A/B Testing
- Hadas Makovsky (Unlicensed)
Creating an A/B test is now easier than ever!
With our system you can easily compare performance and understand the value of the new layout configuration
In Order to create a new A/B Testing for Layouts:
On The Left Sidebar Menu, Under “Inventory Management”, Select -> “Layouts”
On The Top Right Menu, Select A/B Testing
2. Select the Site where the test should be applied on and the device.
3. Name the Test Layout and Name your 2 Test Groups (For Example: One Might be “Control” and the other “Test”, Or alternatively 2 Test variants) and Allocate traffic % per each group
4. Select the correct targeting for the whole layout:
Traffic source - Direct /Search/ Social
Query Params - Select whether the test should be applied to a specific inventory/User/Scenario based on a KV variable (Optional)
Specific URL - Choose whether the test should be applied to all Site’s inventory or specific URL only (Contains/Equal)
Countries - Select whether the test should be applied to All/specific countries (Include/Exclude)
Operating Systems - Select whether test should be applied to All/specific OS
5. Create the desired serving policy for each variant created, Add Ad type to be configured
For each Ad type the following options can be configured:
Creative size to be supported under the selected ad type
Viewability Optimization: Choose whether Browsi’s AI Viewability Optimization should be applied to variant
Max Ads: Select Maximum ads to be allowed under that placement (relevant to inline ads only):
Target Placement - Select specific Placement (Div Selector in CSS) on page where Ad should be served.
After saving layouts for the 2 test variants, Test/Experiment should be activated by the “Activate” Button, positioned under the Test setting box.
AB Testing Layouts Overview
All Layouts (Defaults / Tests) are displayed under Inventory Management -> Layouts
Please note that as a default option, Only Layouts in “Active” status are displayed.
In order to see all layouts (including non-active), you may remove the “Active” Tag.
Layouts are categorized to domains and displayed per Device Type (Desktop / Mobile &Tablet).
AB Testing Performance Data
Performance Data of experiments can be reached by clicking the A/B Test Tab on in the left hand side navigation bar, or alternatively on Layouts Page, by clicking the 3 Dots next to the Test name and selecting “Dashboard”.
Best Practices for Layouts AB Testing:
Define Mild/Aggressive Ad Serving policies, where “Aggressive” allows:
Additional Sizes Per same ad unit
A greater maximum number of ads per page
Less restrictions on page positions
Try running the more aggressive policy on “long tail” segments:
Geos - Non-core Traffic
Traffic Sources - Social traffic Users
URLs - Specific Site Sections