/
A/B Testing

A/B Testing

Owned by Hadas Makovsky (Unlicensed)
May 24, 2023
3 min read

Creating an A/B test is now easier than ever!
With our system you can easily compare performance and understand the value of the new layout configuration

 

In Order to create a new A/B Testing for Layouts:

  1. On The Left Sidebar Menu, Under “Inventory Management”, Select -> “Layouts”

On The Top Right Menu, Select A/B Testing

Enter the Layout tad and choose an A/B Test type of layout

2. Select the Site where the test should be applied on and the device.


3. Name the Test Layout and Name your 2 Test Groups (For Example: One Might be “Control” and the other “Test”, Or alternatively 2 Test variants) and Allocate traffic % per each group

4. Select the correct targeting for the whole layout:

  • Traffic source - Direct /Search/ Social

  • Query Params - Select whether the test should be applied to a specific inventory/User/Scenario based on a KV variable (Optional)

  • Specific URL - Choose whether the test should be applied to all Site’s inventory or specific URL only (Contains/Equal) 

  • Countries - Select whether the test should be applied to All/specific countries (Include/Exclude)

  • Operating Systems - Select whether test should be applied to  All/specific OS

5. Create the desired serving policy for each variant created, Add Ad type to be configured

Choose the ad types you would like to configure for each layout

For each Ad type the following options can be configured:

  • Creative size to be supported under the selected ad type

  • Viewability Optimization: Choose whether Browsi’s AI Viewability Optimization should be applied to variant 

  • Max Ads: Select Maximum ads to be allowed under that placement (relevant to inline ads only):

  • Target Placement - Select specific Placement (Div Selector in CSS) on page where Ad should be served.

After saving layouts for the 2 test variants, Test/Experiment should be activated by the “Activate” Button, positioned under the Test setting box.

AB Testing Layouts Overview

All Layouts (Defaults / Tests) are displayed under Inventory Management -> Layouts

Please note that as a default option, Only Layouts in “Active” status are displayed.

In order to see all layouts (including non-active), you may remove the “Active” Tag.

Layouts are categorized to domains and displayed per Device Type (Desktop / Mobile &Tablet).

AB Testing Performance Data

Performance Data of experiments can be reached by clicking the A/B Test Tab on in the left hand side navigation bar, or alternatively on Layouts Page, by clicking the 3 Dots next to the Test name and selecting “Dashboard”.

 

Navigation bar
Layouts Page

Best Practices for Layouts AB Testing:

Define Mild/Aggressive Ad Serving policies, where “Aggressive” allows:

  • Additional Sizes Per same ad unit

  • A greater maximum number of ads per page

  • Less restrictions on page positions

Try running the more aggressive policy on “long tail” segments:

  • Geos - Non-core Traffic

  • Traffic Sources - Social traffic Users

  • URLs  - Specific Site Sections 

Related content