A/B testing

An A/B test is an experiment in which the current settings apply to one part of the impressions in the Yandex Mediation unit (Control), and alternative settings to the other part (Test). Based on the test results, you can compare how effective Control and Test settings are and decide whether to keep the current settings for all impressions or apply new ones.

Creating an A/B test

To create an A/B test:

1. Open the settings of the unit you want to run the test for.

2. Go to Networks and click Create A/B test. Settings for Test will open.

3. Enter the name of the A/B test.

4. Choose the size of the test group (from 10% to 50%): this is the percentage of traffic that will go to Test.

5. Specify the test period. The recommended period is at least 7 days.

6. Configure alternative settings for Yandex Mediation. What you can change:

   • Redefine ad sources by adding or removing ad networks in the unit.
   • Change the Smart Waterfall sequence by experimenting with eCPM values for different ad networks.

   Note

   We recommend changing one setting for one test (for example, add one ad network and leave other settings unchanged): this makes it easier to analyze the results.

7. Click Save.

You can't change unit settings during the test.

Test statuses

Running tests have the Active status.

If the test period has ended, but no decision has been made based on its results, the test status changes to Expired.

Completed tests have the Stopped status.

Chat with us