Skip to main content
For Advanced Personalization, A/B testing compares two sets of search results to determine which one performs better. The A and B variants are based on the personalization re-ranking level. This helps you find the level that maximizes user engagement and satisfaction.
This feature isn’t available on every plan. Refer to your pricing plan to see if it’s included.

​
Prepare to A/B test Advanced Personalization

Before setting up an A/B test, make sure you have configured Advanced Personalization on the dashboard: Alternatively, you can use the Advanced Personalization API to configure Advanced Personalization.

​
Launch an A/B test

Dashboard interface for launching an A/B test

Dashboard interface for launching an A/B test

You can launch an A/B test directly from the Advanced Personalization dashboard:
  1. Select the index on which you want to A/B test personalization. This is the index for which search results will be compared. You only have access to indices that are configured to use Advanced Personalization.
  2. Define the personalization re-ranking level for the A/B test. This is the level of personalization you want to A/B test against the personalization re-ranking from the configuration.
  3. Set the percentage of traffic. This is the share of searches that will be boosted according to the personalization re-ranking level set.
  4. Set the duration of the test. This is the maximum duration of time the A/B test will be live after you start it. For the best results, set a duration that is more likely to lead to high confidence in results.
  5. Launch A/B test. This triggers the launch of the A/B test. Your users now receive personalized search results based on your setup.

​
View the results of an A/B test

You can view the results of all Advanced Personalization A/B tests in the A/B testing dashboard.

​
A/B test real-time personalization

Beta Real-time personalization is a beta feature according to Algolia’s Terms of Service (“Beta Services”).
You can also use A/B testing to determine if real-time personalization is the right option for your application. After testing historical personalization, you can test the impact of real-time personalization to see if this approach leads to more engagement. You can measure the impact of real-time personalization in two ways.

​
Measure combined impact of real-time and historical personalization

  1. Ensure that you have setup real-time personalization in the Advanced Personalization dashboard.
  2. Repeat the steps in the launching an A/B test section.
The results of the A/B test will show you how real-time personalization combined with historical personalization affects user engagement compared to no personalization.

​
Next steps

⌘I