A/B tests
Last updated
Last updated
Assetario serves its customers with A/B tests for all IAP Recommendation. It is needed to be sure that we provide uplift and measure it correctly.
Usually, we split into two random groups:
Control
Personalized
The customer must agree on the A/B test ratio during onboarding.
Assetario recommended setup is 30/70 for the pilot where testing and optimization are done after the pilot period A/B split should be increased to 80/20.
In case customers want to perform an A/B test themselves, Assetario would appreciate knowing which users are part of the control group and which users are being personalized by Assetario. This serves multiple purposes, namely:
Helps ensure all users who are supposed to be in the Assetario group of the A/B test have actually received personalized treatment and hence rightfully qualify to be evaluated as part of the test.
Allows Assetario to generate performance dashboards and automatically calculate the uplift generated due to Assetario’s personalization engine. This is not possible without knowing which players to compare.
Please, refer to the to see which identifiers Assetario requires.