Offer A/B testing
Prosper planEnterprise plan
Offer A/B testing allows you to pit offers against each other to measure their effectiveness and optimize your accept rates.
ProsperStack will track and compare the accept rates of the offers in an A/B test automatically so you can determine which offers will help increase retention the most.
Creating an A/B test
To create an offer A/B test, navigate to the Offers screen and click the A/B tests button at the top of the page. Click Create an A/B test to create a new test. You'll need to have at least two offers available in order to create an A/B test.
Select an offer to act as your control and up to two variants to test.
Variant weights
Enterprise plan
Weights control how likely a customer is to see a variant in an A/B test. For example, you can use weights to roll out a new offer to a small percentage of customers to validate effectiveness before committing to a full launch.
Using an A/B test in a cancellation flow
To activate an A/B test, select the test in the offer rules editor in a cancellation flow. When the rule containing an A/B test is matched, the subscriber will be presented a random offer from the A/B test. ProsperStack will track the results and update your A/B test metrics in real-time.
Ending an A/B test
When your A/B test has collected enough data to determine a winning offer, you can end the test by clicking the End test button. If a statistically significant winner can be determined automatically, it will be pre-selected. Confirm the winning offer to end to test.
Once a test is complete, only the winning offer will be presented in any cancellation flows using the A/B test.