Skip to main content

Deflection A/B testing

Prosper planEnterprise plan

Like offer A/B tests, deflection A/B tests let you compare performance in a scientific way. Use a control and one or more variants to test which deflections produce the best retention outcomes.

Deflection A/B test dashboard

Creating an A/B test​

To create a deflection A/B test, you need at least two deflections. Navigate to Deflections and select A/B tests, then click Create A/B test.

Creating a deflection A/B test

Enter a unique Name, select a deflection as the Control and select another deflection as Variant 1.

Optionally add Variant 2.

Sticky assignment​

By default, an A/B test uses sticky assignment: once a subscription is assigned a variant, it will keep seeing that same variant every time it enters the test. This keeps the experience consistent for a given customer across multiple cancellation attempts.

If you'd rather have each cancellation attempt independently assigned a variant at random — rather than sticking to whatever the subscription saw previously — uncheck Sticky assignment when creating or editing the test.

Variant weights​

Enterprise plan

Deflection A/B test variant weights

Weights control how likely a customer is to see a variant in an A/B test. For example, you can use weights to roll out a new deflection to a small percentage of customers to validate effectiveness before committing to a full launch.

Using an A/B test in a cancellation flow​

Use a deflection A/B test in the flow

To activate an A/B test, select the test in the deflection rules editor in a cancellation flow. When the rule containing an A/B test is matched, the subscriber will be presented a deflection from the A/B test, chosen according to the variant weights and the test's assignment setting. ProsperStack will track the results and update your A/B test metrics in real-time.

Ending an A/B test​

Ending a deflection A/B test

Click End test to stop a running A/B test and choose a winning deflection. If no variant has reached statistical significance yet, you'll see a warning before confirming a winner. Once a winner is chosen, that deflection is shown to all customers going forward, and the test's results are preserved for reference.