Viewing A/B testing results requires filtering a selected dashboard widget by your configured variants and comparing it to a similar dashboard widget filtered to the baseline. This allows brand admins to see both the cohort of customers who when through the normal policy set, the Baseline, and the alternative policy set, the Variant. See Configure an A/B test to learn about how to create variant policy sets.

Setting up an A/B test dashboard

Strivacity’s advanced dashboard capabilities allow you to add widgets to an existing dashboard or create a new dashboard for viewing your A/B testing results. Setting up a new dashboard can be the best way to keep your A/B testing data separate from your normal dashboard data. The following example explains how to set up a simple comparison between a baseline and a variant.

To set up a custom A/B test dashboard:

1. First, create a new tab in the Dashboard for your test.
2. Next, add two widgets of the same type. Dashboard metrics
3. Set the dashboard time filter to reflect the time period of the A/B test.
4. Set the dashboard variant filter on one of the widgets to the baseline variant of the application you are testing.
5. Set the dashboard variant filter on the other widget to the desired variant you want to compare to the baseline.
6. Check your dashboard after the A/B testing period has ended to see the results.
7. Make any policy changes that showed positive results permanent to the application, if desired.

What to look for in the data

A/B testing is a great way to understand how to improve your account onboarding experiences. Brand admins typically value registration session times, failure trends, failure reasons, and steps where failures and abandonments occur. Strivacity provides data visualizations for all of these metrics, making it a snap to compare and make informed decisions about your policy configurations.