The report of an A/B test shows the performance of different variations for the overall traffic of your website. To analyze the test further, customers often use report filters to view data for a particular visitor segment. Previously, if someone wanted to view data for multiple segments, they had to view reports for each segment separately. But not anymore. We have now added a feature to compare two or more visitor segments in the same report.
For example, if you want to view the conversion rate of visitors from mobile and desktop, rather than opening them individually, you can now compare them. With this capability, you can add segments from Segment Gallery, My Segments, and even include one custom segment to the comparison.
Some questions that you can answer using this feature:
- How did the different variations perform across segments?
- What is the improvement of a variation over baseline across segments?
- What is the overall conversion rate of each segment?
- What is the overall size of each segment (say by traffic type – direct, referral, social, etc.) in the test?
VWO also allows you to compare multiple segments and multiple goals in the same view. This adds a new dimension to the report as shown in the screenshot below.
Note: This feature is available for all customers on VWO Testing Pro and Enterprise plans.
To learn more about comparing multiple segments, refer to this knowledge base article.