The Experiments report helps merchants to make data-empowered decisions using the details from A/B Testing experiments. This page lists an overview of every experiment created in the console, both past and present. Click into any one of these experiments to see the full report.
Note: This feature is available on the Advanced and Expert plans. If you're interested in taking advantage of it, please reach out to your customer success manager.
Note: Visualizations (widgets) are sorted in descending order.
To see more about general report functionality, such as date ranges, scheduling, and downloads, click here.
Current Experiments tab
This tab displays all current campaigns with experiments. Experiments that have had a winner selected will move automatically to the Past Experiments tab. Click the name of any experiment to see its full report.
Note: If a winner isn't selected, Athos will default the winner to the variation set as the control.
Experiment
This column lists the name of the experiment, which is also a link directly to that experiment's report.
Campaign
This column lists the name of the campaign associated with the experiment.
Type
This column displays the type of campaign, such as "search" or "segment".
Context
This column provides details of the context for the campaign and how it is triggered, whether it's a search campaign or category campaign. Mouse over the number under the Context column to see details.
Variations
This column displays how many variations of the campaign are being used in the selected experiment.
Date Started
This column provides the date when the experiment started.
Time Left
This column shows how much time is left for the experiment.
If there are no current experiments, you will be directed to your campaigns page to create a new active experiment.
Past Experiments tab
This tab displays any previous experiments that have ended.
Click any campaign name to see the report for that experiment.
Experiments Report
Click the name of the experiment, which will open a link to a report specifically about this campaign. This report shows the metrics of performance for each variation during the lifetime of the experiment. If the experiment has been completed, the winning variation will be bolded and highlighted. If you haven't chosen a winner to complete the experiment, you can click Select Winner to make your final selection.
Duration
This column shows the date span of the report for the duration of the experiment.
Report options
The report has various tools that allow you to easily navigate its data. A three-dot menu to access these tools is available at the top right of the report and also within the main graph/chart for this report. Simply mouse over a visualization or the chart to see the available options, which may differ for each visualization on the page.
If you decide to download the report or an element of the report (such as a chart or visualization), select "Download" to choose between an .xlsx or .csv export, or choose "Present" to see a full-screen version of the report.
Note: Some reports will also have .pdf as a download option.
Views Breakdown
This visualization shows the views reported for each variation of the experiment.
Conversions Breakdown
This visualization shows the conversions reported for each variation of the experiment.
Revenue Breakdown
This visualization shows the revenue reported for each variation of the experiment.
Experiment Results
This visualization shows an overview of experiments on your site, both past and present.
Variation
This column describes the variations used in the selected experiment.
Split
This column displays how the variations are split in percentage of presentation to shoppers. In the example shown above, two variations are each shown to 33% of users, while the third variation is shown to 34% of users.
Views
This column denotes how many views the selected variation has received during the experiment.
Transactions
This column lists how many transactions took place with the selected variation.
Revenue
This column displays the revenue from transactions within the selected variation.
Conversion
This column displays the percentage of conversions that occurred within the selected variation.
AOV
This column displays the average order value (AOV) of transactions that occurred within the selected variation.
RPV
This column displays the revenue per visit (RPV) for the selected variation.
Adding a Filter
To add a filter to the report, right-click any variation and click "Filter".
The report will update to reflect the filter applied:
To remove the filter from the report, click the "Clear all" button at the top left of the page. This will remove the filter applied and reset the report to its original state.
Comments
0 comments
Article is closed for comments.