View Experience Metrics

When you're creating an experience, you define its goals in the WHY settings. In defining the goals, you define the following:

Monetate can notify you when each KPI reaches confidence within an experience. If you've chosen to automatically push winning tests to 100% of site traffic, the platform does so when the following are achieved:

  • The experience reaches the selected confidence level for one or more of the selected goals and metrics
  • The experience goal reaches confidence with positive or neutral results
  • The experience has no negative lift for any metric with statistical confidence

To enable this setting for an experience, click the additional options menu (...) in Experience Editor, and then click Configure Auto-promotion.

Callout of the 'Configure Auto-promotion' option in the additional options menu in Experience Editor

See Enable Auto-Promotion for Experiences for more information.

Accessing an Experience's Metrics Results

Follow these steps to access metrics results for an experience.

  1. Click ANALYTICS in the top navigation bar, and then select Experience Results.

    Callout of the 'Experience Results' option in the ANALYTICS menu

  2. Search for the experience's entry on the Experience Analytics list page.

    Callout of the search field on the Experience Analytics list page

  3. Click the experience's name.

The Experience Results page opens on the Metrics tab unless the experience hasn't been active for at least 24 hours. In that situation, the Real-Time Counts tab opens. See Real-Time Counts to review what data appears on that tab.

The Metrics Tab

The Metrics tab of the Experience Results page displays information about the performance of each metric included in the experience.

The Metrics tab of the Experience Results page

Monetate reports statistical confidence for each KPI within an experience rather than at the experience level itself. Experience level confidence offers little insight to marketers for some metrics, such as New Visitors, because the sample size for an experience may be larger than that of the KPI. By default, the experience results displays the cumulative results of the experience.

To view a line graph with a breakdown of the experiment and control for any metric in the experience, select an option from and considering. Select an option from Over the period of to change the date range for the results graphed.

Example of a graph breaking down results for a single metric

The graph is broken into three distinct parts: the dark shaded non-confidence region, a green experiment line, and a black control line. The non-confidence region is widest where there are the fewest samples and the highest level of variance in the data. If the experiment line is completely contained inside the gray non-confidence region, the metric has not yet reached a confidence of 95%. When the experiment line breaks out of the non-confidence region, either positively or negatively, the metric has reached at least 95% confidence.

Actionable Results and Pending Tables

If not all the metrics have achieved 95% statistical confidence, then the Metrics tab is divided into the Actionable Results table and the Pending table. The Actionable Results table contains those metrics that have reached confidence, and the Pending table contains those metrics that haven't yet reached confidence.

Example of the Actionable Results table and the Pending table on the Metrics tab of an experience's results

The Pending table includes the time to reach confidence for each metric.

Metrics for Experiences with Splits

The analytics displayed on the Metrics tab for an experience with splits compares the control group with each individual split independently.

Example of the Metrics tab for an experience with splits

To view the graph for an individual metric's performance, first select it from and considering. Next, select an option from and comparing if you want the graph to show the comparison of some combination of splits.

Animated demonstration of a user selecting 'Conversion rate' from the 'and considering' selector and then perusing the options in the 'and comparing' selector, which include 'all splits,' 'A vs A-control,' 'A vs B,' 'B vs B-control' and 'B vs A,' before finally selecting 'A vs A-control'

The default view is the cumulative average over time of how the metric has performed. Click Daily above the graph to view the daily values.

Animated demonstration of a user viewing the cumulative average over time of how the Conversion Rate metric performed in splits B and B-Control, and then clicking 'Daily' to view the daily values

You can change the time range of the data charted by selecting an option from Over the period of.