Review and Analyze

Monetate tracks and reports on a variety of metrics. The following key performance indictators (KPIs) work out of the box without any additional tracking from the Monetate API:

  • Bounce rate
  • Average page views
  • Average time on site

With that said, you may want to track myriad of other metrics.

Each experience has its own Experience Results page that shows the performance of individual metrics in the experience. Monetate reports confidence for each KPI within an experience rather than at the experience level itself. Experience-level confidence offers little insight to you for some metrics, such as New Visitors, because the sample size for an experience may be larger than that of the KPI.

To access an experience's Experience Results page, first click the Experience Results option from the ANALYTICS drop-down menu to navigate to the Experience Analytics page. Next, click the name of the experience for which you want to review the results to access its Experience Results page. By default, the Experience Results page for each experience displays the cumulative results of that experience.

The Real-Time Results tab of the Experience Results page for a Persona-Driven Banner Web experience, as seen in an old version of the Monetate user interface

Every experience contains visualizations of test performance that include the following information:

  • Statistical confidence reported for all KPIs

    The Actionable Results section of the Experience Results page, as seen in an old version of the Monetate user interface

  • Estimated time to confidence for KPIs with less than 90% confidence

    The Pending table of metrics results on the Experience Results page, as seen in an old version of the Monetate user interface

Best Practices

It's important to regularly observe the data in any active experiences. That said, you should ensure the data in an active experience has reached statistical confidence before you make any changes or stop it.

Regular observation of data is especially important with Automated Personalization experiences. Before variants in an Automated Personalization experience have received sufficient traffic, allocation may fluctuate. Don't panic because this behavior is normal. The Monetate Personalization Engine continuously learns about your customers, so the longer you let an Automated Personalization experience run, the more data the platform collects so that you can make better decisions.

Dynamic Testing experiences work best for flash sales and other short-lived promotions. For that reason, you should keep an eye on their performance and what was successful for future experiences—and not necessarily to make changes to an already running experience.

Scratching the Surface

Everything presented in the methodology training materials is only the baseline for the strategic approach you can take within Monetate. The Strategy & Insights team is here to help develop a personalized approach to your specific business goals. For more information, contact your Client Success Manager.