Scenario Performance Dashboard

Last updated: April 7, 2026

The Scenario Performance Dashboard provides the essential data you need to efficiently tune and optimize active scenarios. It offers a 6-month historical view, allowing you to focus on long-term effectiveness.

 

Key Performance Metrics (KPMs)

The dashboard centers on two main metrics to guide your adjustments:

  1. True Positive to False Positive Ratio (TP:FP):

    • Goal: A high TP:FP ratio.

    • Meaning: This is the core measure of alert quality. A high ratio means most of your scenario's alerts are valid (True Positives) and not noise (False Positives).

  2. Hit Rate (Detection Frequency):

    • Meaning: How often the scenario triggers.

    • Tuning Insight: If the hit rate is very low, the scenario may be too restrictive. If it's very high, it might be too broad and generating excessive FPs.

 

Scenario Tuning 

After identifying scenarios with low TP:FP ration or too low/too high hit rate, you can use the filters to pinpoint where the poor performance is coming from (a specific customer segment or scenario parameter). You can then modify the scenario's configuration e.g. by adjusting parameters or segment targeting. Finally, the dashboard will show in the following few weeks how the changes have affected the scenario's TP:FP.