Flags
Learn what each flag means and when to take action.
Flags appear at the top of the experiment dashboard to inform you about the current status of your test. They help you validate your setup, monitor progress, and interpret results.
Below is what each flag means and how to interpret it.
Track your goal
This flag appears if you are not tracking the experiment goal on your website. The Goal Completed is the key conversion event used to calculate variant performance, so it must be correctly implemented for the experiment to produce meaningful results.
If you see this flag, it means that no goal completion events have been recorded for the experiment. Review your event tracking setup to ensure the event is firing as expected.
Experiment in progress
This flag appears when it is still too early to draw conclusions about variant performance. The results are not yet stable because the test has either been running for a short time or has not accumulated enough data. At this stage, performance may fluctuate significantly, so do not expect to infer any reliable insights yet.
To be considered stable, an experiment needs to meet the following criteria:
- Each variant receives at least 1,000 visitors.
- Each variant has at least 25 conversions.
- The test has been running for at least one week.
Recommended winner
This flag indicates that the experiment has reached statistical stability and that one variant is performing better than the others with high confidence.
A variant is recommended as the winner when both of the following conditions are met:
- The Probability to Be Best (PBB) for a variant is above 95%.
- The potential loss of choosing that variant is below 0.1%.
If you see this flag, you can consider ending the experiment and implementing the winning variant on your website.
No clear winner
This flag appears when the experiment has stabilized statistically, but no variant stands out as a clear winner. The performance of the variants is too similar, and even with additional data, a meaningful difference is unlikely to emerge.
In these cases, you may choose to end the test without declaring a winner or explore new hypotheses.
No clear winner between variants
This flag confirms that you ended the experiment without declaring a winner because the variants performed similarly.
Experiment finished
This flag appears after you declare a winner. It shows which variant won and how long the experiment ran.
