Creative Testing Duration Forecaster
Know how many days a creative test needs before you can trust the result.
This test needs ~40 days, long enough that fatigue and seasonality creep in. Cut variants, raise budget, or lower the per-variant bar.
Rule of thumb: ~100 conversions per variant for a directional read, more for small lifts. Ending early is the most common testing mistake.
About this calculator
Calling a creative test winner after three days is the single most common way teams crown noise as a result, because a stable read needs a real sample, not a schedule that felt long enough. This calculator forecasts exactly how many days a test needs, from daily spend, expected CPA, variant count and your target conversions per variant, so you have a concrete end date before you start instead of an impulse to stop early.
How to use it
- Enter your daily test spend and expected CPA per variant.
- Enter the number of variants you're testing and the conversions needed per variant for a stable read.
- Read the forecasted test duration, the date it finishes, and the estimated total test cost.
- Don't call a winner before the forecasted duration completes, even if one variant looks ahead early.
Methodology
Total conversions needed is variants × conversions needed per variant, the aggregate sample size across the whole test.
Conversions per day is daily spend ÷ expected CPA, and test duration in days is total conversions needed ÷ conversions per day.
Estimated test cost is duration × daily spend, and the finish date is simply today plus the calculated duration.
The default target of roughly 100 conversions per variant is a common rule of thumb for a directional read, not a statistically rigorous significance calculation; smaller expected lifts between variants need a larger sample than this to be trustworthy, while dramatic differences can sometimes be read with less.
FAQ
Long tests are more exposed to confounding factors, seasonality shifts, creative fatigue setting in mid-test, or audience composition drifting, any of which can contaminate the read. A test stretching past a month is often a sign to cut variants or raise budget rather than let external noise creep in.
It's a reasonable floor for a directional signal, especially when the difference between variants is large and obvious. For subtle lifts (a 5-10% CTR difference, for example) you generally need a considerably larger sample to be confident the result isn't noise.
Raise daily spend to shorten the timeline, reduce the number of variants being tested simultaneously so each gets more of the traffic, or lower the per-variant conversion bar if you can accept a less statistically rigorous, more directional read.
Early results are disproportionately driven by whichever variant randomly gets a lucky run of conversions first. That early lead frequently narrows or reverses as the sample grows, which is exactly what the forecasted duration here is meant to protect against.