Note:
The calculator is designed for VWO's enhanced SmartStats engine.
To get estimates using the classic stats engine, please use this calculator instead.
Say hello to enhanced SmartStats - our Bayesian-powered sequential testing engine
Get actionable results faster
Get clear insights on whether your variations outperform, underperform, or match the baseline. Our engine automatically recommends disabling underperforming variations to speed up results with fewer visitors. Plus, SmartStats tracks your experiment’s health—monitoring minimum run-time, data tracking, and more—while alerting you to errors for quick corrective action. Ensure reliable, faster results with confidence.
Take complete control of statistical parameters
No more one-size-fits-all experiments. With enhanced SmartStats, you can fine-tune statistical parameters—like Region of Practical Equivalence, Statistical Power, False Positive Rate, and Minimum Detectable Effect—based on your priorities. Set higher precision for critical experiments, such as revenue tests, and lower precision for low-priority ones like design tweaks. Tailor your approach for smarter, more efficient experimentation.
Pick between improvement and non-inferiority modes
Choose your testing objective based on your needs: "strict improvement" for guaranteed uplifts, or "improvement or equivalence" to maintain your guardrails. For accurate, error-free results, use the Fixed horizon approach, which only calculates statistics after the full sample size is reached. Alternatively, the Sequential testing approach adjusts for peeking errors, ensuring your reports are always accurate, no matter when you check them.