Optimization Test Confidence Calculator

I’m not sure if this calculator will be of much use to anyone but I am constantly being asked questions like “how many visitors do I need to include in my test?”, “when will I have enough conversions to make a decision on a winning treatment?”, and “what kind of conversion rate will I need before I reach statistical significance?”

So, I built this confidence calculator to answer all of those questions. The calculator uses the same underlying statistical calculations used by Omniture Test & Target. It gives you the ability to run “what if” analysis to determine what type of volume and conversion rates you need to see in order to reach an optimal level of statistical significance. The calculator also allows you to quickly determine statistical significance for optimization tests that you may run outside of a standard optimization platform, where such calculations may not be readily available to you.

The calculator is free to use. If you make use of the calculator, I’d appreciate any feedback on issues, bugs, ideas on how to enhance, etc.