Statistical Power Calculator
Estimate statistical power and required sample size for a two-proportion test.
How statistical power works
Statistical power is the probability that a test will detect an effect when one truly exists: Power = 1 − β, where β is the probability of a false negative (Type II error).
Power depends on the effect size, the significance level α, the sample size, and the variability of the data. Given any four of these, the fifth can usually be found — this calculator finds power or the required sample size.
V1 supports one clearly defined, common scenario: the two-proportion z-test (e.g., comparing conversion rates in an A/B test) using the standard normal approximation. Other models are not faked — only this scenario is implemented and documented.
The formulas
Power = Φ( δ/SE₁ − z_{1−α/2}·SE₀/SE₁ ) · Power = 1 − β
For two proportions, δ = |p₁−p₂|, SE₀ uses the pooled proportion under the null, and SE₁ uses the two separate proportions. The required per-group sample size is the closed-form solution for a target power. Cohen's h = 2·arcsin(√p₂) − 2·arcsin(√p₁) is reported as the standardized effect size.
Worked example
Baseline 50% → target 60%, α = 0.05
With 200 subjects per group, power is about 0.52 — only slightly better than a coin flip. To reach 80% power for this effect you would need about 388 subjects per group.
Frequently asked questions
What is the difference between α, β and power?
α (alpha) is the significance level — the accepted probability of a false positive. β (beta) is the probability of a false negative. Power = 1 − β is the probability of detecting a real effect.
What is an effect size?
An effect size is a standardized magnitude of the difference you want to detect. Here it is the difference between two proportions, also reported as Cohen's h.
What scenario does this calculator support?
V1 supports the two-proportion z-test (two independent groups with binary outcomes, e.g. A/B conversion rates). Power for other models — t-tests, ANOVA — is not implemented and is not silently approximated.
Related tools
Related guides
Built by PanelRoster
PanelRoster is an enterprise operations management platform for organizations coordinating distributed teams, assignments, workflows, quality assurance and operational execution.
Explore PanelRoster