What test is used?
A two-sided pooled two-proportion z-test using a normal approximation.
THE TOOLBOX / SCHOOL & STATISTICS UTILITIES
Calculate a two-proportion A/B test p-value and approximate sample size locally.
Enter visitors and conversions to run a two-proportion Z-test or plan your sample size.
Click “Analyze results” or “Calculate sample size” to generate a text summary.
Assumes two independent groups with fixed sample size and sufficient expected counts (≥ 5 per cell). Repeated peeking without sequential correction inflates false positives.
THE DETAILS
The test uses a large-sample approximation described in the NIST two-proportion test reference.
A two-sided pooled two-proportion z-test using a normal approximation.
Groups should be independent with a fixed sample and sufficient expected counts. Repeated peeking and multiple comparisons affect results.
A normal approximation estimates equal group sizes from baseline and target rates, confidence and power.
No. P-values and sample sizes depend on assumptions and do not measure practical significance.
No. Calculations run locally.