A/B Test Significance Calculator

Check whether an A/B test result is statistically significant: conversion rates, lift, confidence and p-value.

Runs instantly in your browser — results update as you type.

How do I know if my A/B test is significant?

An A/B test is statistically significant when the difference between variants is unlikely to be random. With a two-proportion z-test, a p-value below 0.05 means significance at 95 % confidence.

How to use the A/B Test Significance Calculator

    Frequently asked questions

    What does the p-value mean?

    The probability of seeing a difference at least this large if the variants were actually the same.

    Is 90% confidence enough?

    It can be for low-risk changes; 95 % is the common standard.

    Is this one-tailed or two-tailed?

    Two-tailed, which is more conservative.