What Is A/B Testing: Statistical Significance and Common Mistakes
Technology Corrected & verified

What Is A/B Testing: Statistical Significance and Common Mistakes

Published by When Notes Fly · View original ↗

A/B testing is how companies make evidence-based product decisions. Learn how statistical significance works without jargon, how to avoid common...

What has been corrected on this page?

Every accepted correction to this page is recorded with the exact change, so readers can see how the page improved over time.

  1. 12 July 2026 · corrected by Melik Can Sariyer

    The always-valid-inference / Stats Engine work was developed at Optimizely, not Airbnb

    Before

    quantified this rigorously in a 2017 paper on "always valid inference" developed while working at Airbnb

    After

    quantified this rigorously in a 2017 paper on "always valid inference" developed while working at Optimizely

    Why: Verified fix already fully applied in article body and references list. Other 'Airbnb' mentions in the article are legitimate, unrelated references to Airbnb's own marketplace experimentation research. No secondary leftovers found in FAQ.

    View the full record →

Who checked this page?

1 contributor has checked "What Is A/B Testing: Statistical Significance and Common Mistakes" on When Notes Fly. Each name below links to that person's public CitePep profile, where every contribution they have made is listed with the exact change they proposed.

Melik Can SariyerExpert Contributor