
What Is A/B Testing: Statistical Significance and Common Mistakes
This is the CitePep accuracy record for “What Is A/B Testing: Statistical Significance and Common Mistakes”, published by When Notes Fly. It lists every change experts checked and accepted on that page.
What is A/B testing, and the mistake that breaks it: stopping as soon as p crosses 0.05 can push false positives toward 30 percent.
What has been corrected on this page?
Every accepted correction to this page is recorded with the exact change, so readers can see how the page improved over time.
-
The always-valid-inference / Stats Engine work was developed at Optimizely, not Airbnb
Beforequantified this rigorously in a 2017 paper on "always valid inference" developed while working at Airbnb
Afterquantified this rigorously in a 2017 paper on "always valid inference" developed while working at Optimizely
Why: Verified fix already fully applied in article body and references list. Other 'Airbnb' mentions in the article are legitimate, unrelated references to Airbnb's own marketplace experimentation research. No secondary leftovers found in FAQ.
View the full record →
Who checked this page?
1 contributor has checked "What Is A/B Testing: Statistical Significance and Common Mistakes" on When Notes Fly. Each name below links to that person's public CitePep profile, where every contribution they have made is listed with the exact change they proposed.