Steve Hanov personal blog
20 lines of code that beat A/B testing every time
<img src="http://research.microsoft.com/en-us/projects/bandits/MAB-2.jpg"/> A/B testing is used far too often, for something that performs so badly. It is defective by design: Segment users into two groups. Show the A group the old, tried and true stuff. Show the B group the new whiz-bang design with the bigger…
- Points
- 989
- HN comments
- 559
- Submissions
- 4
- Cited by
- 7 commenters
Software EngineeringTech Industry & Business2012
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| May 29, 2012 | 20 lines of code that beat A/B testing every time by spiffytech | 989 | 147 |
| Apr 6, 2016 | 20 lines of code that beat A/B testing (2012) by _kush | 545 | 157 |
| Jan 9, 2025 | Lines of code that beat A/B testing (2012) by Kerrick | 379 | 176 |
| May 27, 2019 | The multi-armed bandit problem (2012) by navigaid | 303 | 79 |
Cited in comments
Linked from 7 Hacker News comments by 7 different people, from May 2012 to Jan 2025.
Most recent:
- nayuki · Jan 13, 2025
- panda427 · Sep 28, 2018
- duhruh · Dec 4, 2015
- relaunched · May 6, 2013
- juan_juarez · Aug 1, 2012
- DrDub · Jun 19, 2012
