John D. Cook personal blog
The quadratic formula and low-precision arithmetic
The familiar quadratic formula can give the wrong answer in a program due to numerical precision issues. This post shows what can go wrong and how to fix it. Especially important in low-precision arithmetic.
- Points
- 147
- HN comments
- 41
- Submissions
- 1
- Cited by
- 0 commenters
Math & AlgorithmsSoftware Engineering2018
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Apr 28, 2018 | The quadratic formula and low-precision arithmetic by ingve | 147 | 41 |
