Daniel Lemire personal blog
Validating UTF-8 bytes using only 0.45 cycles per byte (AVX edition)
When receiving bytes from the network, we often assume that they are unicode strings, encoded using something called UTF-8. Sadly, not all streams of bytes are valid UTF-8. So we need to check the strings. It is probably a good idea to optimize this problem as much as possible. In earlier work, we showed that ……
- Points
- 148
- HN comments
- 51
- Submissions
- 1
- Cited by
- 0 commenters
Systems & PerformanceSoftware Engineering2018
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Oct 20, 2018 | Validating UTF-8 bytes using only 0.45 cycles per byte (AVX edition) by akarambir | 148 | 51 |