Daniel Lemire personal blog

Validating UTF-8 bytes using only 0.45 cycles per byte (AVX edition)

When receiving bytes from the network, we often assume that they are unicode strings, encoded using something called UTF-8. Sadly, not all streams of bytes are valid UTF-8. So we need to check the strings. It is probably a good idea to optimize this problem as much as possible. In earlier work, we showed that ……
Points
148
HN comments
51
Submissions
1
Cited by
0 commenters

Systems & PerformanceSoftware Engineering2018

On Hacker News

SubmittedTitle on HNPointsComments
Oct 20, 2018Validating UTF-8 bytes using only 0.45 cycles per byte (AVX edition) by akarambir14851

More from Daniel Lemire

All 87 posts →

Related posts from the same era