Full Unicode Search at 50ร ICU Speed with AVXโ512
ICU gets Unicode right and pays for it. This post shows a different approach: fold-safe windows, SIMD probes, and verifiers for fast UTFโ8 search.
About Building Unum Cloud since 2015. Investing in AI & Infra companies at AAL VC. Computer Science & AI researcher (unpublished, by choice). Twice an Astrophysics dropout, lifelong Bioinformatics fan. Fluent in English, Russian & Armenian. Lived in ๐บ๐ธ๐ฌ๐ง๐ท๐บ๐ฆ๐ฒ & ๐ฒ๐ฝ๐ต๐ฆ๐ฆ๐ท๐ฉ๐ช๐ฆ๐ช๐น๐ญ๐ฒ๐พ๐ป๐ณ๐ฎ๐ฉ. Hosting โSystemsโ meetups in SFโฆ
Visit ashvardanian.com โ RSS feedOn Hacker News May 2023 โ Dec 2025
Systems & Performance 4Software Engineering 3AI & Machine Learning 2Databases & Data 1
ICU gets Unicode right and pays for it. This post shows a different approach: fold-safe windows, SIMD probes, and verifiers for fast UTFโ8 search.
From pure Python to AVX-512 assembly, optimizing cosine similarity reveals a 2,500x speedup through SIMD, FP16, and VNNI instructions on modern Intel CPUs.
Most C++ and Rust thread pools run 10x slower than OpenMP on fork-join workloads. Fork Union closes the gap to 20% with 300 lines, dodging mutexes and CAS.