1
From text to token: How tokenization pipelines work
Understanding how search engines transform text into tokens through character filtering, tokenization, stemming, and stopword removal.
ParadeDB Blog
Just use Postgres. ParadeDB makes text and vector search, filters, facets, and joins fast in Postgres. Home of the pg_search extension.
- Popular posts
- 4
- Total points
- 692
- HN comments
- 200
- Rank
- #1,946 company
Visit paradedb.com → RSS feedOn Hacker News Jul 2025 – Mar 2026
Systems & Performance 3Databases & Data 3Software Engineering 1AI & Machine Learning 1