vector and full-text search built on object storage: fast, 10x cheaper, and extremely scalable
Visit turbopuffer.com → On Hacker News Jul 2024 – Oct 2026
Databases & Data 4Infrastructure & DevOps 2Tech Industry & Business 1AI & Machine Learning 1
Inaugural blog post about the development of turbopuffer, a search engine that uses object storage and SSD caching for cost-effective, low latency search. This post describes into the motivation behind its creation, its unique architecture, and how it significantly reduces costs for large-scale vector searches…
How to build a single global queue for distributed systems on object storage: Start with a single file on object storage, then add write batching, a stateless broker, and high-availability.