Topics /
The most popular blog posts about databases & data on Hacker News. 185 posts.
A new search engine in 2024? Yes, but stateless — index on S3, serverless — no cluster state, with all Lucene features — filters, autocomplete, facets. And also with local embedding & RAG inference.
By combining two types of remote sensing data, we can see hidden leaks from ships
Meet pgvectorscale, an open-source PostgreSQL extension that supercharges pgvector’s vector search performance for large-scale vector workloads.
We analyzed topics covered by 100k Hacker News posts and the sentiments they evoke using Metaflow.
Uber connects the physical and digital worlds to help make movement happen at the tap of a button. Billions of trips, deliveries, and tens of billions of financial transactions across earners, spenders, and merchants are made at Uber every quarter. LedgerStore is an immutable storage solution at Uber that provides…
Let's look at the numbers behind Xata's free tier. How much does a database cost us and why are we offering them for free.
At SQLite Cloud, we are dedicated to making database management as seamless and intuitive as possible. Today, we are thrilled to unveil a groundbreaking addition to our platform - the Interactive SQLite Documentation! Now, alongside our comprehensive...
We respond to Pinecone's recent blog post comparing Postgres and Pinecone. We show that Postgres can outperform Pinecone in the same benchmarks Pinecone covered in their article.
The query optimizer is an important part of any analytical database system as it provides considerable performance improvements compared to hand-optimized queries, even as the state of your data changes.
A deep dive into the Probabilistic B-tree or Prolly Tree data structure including examples. Prolly Trees are used to create version controlled databases.
Why are streaming joins so tricky? Discover the hidden complexities of real-time data, and learn how to tame the infinite stream!
Tiny diatoms in the ocean are masters at capturing carbon dioxide (CO2) from the environment. They fix up to 20 percent of the Earth’s CO2. A research team at the University of Basel has now discovered a protein shell in these algae that is necessary for efficient CO2 fixation. This groundbreaking discovery can…
Quickwit 0.8 brings indexing and search at an unprecedented scale, indexing at 1PB/day and searching through 50 PB is a reality.
Maximize the performance of your hardware with memory access amortization
Arroyo 0.10 has an entirely new SQL engine built with Apache Arrow and DataFusion. It's much faster, smaller, and easier to run. Read on for why and how we're making this change.
Alberto Ordonez Pereira | Senior Staff Software Engineer; Lianghong Xu | Senior Manager, Engineering;
A whistlestop tour of the cool bits of DuckDB
We discuss streaming and vectored I/O in Postgres 17. This is an important step towards implementing asynchronous I/O in Postgres. In Postgres 17 we do not yet have asynchronous I/O, but we do see a performance benefit from what is essentially a refactoring work around the internal APIs.
The "Ask HN: Who is hiring" monthly post on Hacker News, available on the first day of each month, provides a platform for users to share tech job listings for free. Analyzing 10 years of these posts with a Python script reveals significant shifts in hiring trends. This insight into the evolving tech job market can…
Index creation time is a critical database metric. Learn more about how Lantern enables 90x faster index creation times than pgvector, and how Lantern compares to Pinecone.
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database realm. The trend of “Using Postgres for Everything” is no longer limited to a few elite teams but is becoming a mainstream best practice.
In this post we take you on a walkthrough on how you can use DataFusion to build your own developer experience for databases.
The past few weeks have been nuts, and we’ve been itching to share some huge news with you all… 🥁 Langflow is joining DataStax!
Andy recounts the rise of vector databases to SQL:2023 to MariaDB troubles and the FAA outage in 2023.
Explore DuckDB Wasm for fast, in-browser analytical SQL. Learn how to instantiate the JS API, query Parquet files, and export data to CSV with zero latency. | Reading time: 8 min read
Or why clear consistency guarantees are how to stay sane when programming distributed systems.
Posted by Long Zhao, Senior Research Scientist, and Ting Liu, Senior Staff Software Engineer, Google Research An astounding number of videos are av...
I spent the last week looking for a memory leak in Postgres’s WAL Sender process. I spent a few days getting more acquainted with Valgrind and gcc/clang sanitizers, but ultimately got nowhere useful with them. Finally, I stumbled on the memleak program from the bcc tools collection which led me right to the source…
