Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
SQLite: Wal2 Mode
"Wal2" mode is very similar to "wal" mode. To change a database to wal2 mode, use the command:
Discovering Millions of Datasets on the Web
Dataset Search launches publicly with an index of 25 million datasets, helping scientists, journalists, students, data geeks to find data.
Case study: Algorithmic trading with Go
In this case study, we are excited to share an insider's perspective and look under the hood of how a Massive.com customer built an automated retail trading bot that is capable of monitoring the entire stock market in real-time.
Advanced SQL and database books and resources
For people who've worked through Mastery with SQL , a common question I get is "What's next?" If you completed the course and all 150+ exercises, at this point you'll have a very strong grasp of SQL and should be comfortable writing all sorts of complex queries. However, there's more to working with databases…
Things I hate about PostgreSQL (2020)
Over the last few years, the software development community’s love affair with the popular open-source relational database has reached a…
Learn SQL Interactively on Khan Academy
There are millions of SQL users around the world. Who are these people, what is SQL, and what are they all using it for? Start learning S...
How Discord Stores Billions of Messages Using Cassandra
Discover the latest news and app updates, stories, company insights, and plenty more about Discord, all in one place.
Postgresql 9.3 Released
The PostgreSQL Global Development Group announces the release of PostgreSQL 9.3, the latest version of the world's leading open source …
Beating GPT-5.6 Sol on retrieval with 100x cheaper open models
A 4B open-source model post-trained with Castform retrieved search results as accurately as GPT-5.6 Sol, while costing 100x less.
Personal Data Warehouses: Reclaiming Your Data
I gave a talk yesterday about personal data warehouses for GitHub’s OCTO Speaker Series, focusing on my Datasette and Dogsheep projects. The video of the talk is now available, and …
How Discord stores trillions of messages (2023)
Engineer Bo Ingram shares insight into how Discord shoulders its traffic and provides a platform for our users to communicate.
SQL Keys in Depth
The internet is full of dogmatic commandments for choosing and using keys in relational databases. At times it verges on a holy war: should you use natural or artificial keys? Auto-incrementing integers, UUIDs?
Instant database clones with PostgreSQL 18
Learn how to clone PostgreSQL databases instantly using reflinks. Turn slow template copies into milliseconds with PostgreSQL 18's new file copy options.
SQL should be the default choice for data transformation logic
SQL should be the first option considered for new data engineering work. It’s robust, fast, future-proof and testable. With a bit of care, it’s clear and readable.
How Google Code Search Worked: Regex Matching with a Trigram Index (2012)
In the summer of 2006, I was lucky enough to be an intern at Google. At the time, Google had an internal tool called gsearch that acted as if it ran grep over all the files in the Google source tree and printed the results. Of course, that implementation would be fairly slow, so what gsearch actually did was talk to a…
PingCap TiDB Leaks
PingCAP Inc. / TiDB Cloud • Distributed databases • 10.6 TB total exfiltration • 200 GB stage one release
Jepsen: NATS 2.12.1
NATS is a popular streaming system. Producers publish messages to streams , and consumers subscribe to those streams, fetching messages from them. Regular NATS streams are allowed to drop messages. However, NATS has a subsystem called JetStream , which uses the Raft consensus algorithm to replicate data among nodes…
Emerging Architectures for Modern Data Infrastructure
To help data teams stay on top of the changes happening in the industry, this article reviews an updated set of data infrastructure architectures.
Pg_GraphQL: A GraphQL Extension for PostgreSQL
GraphQL support is in development for PostgreSQL + Supabase.
Unconventional PostgreSQL Optimizations
Creative ideas for speeding up queries in PostgreSQL
Litestream v0.5.0
Same Litestream goodness but better, faster, stronger
Writing a SQL database from scratch in Go
Writing a SQL database from scratch in Go: 1. SELECT, INSERT, CREATE and a REPL
Excel Never Dies
The Spreadsheet That Launched A Million Companies