Topics /
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
After going viral, there is one comment I'd like to address. One guy pointed out how comfortable this work seemed, how high the pay was, and said I am out-of-touch and privileged. To that I say, yes, obviously . I moved to the first-world to have first-world problems. Mission accomplished.
Please note: our followup analysis of 3.4.0-rc3 revealed additional faults in MongoDB’s replication algorithms which could lead to the loss of acknowledged documents–even with Majority Write Concern, journaling, and fsynced writes.
What you can do without Pandas
To help fellow engineers wrap their head around Apache Kafka and event streaming, I wrote a 4-part series on the Confluent blog on Kafka’s core fundamentals....
I’ve built a lot of unofficial software for my schools, Brown University and previously Macalester College. To name a few: an “everything app” called 75grand with dining hall menus, Moodle assignments, building hours, an event calendar, and more; two unfinished course catalogs; and a university shuttle tracker. None…
You can use of UUIDs as the primary key to avoid database scale problems. But should you? I propose an alternative.
Lambdaclass's blog about distributed systems, machine learning, compilers, operating systems, security and cryptography.
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. Recently I introduced a high-performance write-path into rqlite and, to my great surprise, it exposed a bug in SQLite. The SQLite team quickly addressed the issue but let's take a look at the…
A handy rule of thumb for creating a confidence interval for the probability of an event you haven't seen happen yet.
This is a chronicle of my experiment where I set out to insert 1B rows in SQLite
"Deep" modules, mismatched interfaces - and why SAP is so painful
Five years ago I wrote a post that got some good attention on why you should use Postgres. Almost a year later I added a bunch of things I missed. Many of those items bear repeating, and I’ll recap a few of those in the latter half of this post. But in the last 4-5 years there’s been a lot of improvements and more…
I was writing a tiny website to display statistics of how much sponsored content a Youtube creator has over time when I noticed that I often write a small tool as a website that queries some data from a database and then displays it in a graph, a table, or similar. But if you want to use a
I have been probably obsessed with two things in the last few years: Nix as a tool to explore innovative ideas that require the capability to rebuild the world and replacing ELF with SQLite as an executable format. You might have noticed that these two ideas are well suited to each other.
This is the text version of a talk I gave on September 27, 2016, at the Collections as Data event at the Library of Congress. [ video ] (21 mins)
A high-level overview of how PostgreSQL stores data on disk, covering segments, pages and more.
How I made $500k from high frequency trading using machine learning to optimize a trading algorithm for Russell 2000 and DAX futures, trading independently without working for a quant firm.
Lessons learned from building RAG systems for Usul AI and enterprise clients, processing over 13 million pages.
In 2017, I went to Facebook on a sabbatical from my faculty position at Yale. I created a team to build a storage system called Delos at the bottom of the Facebook stack (think of it as Facebook’s version of Chubby). We hit production with a 3-person team in less than a year; and subsequently scaled the team to 30+…
The name SQLite is a nice name, but the "lite" part is misleading, it sounds like it is only useful for tiny things - which is very wrong. SQLite should be named AwesomeSQL, because that is what it is. SQLite is probably the only database you will ever need in most cases.
On today's show, I'm talking to Richard Hipp about surviving becoming core infrastructure for the world. SQLite is everywhere. It's in your web browser, it's in your phone, it's probably in your car, and it's definitely in commercial planes. It's where your iMessages and WhatsApp messages are stored, and if you do a…
A step-by-step guide to building a key-value database from scratch.
Last week, a tweet went viral showing a guy claiming that a Cursor/Claude agent deleted his company's production database. We watched from the sidelines as he tried to get a confession from the agent:
So, a while ago I built a gaming PC with the following specification: Case Dan A4 v4.1 Motherboard Z690I Strix Gaming Pro...
Relational (inner) joins are really common in the world of databases, and one weird thing about them is that it seems like everyone has a different idea of what they are. In this post I’ve aggregated a bunch of different definitions, ways of thinking about them, and ways of implementing them that will hopefully be…
sqlite-vec is an new vector search SQLite extension, coming soon!
