3121
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
3122
3123
Three years later, Mr. Moore is still letting us punt on database sharding
Three years ago, I wrote about how improvements in technology keep allowing us to punt on sharding the Basecamp database. This is still true, only more so now. We’ve grown enormously over the last three years but RAM keeps getting cheaper and FusionIO SSD’s keep getting faster. If an…
3124
PostgreSQL 16 Bi-Directional Logical Replication
Introduction In this blog, we'll be going over some more advanced topics new in Postgres 16. Having some experience with Linux, Postgres, and SQL is necessary as we'll not only be going over these new features but also how to implement them. This blog was written using PostgreSQL 16 (Development Version) running on…
3125
3126
3127
3128
Native ZFS VDEV for Object Storage (OpenZFS Summit)
We presented MayaNAS at OpenZFS Developer Summit 2025, introducing objbacker.io—a native ZFS VDEV for object storage. No FUSE, direct kernel-to-SDK integration achieving 3.7 GB/s throughput.
3129
There is no posttraining data commons
The LLM revolution ran on a pretraining commons that humanity built for other reasons. Posttraining consumes tasks, not documents, and no such commons exists. If the open models community wants...
3130
3131
Jepsen: Crate 0.54.9 version divergence
In the last Jepsen analysis, we saw that RethinkDB 2.2.3 could encounter spectacular failure modes due to cluster reconfiguration during a partition. In this analysis, we’ll talk about Crate, and find out just how many versions a row’s version identifies.
3132
3133
Optimizing Datalog for the GPU
Datalog primer and a neat data structure
3134
Tuning Your DBMS Automatically with Machine Learning
This is a guest post by Dana Van Aken, Andy Pavlo, and Geoff Gordon of Carnegie Mellon University. This project demonstrates how academic researchers can leverage our AWS Cloud Credits for Research Program to support their scientific breakthroughs. Database management systems (DBMSs) are the most important component…
3135
Oklahoma Department of Securities Leaked Millions of Files
A storage server configured for public access exposed millions of files belonging to the Oklahoma Securities Commission.
3136
Designing far memory data structures: think outside the box
Designing far memory data structures: think outside the box Aguilera et al., HotOS’19 Last time out we looked at some of the trade-offs between RInKs and LInKs, and the advantages of local in…
3137
CockroachDB 20.1
We want to give you a database that allows you to quickly and simply build and manage data-intensive applications in the cloud—without worrying about the performance, scale or resilience of those apps. To support that mission, our latest release includes updates that let you build fast and build to last.
3138
Thrill – Big Data Processing with C++
Yesterday, I discovered an experimental Big Data processing framework written in C++ called Thrill. As most of you surely know, the well-known frameworks of this kind are mostly based on JVM, like …
3139
A Word Is Worth a Thousand Vectors
Standard natural language processing (NLP) is a messy and difficult affair. It requires teaching a computer about English-specific word ambiguities as well a...
3140
Why start a new database conference?
Somehow I am organizing a conference called Have you tried rubbing a database on it?
3141
3142
Solving methane mysteries with satellite imagery
By combining two types of remote sensing data, we can see hidden leaks from ships
3143
3144
Pgvector Is Now Faster Than Pinecone at 75% Less Cost
Meet pgvectorscale, an open-source PostgreSQL extension that supercharges pgvector’s vector search performance for large-scale vector workloads.
3145
3146
C# strings silently kill your SQL Server indexes in Dapper
If you're using Dapper with anonymous objects to query varchar columns, you're probably sending nvarchar(4000) parameters — causing CONVERT_IMPLICIT on every row and defeating your indexes. Here's the fix.
3147
Choose SQL
Let’s get straight to the point; choose an SQL database for your web application. I think I can’t make my self clearer.
3148
Migrating a 40TB SQL Server Database
Initially, I wasn’t sure whether to write about this migration project, but when I randomly asked if people would be interested, the response was overwhelming. This was a long, kind of boring, very repetitive, and at times incredibly frustrating project, but I learned a lot, and maybe someone else will learn from this…
3149
Revisiting the principles of data-oriented programming
Principles of Data-Oriented Programming. Benefits and costs of Data-Oriented Programming. DOP vs OOP. DOP vs FP.
3150
Filecoin, StorJ and the problem with decentralized storage (2019)
Blockchains for everything Decentralized storage services such as Filecoin and StorJ seek to disrupt the data-storage industry, using blockchain tokens to create a competitive marketplace that can …