1921
Facebook's Top Open Data Problems
At Meta, research permeates everything we do. We believe the most interesting research questions are derived from real world problems.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,224 posts.
1922
1923
1924
How to create a 1M record table with a single query
With recursive CTE and randomized data.
1925
Rqlite 6.0: the evolution of a distributed database design
rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. v6.0.0 is out now and makes clustering more robust. It also lays the foundation for more important features. What's new in 6.0? 6.0 multiplexes multiple logical connections between rqlite nodes…
1926
Exact binary vector search for RAG in 100 lines of Julia
Thanks for HN users mik1998 and borodi who brought up the popcnt instruction and the count_ones function in Julia which carries this out, I've updated the timings and it's even faster now.
1927
Python Pandas: Tricks and Features
Lesser-known but idiomatic pandas features for those already comfortable with Pandas' basic functionality and concepts.
1928
Bank failures come in waves
Interactive post about the frequency of bank failures over time
1929
1930
Operating on a minimal two-core Postgres instance: Query optimization insights
In an era where the costs for cloud services continue to soar, I want to outline how our data team has successfully managed to run the infrastructure of our energy trading company within the first year using only two PostgreSQL database instances - each equipped with just two CPU cores and four GB of RAM. Despite this…
1931
Most companies do not need Snowflake or Databricks
The cost for something that can be replicated free and open source is absurd. The Fortune 100 have a use case for these companies, the rest…
1932
Azure Cosmos DB: Microsoft's Cloud-Born Globally Distributed Database
It has been almost 9 months since I started my sabbatical work with the Microsoft Azure Cosmos DB team. I knew what I signed up for then...
1933
Encoding Data in Dubstep Drops
[Warning: Those who can’t stand EDM/dubstep, oh boy do I have bad news for you in regards to this blog post]
1934
How We Proved the Eth2 Deposit Contract Is Free of Runtime Errors
Consensys is a blockchain software company building the tools, infrastructure and research that power the new Era of Decentralized Finance, for a more secure and open economy
1935
Index bloat reduced in PostgreSQL v14
This article describes how PostgreSQL v14 reduces B-tree index bloat with "bottom-up index tuple deletion". A test case shows the difference.
1936
Ways to shoot yourself in the foot with Redis
Personal website of Phil Booth
1937
1938
1939
The Horrors of Upgrading Etcd Beneath Kubernetes
We dig into the challenges of in-place etcd upgrades beneath autonomous Kubernetes clusters running in air-gapped environments.
1940
1941
1942
.NET Core Image Processing
Image processing, and in particular image resizing, is a common requirement for web applications. As such, I wanted to paint a panorama of the options that exist for .NET Core to process images. For each option, I’ll give a code sample for image resizing, and I’ll outline interesting features. I’ll conclude with a…
1943
Common Mistakes and Missed Optimization Opportunities in SQL
Made by Developers and Non-Developers
1944
CRDT Benchmarks
Open-source TypeScript library for collaborative JSON editing powered by CRDTs.
1945
1946
Storage engine design
In time-series databases the querying pattern differs from the write pattern. We usually write data in time order by updating many series every second. But querying is a different story. We usually want to read only a handful of series leaving most of the data behind. Here lies the biggest problem, which is we don’t…
1947
Build your own SQLite, Part 1: Listing tables
As developers, we use databases all the time. But how do they work? In this series, we'll try to answer that question by building our own SQLite-compatible…
1948
Postgres Data Flow
What happens when you query Postgres? Data can actually come from many different places like the application cache, buffer cache, and even down into the physical disk cache. This post surveys the data storage and flow of Postgres data.
1949
Database mocks are not worth it
Testing against a real database uncovers hidden pitfalls that can appear as the application matures
1950
How and why the Relational Model works for databases
This is a note on, the Turing Award laureate, Ted Codd’s revolutionary paper — A Relational Model of Data for Large Shared Data Banks. In this post, I will review the paper and add my comments with a perspective from modern distributed databases.