121
Upgrading Uber's MySQL Fleet
Learn all about our journey of successfully upgrading our MySQL fleet at Uber from v5.7 to v8.0, enhancing performance and reliability.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 350 posts.
122
Are we at peak vector database?
Seriously - why do we need all these vector databases? Do we need dozens of them?
123
We built our customer data warehouse all on Postgres
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
124
Multi-tenant queues in Postgres
How we implemented fair queueing strategies for Postgres-backed task queues to ensure fair execution time across tenants.
125
What happens if we remove 50 percent of Llama?
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
126
Deno KV internals: building a database for the modern web
How we built a performant, scalable, ACID-compliant, JavaScript-native database on FoundationDB.
127
Binance built a 100PB log service with Quickwit
Binance Scales its Log Service to 100PB and Saves Millions with Quickwit
128
Farewell Pandas, and thanks for all the fish
the portable Python dataframe library
129
Making a Postgres query 1k times faster
Learn how we discovered what was slowing down large database queries, and what we did to make Postgres queries 1000x faster.
130
131
Why Polars rewrote its Arrow string data type
We have completely rewritten the string/binary data structure we use in Polars.
132
Postgres as queue
The team I've been working in for the last year or so have had great success using Postgres-as-queue. We've managed to avoid the following:
133
Chronon, Airbnb's ML feature platform, is now open source
A feature platform that offers observability and management tools, allows ML practitioners to use a variety of data sources, while handling…
134
Jepsen: Bufstream 0.1
2024-11-13 : An earlier version of this report asserted that consumers with auto-commit enabled could lose data by automatically committing offsets returned by the most recent poll. This claim was based in part on Confluent’s documentation , which states:
135
Reads Causing Writes in Postgres
It is good practice to regularly inspect the statements running in the hot path of your Postgres instance. One way to do this is to examine the pg_stat_statements view , which shows various statistics about the SQL statements executed by the Postgres server.
136
Sensible SQLite Defaults
SQLite is cool now. DHH uses it, Laravel defaults to it. Here is a list of _sensible defaults_ when using sqlite.
137
Multi-database support in DuckDB
DuckDB can attach MySQL, Postgres, and SQLite databases in addition to databases stored in its own format. This allows data to be read into DuckDB and moved between these systems in a convenient manner.
138
CRDTs Turned Inside Out
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs [https://jakelazaroff.com/words/an-interactive-intro-to-crdts/] - An introduction to state-based CRDTs [https://www.bartoszsypytkowski.com/the-state-of-a-state-based-crdts/] - CRDTs for non-academics…
139
140
The future of kdb+?
It’s been 2 years since I worked full time in kdb+ but people seem to always want to talk to me about kdb+ and where I think it’s going, so to save rehashing the same debates I’m going to put it here and refer to it in future. Please leave a comment if you want and I will reply.
141
Bento: Jupyter Notebooks at Meta
This episode of the Meta Tech Podcast is all about Bento, Meta’s internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Bento allows our engineers to mix code, tex…
142
Using reinforcement learning and $4.80 of GPU time to find the best HN post
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
143
144
SQL is syntactic sugar for relational algebra
This idea is particularly sticky because it was more or less true 50 years ago, and it's a passable mental model to use when learning sql. But it's an inadequate mental model for building new sql frontends, designing new query languages, or writing tools likes ORMs that abstract over sql.
145
Optimizing Ruby's JSON, Part 4
In the previous post, we established that as long as ruby/json wasn’t competitive on micro-benchmarks, public perception wouldn’t change. Since what made ruby/json appear so bad on micro-benchmarks was its setup cost, we had to find ways to reduce it further.
146
Saving cloud costs by writing our own database
What is the first rule of programming? Maybe something like “do not repeat yourself” or “if it works, don’t touch it”? Or, how about “do not write your own database!”… That’s a good one.
147
Heroku Postgres is now based on AWS Aurora
We’re thrilled to launch our new Heroku Postgres Essential database plans. These plans have pgvector support, no row count limits, and come with a 32 GB...
148
149
A Technical Dive into PostgreSQL's replication mechanisms
Guide to PostgreSQL Replication and CDC - Navigate the complexities of logical replication in PostgreSQL.
150
The CAP theorem of Clustering: Why Every Algorithm Must Sacrifice Something
No clustering algorithm is perfect and you must make a trade-off.