How to get the most out of Postgres memory settings
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
Topics /
The most popular blog posts about databases & data on Hacker News. 350 posts.
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
This is my personal site, where I write about Ruby, programming, and any of my varied fascinations.
( This is part of a series on the design of zest . See the list of posts here .)
I was recently made maintainer of the json gem, and aside from fixing some old bugs, I focused quite a bit on its performance, so that it is now the fastest JSON parser and generator for Ruby on most benchmarks.
New database library for Rust
The State Space Model taking on Transformers
This quote from Charity Majors is probably the best summary of the current state of observability in the tech industry - a total, mass confusion.
Many companies are running old Postgres versions and missing out on many improvements. The reasons: Postgres works and upgrades suck.
Modern AI rewards being very weird.
Postgres 16 introduces quite a few improvements to the query planner and makes many SQL queries run faster than they did on previous versions of PostgreSQL. This post is a deep dive into 10 of the improvements, including code blocks and comparisons of query plan output between Postgres 15 & Postgres 16.
TL;DR — We are excited to announce voyage-multimodal-3, a new state-of-the-art for multimodal embeddings and a big step forward towards seamless RAG and semantic search for documents rich with both…
Are database benchmarks still relevant ? Let's understand why it's a poor way to choose a database. | Reading time: 17 min read
Joel Gustafson
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
I knew that data tables had been around a long time, but I didn't appreciate how long until I read recently about account-keeping in ancient Mesopotamia.
SQLite is fast, really fast. On a single ~40€ / m commodity server, it can sustain ~168,000 reads and ~8000 writes per second, concurrently. Because it's an embedded library designed for client-side applications such as embedded systems and phone & desktop applications, SQLite databases have to be co-located…
Optimize your support with Assembled's Hybrid Search. Learn how we enhance RAG results using Reciprocal Rank Fusion for accurate, relevant answers.
How do you find near-duplicates in a massive collection of documents? An exploration of the Jaccard similarity metric, and the MinHash hashing trick used to efficiently approximate it at web scale.
Analyze Backblaze's Q1 2024 hard drive stats, including annualized failure rates, average ages of failure, and insights on over 279,000 drives.
Introducing the search capabilities of ParadeDB.
The other day I was implementing multi-threaded stat() calls in bfs . When I ran some benchmarks, I saw something that made my heart skip a beat:
Data is reductive. It objectifies. It bureaucratizes. But is it a bad idea?
How Notion build and grew our data lake to keep up with rapid growth
There is a lot of excitement around retrieval augmented generation or “RAG.” Roughly the idea is: some of the deficiencies in current generative AI or large language models (LLMs) can b…
Advice: When you are making a new application that requires persistent storage of data, like is the case for most web applications, your default choice should be Postgres .