241
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 350 posts.
242
Knowledge Graphs in RAG: Hype vs. Ragas Analysis
A deep dive on Microsoft's GraphRAG paper found questionable metrics with vaguely defined lift, so I analyzed knowledge graphs in RAG overall using Neo4j vs FAISS
243
Trade-offs between Different CRDTs
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs - An introduction to state-based CRDTs - CRDTs for non-academics - CRDT: The Hard Parts - Readings in CRDTs - crdt.tech What are the trade-offs between different kinds of CRDTs (Conflict-free Replicated
244
Sculpting the moon in R: Subdivision surfaces and displacement mapping
We like the moon The moon is very useful, everyone Everybody like the moon Because it light up the sky at night and it lovely and it makes the tides go and we like it But not as much as cheese We really like cheese
245
Putting a full power search engine in Ecto
My diatribe about adding support for ParadeDB to Ecto
246
Breaking up is hard to do: Chunking in RAG applications
A look at some of the current thinking around chunking data for retrieval-augmented generation (RAG) systems.
247
DuckDB Community Extensions
DuckDB extensions can now be published as DuckDB Community Extensions. The repository makes it easier for users to install extensions using the INSTALL extension_name FROM community syntax. Extension developers avoid the burdens of compilation and distribution.
248
Nutrient levels in retail grocery stores
A counterintuitive conclusion
249
Inside a Ferroelectric RAM Chip
Ferroelectric memory (FRAM) is an interesting storage technique that stores bits in a special "ferroelectric" material. Ferroelectric memory...
250
Lossless Log Aggregation – Reduce Log Volume by 99% Without Dropping Data
Reduce Log Volume by 99% Without Dropping Data
251
A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes
Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.
252
In the land of LLMs, can we do better mock data generation?
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
253
OrioleDB beta7: Benchmarks
OrioleDB is a storage extension for PostgreSQL which uses PostgreSQL's pluggable storage system. Designed as a drop-in replacement for PostgreSQL's existing Heap storage, OrioleDB aims to overcome scalability bottlenecks and fully utilize modern hardware capabilities. By integrating seamlessly with PostgreSQL, it…
254
DELETEs Are Difficult
Why are database DELETEs complex and inefficient? Uncover challenges from physical data removal to autovacuum, and find strategies for managing large deletions.
255
Large language model data pipelines and Common Crawl
This article provides a short introduction to the pipeline used to create the data to train large language models (LLMs) such as LLaMA using Common Crawl (CC).
256
How to think about creating a dataset for LLM fine-tuning evaluation
I summarise the kinds of evaluations that are needed for a structured data generation task.
257
Array languages vs. the curse of the spreadsheet
It has been said that the most popular programming language in the world is the spreadsheet (and in particular these days, Excel). There...
258
259
260
261
262
The Ultimate Guide to PostgreSQL Data Change Tracking
Explore five methods of data change tracking in PostgreSQL available in 2024.
263
Let's consign CAP to the cabinet of curiosities
Brewer’s CAP theorem, and Gilbert and Lynch’s formalization of it , is the first introduction to hard trade-offs for many distributed systems engineers. Going by the vast amounts of ink and bile spent on the topic, it is not unreasonable for new folks to conclude that it’s an important, foundational, idea.
264
Non-elementary group-by aggregations in Polars vs pandas
A closer look at non-elementary group-by aggregations
265
Why CockroachDB doesn't use EvalPlanQual
Under READ COMMITTED isolation, PostgreSQL can sometimes miss rows when performing UPDATE, DELETE, SELECT FOR UPDATE, or SELECT FOR SHARE statements. This is due to the EvalPlanQual recheck PostgreSQL adds to these statements to prevent lost-update anomalies.
266
Ledger: Stripe's system for tracking and validating money movement
Technical details on how Stripe built Ledger, a state-of-the-art money movement tracking system, including how teams at Stripe interact with the data quality metrics that underlie our payment processing network.
267
Lisp Query Notation (LQN)
Query language and terminal utility for transforming various data formats
268
Jepsen: Jetcd 0.8.2
Etcd is a coordination service designed to offer Strict Serializable reads, writes, and micro-transactions over a small, in-memory key-value store. In 2022, Jepsen re-tested etcd as a part of a private engagement covering an assortment of databases. We reported several issues to the etcd team during that engagement…
269
Building a Managed Postgres Service in Rust
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
270
UUID Benchmark War
This month’s PGSQL Phriday #015 topic is about UUIDs, hosted by Lætitia Avrot. Lætitia has called for a debate. No, no, no. I say let’s have an all-out war. A benchmark war. I have deci…