121
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 185 posts.
122
Seeing Like a Data Structure
Our data-centric way of seeing the world isn't serving us well. Barath Raghavan and Bruce Schneier argue that we need new socio-technical systems that leave room for the inherent messiness of reality.
123
Moving a billion Postgres rows on a $100 budget
Inspired by the 1BR Challenge, I wanted to see how much it would cost to transfer 1 billion rows from Postgres to Snowflake. Moving 1 billion rows is no…
124
The case against dual axis charts (and what to use instead) (2018)
We believe that charts with two different y-axes make it hard for most people to intuitively make right statements about two data series.
125
Is Tableau Dead?
Is Tableau dead? The future looks mixed.
126
MemoryDB: A fast and durable memory-first cloud database
Amazon MemoryDB for Redis is a database service designed for 11 9s of durability with in-memory performance. In this paper, we describe the architecture of MemoryDB and how we leverage open-source Redis, a popular data structure store, to build an enterprise-grade cloud database. MemoryDB offloads…
127
Breaking up is hard to do: Chunking in RAG applications
A look at some of the current thinking around chunking data for retrieval-augmented generation (RAG) systems.
128
DuckDB Community Extensions
DuckDB extensions can now be published as DuckDB Community Extensions. The repository makes it easier for users to install extensions using the INSTALL extension_name FROM community syntax. Extension developers avoid the burdens of compilation and distribution.
129
A Distributed File System in Go Cut Average Metadata Memory Usage to 100 Bytes
Learn JuiceFS Enterprise Edition’s metadata engine design and optimization methods that reduced its metadata memory usage by 90%.
130
In the land of LLMs, can we do better mock data generation?
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
131
OrioleDB beta7: Benchmarks
OrioleDB is a storage extension for PostgreSQL which uses PostgreSQL's pluggable storage system. Designed as a drop-in replacement for PostgreSQL's existing Heap storage, OrioleDB aims to overcome scalability bottlenecks and fully utilize modern hardware capabilities. By integrating seamlessly with PostgreSQL, it…
132
133
134
135
The Ultimate Guide to PostgreSQL Data Change Tracking
Explore five methods of data change tracking in PostgreSQL available in 2024.
136
Non-elementary group-by aggregations in Polars vs pandas
A closer look at non-elementary group-by aggregations
137
Why CockroachDB doesn't use EvalPlanQual
Under READ COMMITTED isolation, PostgreSQL can sometimes miss rows when performing UPDATE, DELETE, SELECT FOR UPDATE, or SELECT FOR SHARE statements. This is due to the EvalPlanQual recheck PostgreSQL adds to these statements to prevent lost-update anomalies.
138
Ledger: Stripe's system for tracking and validating money movement
Technical details on how Stripe built Ledger, a state-of-the-art money movement tracking system, including how teams at Stripe interact with the data quality metrics that underlie our payment processing network.
139
Jepsen: Jetcd 0.8.2
Etcd is a coordination service designed to offer Strict Serializable reads, writes, and micro-transactions over a small, in-memory key-value store. In 2022, Jepsen re-tested etcd as a part of a private engagement covering an assortment of databases. We reported several issues to the etcd team during that engagement…
140
Building a Managed Postgres Service in Rust
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
141
Netflix's Distributed Counter Abstraction
By: Rajiv Shringi, Oleksii Tkachuk, Kartik Sathyanarayanan
142
The PlanetScale vectors public beta
You can now use the vector data type for vector search and storage in your PlanetScale MySQL database.
143
NumPy-style broadcasting in Futhark
A high-performance and high-level purely functional data-parallel array programming language that can execute on the GPU and CPU.
144
Qdrant, the Vector Search Database, raised $28M in a Series A round
Qdrant is an Open-Source Vector Search Engine written in Rust. It provides fast and scalable vector similarity search service with convenient API.
145
An open source DuckDB text to SQL LLM
Our first Text2SQL model release! | Reading time: 5 min read
146
147
Optimizing ClickHouse: Tactics that worked for us
At LaunchDarkly, we ingest nearly 100 terabytes of observability data from our customers every month.
148
Is the "modern data stack" still a useful idea?
My vote: no.
149
How to Distribute Postgres Geographically
Documenting a pattern for making multi-tenant applications global by distributing the data, using only standard PostgreSQL functionality.
150
Regular expression functions in Excel
Check out three new functions that use Regular Expressions to help parse text more easily: REGEXTEST, REGEXEXTRACT, and REGEXREPLACE!