121
Turso SQLite Offline Sync Public Beta
Turso Offline Sync is now in public beta. Write to local SQLite databases offline at file speed, then sync push and pull with Turso Cloud when reconnected.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 299 posts.
122
Data-at-Rest Encryption in DuckDB
DuckDB 1.4 ships database encryption capabilities. In this blog post, we dive into the implementation details of the encryption, show how to use it, and demonstrate its performance implications.
123
The CRDT Dictionary: A Field Guide to Conflict-Free Replicated Data Types
A comprehensive guide to CRDTs and their tradeoffs, from counters to sequences. Written in the spirit of the Typeclassopedia, exploring how different CRDTs solve the distributed consensus puzzle.
124
How to install TrueNAS on a Raspberry Pi
Now that Joel0 in the TrueNAS community has created a fork of TrueNAS that runs on Arm, I thought I'd give it a spin—on a Raspberry Pi. I currently run an Ampere Arm server in my rack with Linux and ZFS as my primary storage server, and a Raspberry Pi with four SATA SSDs and ZFS as backup replica in my studio. My…
125
Why LLMs still have problems with OCR
LLMs excel at text generation but fail at precise document extraction due to nondeterminism. | Pulse AI
126
Build your own SQLite in Rust, Part 5: Evaluating queries
In the previous posts, we've explored the SQLite file format and built a simple SQL parser. It's time to put these pieces together and implement a query…
127
A lost decade chasing distributed architectures for data analytics?
We benchmark DuckDB on a 2012 MacBook Pro to decide: did we lose a decade chasing distributed architectures for data analytics?
128
SQL nulls are weird
Yes, you read that right. SQL does treat all NULLs as distinct values. I learnt this a while back while working on Convoy and again on LiteQueue: a Golang a queueing library. Basically, any column wi
129
Gemini Embedding: Powering RAG and context engineering
Explore how organizations leverage Gemini Embedding for context-aware AI systems improving performance, accuracy, and efficiency across diverse industries.
130
Bloom filters are good for search that does not scale
Jonathan Arns's personal blog
131
State of AI: An Empirical 100T Token Study with OpenRouter
Read OpenRouter's 2025 State of AI report — an empirical 100 trillion token study of real LLM usage, model trends, and developer insights.
132
The two versions of Parquet
The adoption of Parquet version 2 is limited due to the lack of support in the ecosystem, which affects its evolution despite its improvements in compression and performance.
133
Async I/O on Linux in databases
I've been working on a complex multi-model database for a few weeks now, and recently I took time to simplify and test out an idea I had on a simple key-value database. I started with the basics: A hash table in memory, a simple append-only log
134
Wyvern's Open Satellite Feed
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
135
The program is the database is the interface
That transfer to John Smith isn't covered by any of the tagging rules. So I select the date, switch to the editor window and paste the date into the date->tag definition:
136
How to Store Data on Paper?
How to print my voice? How to put music on paper? How to print an executable program? All this boils down to storing digital data on paper. This is also called paper data storage . Arrived in this domain from poetry, I’ve been investigating the area for some time. Here is what I found.
137
Why was Apache Kafka created?
The story behind how LinkedIn created Apache Kafka
138
Continuous glucose monitors reveal variable glucose responses to the same meals
In this exploratory analysis of 2 highly controlled crossover studies in 30 participants without diabetes, the same meals led to highly variable glucose responses, as measured with continuous glucose monitors.
139
In S3 simplicity is table stakes
From simple object storage to sophisticated table management, builders have always shaped S3's evolution. Andy Warfield discusses why making complex systems simple remains our north star at AWS.
140
Scaling our observability platform by embracing wide events and replacing OTel
Read how we scaled our observability platform from 19PB to 100PB and 500 trillion rows by replacing OpenTelemetry with a native ClickHouse-to-ClickHouse pipeline, embracing wide events and cutting CPU usage by 90%.
141
DeepSeek's smallpond: Bringing Distributed Computing to DuckDB
DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?
142
SedonaDB: A new geospatial DataFrame library written in Rust
Apache Sedona is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark, Apache Flink, and Snowflake, with a set of out-of-the-box distributed Spatial Datasets and Spatial SQL that efficiently load, process, and analyze large-scale…
143
Analysis of Product Hunt products from 2014 to 2021
An analysis of Product Hunt, 2014 - 2021
144
Why LLMs Can't Write Q/Kdb+: Writing Code Right-to-Left
In my previous post I showed how LLMs struggle with coding in q/kdb+; having immediate feedback loops using the q-MCP server does help a…
145
Rails on SQLite: new ways to cause outages
This post was originally given as a talk for Friendly.rb and Kaigi on Rails. The slides are also available. Between Litestack and the Rails 8 trifecta of Solid Cable, Solid Cache, and Solid Queue, it’s easier than ever to spin up a Rails app that doesn’t need a database service, or a redis service, or a file storage…
146
Representing Graphs in PostgreSQL
Some tricks and techniques for working with graph or tree like data in Postgresql
147
Pokémon Team Optimization
This article will show you how forming your Pokémon team can be turned into a mathematical optimization problem.
148
Lessons learned from building a sync-engine and reactivity system with SQLite
Welcome to my personal blog! I use it to share what I'm currently learning or thinking about, usually on topics related to technology, business, and health.
149
A glitch in an online survey replaced the word 'yes' with 'forks'
Dating back to at least early 2023, a bizarre and alarming technical glitch started popping up in some organizations’ online surveys and forms.
150
Turning the database inside-out (2015)
Databases are global, shared, mutable state. That’s the way it has been since the 1960s, and no amount of NoSQL has changed that. However, most self-respecting developers have got rid of mutable global variables in their code long ago. So why do we tolerate databases as they are?