Inserting a billion rows in SQLite under a minute
This is a chronicle of my experiment where I set out to insert 1B rows in SQLite
v: Go and Rust programmer from India.
Visit avi.im → On Hacker News Jul 2021 – Sep 2025
Databases & Data 8Systems & Performance 4Security & Privacy 2Software Engineering 2Programming Languages 1History & Retro Computing 1
This is a chronicle of my experiment where I set out to insert 1B rows in SQLite
This is the fascinating story of how researchers used Bloom filters cleverly to make SQLite 10x faster for analytical queries. These are my five-minute notes on the paper SQLite: Past, Present, and Future
Some of the interesting and insane facts I learned about SQLite
Researchers at the University of Helsinki and Cambridge attempted to build a faster SQLite using modern programming paradigms like io_uring and disaggregated storage. They demonstrate up to a 100x reduction in tail latency. These are my notes.
SQLite WAL has checksums, but on corruption it drops all the data and does not raise error
The oldest recorded transaction was in 3100 BC
I forked and modified Go compiler to add a new keyword called let, as alias for var
SQLite does not do checksums by default. Disk corruptions go silently unnoticed.
SQLite doesn’t do fsync unless specified.