211
Non blocking and zero downtime ALTER statements in PostgreSQL with pg-osc
pg-osc is a CLI tool for making non-blocking, zero downtime schema changes in PostgreSQL
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 300 posts.
212
Extending SQLite with Rust
SQLite has a powerful extension mechanism: loadable extensions. Being an in-process database, SQLite has other extensions mechanisms like application-defined functions (UDF for short). But UDFs have …
213
PlanetScale increases plans to include billions of reads
PlanetScale offers the world’s fastest and most scalable cloud hosting for Vitess, Neki, and Postgres.
214
It’s fine, Rewind: Revert a migration without losing data
Learn how PlanetScale lets you revert changes to your database after a migration with no downtime and zero data loss.
215
Read “Data and Reality”
Once more: we are not modeling reality, but the way information about reality is processed, by people. — Bill Kent I've got this working theory that you can...
216
Building a semantic search engine in Rust
If you're interested in building a semantic search engine in Rust, this article will show you how! We'll cover building a basic engine using sentence transformers and a kd-tree.
217
Bottomless, consumption-based storage for PostgreSQL built on Amazon S3
Data management decisions don’t have to be costly. Introducing Tiered Storage, a low-cost infinite storage tier for your historical data needs.
218
ULIDs and Primary Keys
Not all non-sequential primary keys are created equal, the ULID format is a fantastic substitute for the typical UUIDv4 choice.
219
220
221
Supabase Vault is now in Beta
A Postgres extension to store encrypted secrets and encrypt data.
222
Improving Postgres text search speed
CharityAPI.org improved our Postgres response time so that searches initiated via our API were 760% faster without adding an additional tool like Elastic Search. This is how we did it.
223
MySQL now shows its thread names at OS level for better troubleshooting
Starting from v8.0.27, the MySQL daemon shows its thread names at the OS level too, for better troubleshooting. The MySQL 8.0.27 release notes say this: To assist monitoring and troubleshooting, the Performance Schema instrumentation is now used to export names of instrumented threads to the operating system. This…
224
Why use Paxos instead of Raft?
TLDR: Neon separates storage and compute, substituting the PostgreSQL persistency layer with a custom-made distributed storage written in Rust. Due to this separation, some nodes don’t have persistent disks. The original Raft paper works only with uniform nodes, but Paxos variants support proposers without storage and…
225
Querying Postgres Tables Directly from DuckDB
DuckDB can now directly query tables stored in PostgreSQL and speed up complex analytical queries without duplicating data.
226
IPFS Backed by Decentralized Storage
Filebase now supports IPFS! Learn more about our latest network integration and how you can pin data onto IPFS in seconds, at a fraction of the cost of existing services.
227
I disagree with Turing and Kahneman regarding statistical evidence (2014)
It’s funny. I’m the statistician, but I’m more skeptical about statistics, compared to these renowned scientists.
228
Simple, Fast, and Scalable Reverse Image Search
How we built our first iteration of content matching at Canva.
229
Some thoughts on machine learning with small data
I feel techniques for making machine learning work with small data are not talked about enough. This makes sense because many ML applications are only possible by collecting a huge amount of data. …
230
Revisiting the principles of data-oriented programming
Principles of Data-Oriented Programming. Benefits and costs of Data-Oriented Programming. DOP vs OOP. DOP vs FP.
231
How Palo Alto Networks Replaced Kafka with ScyllaDB for Stream Processing
Learn how Palo Alto Networks rearchitected their real time data systems using ScyllaDB’s monstrously fast and scalable NoSQL database.
232
Push-based outbox pattern with Postgres logical replication
There are only a few patterns that I’m comfortable saying: “You should use it always if you want to build mature system”. One of them is the Outbox Pattern. Why? Because…
233
Where is every IP Address?
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
234
Introducing ArcticDB: A Database for Observability
Continuous profiling needed a columnar database, so we built it.
235
Let's Talk SkipList
the forgotten data structure (not really)
236
237
238
How to Find and Stop Running Queries on PostgreSQL
Your PostgreSQL server is seizing up, with some naughty queries consuming too many resources or blocking others. Don’t panic! You can stop those problem queries and stabilize your system.
239
Quirks, Caveats, and Gotchas in SQLite
The SQL language is a "standard". Even so, no two SQL database engines work exactly alike. Every SQL implementation has its own peculiarities and oddities, and SQLite is no exception to this rule.
240
Maintaining sufficient free space with ZFS
TLDR: ZFS free-space reporting is a lagging indicator. Background I use Proxmox VM server backed by a ZFS array of hard drives for various personal infrastructure. I also have security cameras that upload motion-triggered videos to my server (via FTP!). Problem Description I would like to use 90% of my available space…