871
Indexing iCloud Photos with AI Using LLaVA and Pgvector
A straightforward idea, gluing stuff together until it works, but it’s a glimpse of what’s possible with help of local AIs in near future
New
The latest blog posts to take off on Hacker News. 4,224 posts.
872
Let's talk about joins
An review of horizontal and vertical joins with examples from education research.
873
874
Type information for faster Python C extensions
Update: The paper version of this post is accepted at PLDI SOAP 2024. Take a look at the preprint (PDF).
875
SQLite: Wal2 Mode
"Wal2" mode is very similar to "wal" mode. To change a database to wal2 mode, use the command:
876
Postgres Incremental Backup
We walk through the incremental backup feature committed to the Postgres 17 development branch by Robert Haas. We show an example on our local machine.
877
A Technical Dive into PostgreSQL's replication mechanisms
Guide to PostgreSQL Replication and CDC - Navigate the complexities of logical replication in PostgreSQL.
878
Databases and why their complexity is now unnecessary
This post is not going to be about what’s wrong with individual databases. There are so many databases and so many individual API issues, operational problems, and arbitrary limitations that it wou…
879
Trade-offs between Different CRDTs
🔰If CRDTs are new to you, here are some introductory links. - An interactive intro to CRDTs - An introduction to state-based CRDTs - CRDTs for non-academics - CRDT: The Hard Parts - Readings in CRDTs - crdt.tech What are the trade-offs between different kinds of CRDTs (Conflict-free Replicated
880
An overview of distributed Postgres architectures
Marco just joined Crunchy Data and he reflects on his career in distributed systems in this post. He provides an overview of several options for approaching distributed Postgres workloads and the pros and cons of each approach.
881
Visualizing Ext4
What does ext4 look like?
882
Databases in 2023: A Year in Review
Andy recounts the rise of vector databases to SQL:2023 to MariaDB troubles and the FAA outage in 2023.
883
The drive stats of Backblaze storage pods
Dive into Backblaze's analysis of storage server performance, exploring Drive Stats, Storage Pods, and insights on drive failure rates since 2009.
884
The One Billion Row Challenge
Update Jan 4: Wow, this thing really took off! 1BRC is discussed at a couple of places on the internet, including Hacker News, lobste.rs, and Reddit. For folks to show-case non-Java solutions, there …
885
Sieve is simpler than LRU
SIEVE is Simpler than LRU: an Efficient Turn-Key Eviction Algorithm for Web Caches
886
Thoughts on PostgreSQL in 2024
A look ahead at some ongoing projects in PostgreSQL in 2024 and beyond
887
90x Faster Than Pgvector – Lantern's HNSW Index Creation Time
Index creation time is a critical database metric. Learn more about how Lantern enables 90x faster index creation times than pgvector, and how Lantern compares to Pinecone.
888
Self-hosting a high-availability Postgres cluster on Kubernetes
Ryan Schachte — infrastructure, networking, and distributed systems
889
A Canadian payroll dependency chart
Unfortunately, like most aspects of the tax system, this steadily increases in complexity, and this year with the Canada Pension Plan including not just "base" premiums and "additional" premiums but also "second additional premiums", I needed to rewrite my spreadsheet from scratch; and also very unfortunately, the…
890
Displaying Content as a Graph
Most web content is displayed as a strict hierarchy, tree-based or otherwise. What if it wasn't?An exploration into the advantages of graph-based content design, the numerous pitfalls, and a few case studies along the way.
891
Understanding Parquet, Iceberg and Data Lakehouses
In the past few years, I've heard a lot about Avro, Parquet, ORC, Arrow and Feather, but I also keep hearing about Iceberg and Delta Lake. As a "database person", I’ve been struggling to understand all of these different things, and how they relate to Data Lakes and
892
893
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
894
PostgreSQL internals: Things to know about update statements
I recently finished reading PostgreSQL 14 Internals by Egor Rogov. It is one of the great books that teach applied computer science without watering down the difficult parts. One particularly interesting topic is PostgreSQL’s execution of UPDATE statements. Updates in relational databases are inherently complex. They…
895
Text Editor: Data Structures
The first step in building my text editor is to implement the core API. If you’re wondering why I want to do this, the original article is here.
896
A data corruption bug in OpenZFS?
The Thanksgiving long weekend (23-26 November) in 2023 was an interesting one for OpenZFS, that I managed to land myself in the middle of. The short version of events is that an apparent silent data corruption bug was discovered, which is kind of the worst case scenario for a data storage system. It was a pretty…
897
How does a B-tree make queries fast?
B-tree is a structure that helps to search through great amounts of data. It was invented over 40 years ago, yet it is still employed by the majority of modern databases. Although there are newer index structures, like LSM trees, B-tree is unbeaten when handling most of the database queries.
898
Bayesians moving from defense to offense
Erik van Zwet, Sander Greenland, Guido Imbens, Simon Schwab, Steve Goodman, and I write :
899
Indexing a billion pages
It’s two years since we launched Mwmbl, the open source, non-profit search engine, on Boxing Day 2021. A good time to take stock of where we are and where we’re going. We’ve indexed over 100 million pages Thanks to our volunteers, who crawl the web using the Firefox extension and command line script, we’re crawling up…
900
Database Isolation Is Broken and You Should Care
The database zeitgeist has decided that ANSI SQL '92 isn't enough. We need something better.