Neon is now Generally Available. We’ve shipped major improvements to Neon internals that, combined with our operating experience scaling up to 700,000+ databases over the past year, give us the confidence that Neon is ready to support your business-critical workloads. If you’re building or scaling an application, you…
NumPy 2.0.0 is the first major release since 2006. It is the result of 11 months of development since the last feature release and is the work of 212 contributors spread over 1078 pull requests. It contains a large number of exciting new features as well as changes to both the Python and C APIs.
A comprehensive comparison between Elasticsearch and PostgreSQL for search workloads.
We walk through the incremental backup feature committed to the Postgres 17 development branch by Robert Haas. We show an example on our local machine.
The Electric sync engine is now in BETA. If you haven't checked out Electric recently, it's a great time to take another look.
A traditional subjective Bayesian will assume a data generating distribution (aka a likelihood when viewed as a function of the parameters). Then, conditional on this assumption, they encode their prior beliefs as a prior distribution over parameters. After this, they turn the crank on posterior inference and don’t…
Contextual retrieval improves how AI systems access and use information, reducing retrieval failures in large knowledge bases.
This is basically a compilation of the lecture notes I wrote when teaching 36-401, Modern Regression, in fall 2015 . I offer it here on the chance that it might be of interest to those learning, or teaching, linear regression. There's no shortage of resources on that, but I have tried to present the subject as though…
BM25 is a widely used algorithm for full text search. I wanted to understand how it works, so here is my attempt at understanding by re-explaining.
Ryan Marcus, assistant professor at the University of Pennsylvania. Using machine learning to build the next generation of data systems.
Explores SQLite B-Tree index structure with visualizations, explaining on-disk and in-memory storage mechanisms
Lessons Learned: Sharding for startups is a technical post about database scalability. What caught my eye was the term . What an odd term — “sharding.” Why would a database be described that way?
Author: Alexey Makhotkin squadette@gmail.com. Introduction In this database design tutorial (~9000 words) I’m going to show how to design the database tables for a real-world project of substantial complexity. We’ll design a clone of Google Calendar. We will model as much as possible of the functionality that is…
Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially…
Often when I’m prototyping a project, I hesitate to use a sqlite database despite their many adavantages . It seems much easier to just dump a bunch of files in a directory and to rely on the universal support for the filesystem API to read/delete/update records. Part of this is avoiding the overhead of figuring out a…
Sometimes, I don’t know why I do things. It’s one of these times. A few months ago, Python 3.13 got its JIT engine, built with a new JIT compiler construction methodology (copy-patch, cf. research paper ). After reading the paper, I was sold and I just had to try it with PostgreSQL. And what a fun ride it’s been so…
Discover more about what's new at AWS with Amazon S3 will no longer charge for several HTTP error codes
An in-depth review of Microsoft's new Python in Excel functionality
SIEVE is Simpler than LRU: an Efficient Turn-Key Eviction Algorithm for Web Caches
This article introduces the implementation difficulties and challenges of Movable Tree CRDTs when collaboration, and how Loro implements it and sorts child nodes. The algorithm has high performance and can be used in production.
Kenton Varda introduces the next iteration of Cloudflare's Durable Object platform, which recently upgraded from a key/value store to a full relational system based on SQLite. For useful background on …
At Prisma, we believe that deploying a database should be as simple as adding a new page in Notion. Today, we are excited to share the first milestone towards this vision: Prisma Postgres® gives developers an always-on database with pay-as-you-go pricing, thanks to our unique architecture design.
An overview of erasure coding, its trade-offs, and applications in distributed storage systems.
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more:
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database…
Dive into Backblaze's analysis of storage server performance, exploring Drive Stats, Storage Pods, and insights on drive failure rates since 2009.
Marco just joined Crunchy Data and he reflects on his career in distributed systems in this post. He provides an overview of several options for approaching distributed Postgres workloads and the pros and cons of each approach.
Why OpenRun uses a SQLite database instead of the local file system for static files.
