361
I’m writing a new vector search SQLite Extension
sqlite-vec is an new vector search SQLite extension, coming soon!
New
The latest blog posts to take off on Hacker News. 1,888 posts.
362
Hacking on PostgreSQL is hard
Hacking on PostgreSQL is really hard. I think a lot of people would agree with this statement, not all for the same reasons. Some might poin...
363
364
The "it" in AI models is the dataset
I’ve been at OpenAI for almost a year now. In that time, I’ve trained a lot of generative models. More than anyone really has any right to train. As I’ve spent these hours observing the effects of tweaking various model configurations and h
365
366
AI for Data Journalism: demonstrating what we can do with this stuff
I gave a talk last month at the Story Discovery at Scale data journalism conference hosted at Stanford by Big Local News. My brief was to go deep into the …
367
Setting up PostgreSQL for running integration tests
Setting up PostgreSQL for tests is crucial for achieving performance and reliability. In this article, I'll explain how to set up PostgreSQL for tests and discuss some common pitfalls to avoid.
368
Ten years of improvements in PostgreSQL's optimizer
Ryan Marcus, assistant professor at the University of Pennsylvania. Using machine learning to build the next generation of data systems.
369
Redis is forked
Where do we go from here?
370
371
Do we need to store all that telemetry?
In my last post I talked about why modern observability has become so expensive. At the end of the post I posit a question: What if by default we never send any telemetry at all? In this post I’m goin
372
How much memory does a graph take?
We need a fast way to query multiple potentially large sets of data on-demand at interactive speeds. Sometimes the easiest solution to a hard problem is to build the right tool for the job.
373
Distributed SQLite: Paradigm shift or hype?
SQLite is fast, really fast. On a single ~40€ / m commodity server, it can sustain ~168,000 reads and ~8000 writes per second, concurrently. Because it's an embedded library designed for client-side applications such as embedded systems and phone & desktop applications, SQLite databases have to be co-located…
374
375
Postgres locks explorer
All of the data in this page is derived from these tests , so is true by some definition of true. Notable is this test - given an arbitrary SQL statement, it determines via runtime inspection which locks are taken.
376
Your database skills are not 'good to have' (2023)
And a hateful ode to Object-Relational Mappers
377
DeWitt and Stonebraker's "MapReduce: A major step backwards" (2009)
In January 2008 David DeWitt and Michael Stonebraker published an article criticising MapReduce. As far as I can find, the article is no lon...
378
379
How (and why) to run SQLite in production
This is my personal site, where I write about Ruby, programming, and any of my varied fascinations.
380
381
Fundamentals of Object Storage in Elixir
I did a livestream where I talked about Object Storage. The how and why. The Bad Old Days. And also the neat and interesting stuff just beyond the basics. I figured I'd cover that in text as well.
382
DuckDB as the New jq
Recently, I’ve been interested in the DuckDB project (like a SQLite geared towards data applications). And one of the amazing features is that it has many data importers included without requiring extra dependencies. This means it can natively read and parse JSON as a database table, among many other formats.
383
Bug hunting in Btrfs
The other day I was implementing multi-threaded stat() calls in bfs . When I ran some benchmarks, I saw something that made my heart skip a beat:
384
SQL is syntactic sugar for relational algebra
This idea is particularly sticky because it was more or less true 50 years ago, and it's a passable mental model to use when learning sql. But it's an inadequate mental model for building new sql frontends, designing new query languages, or writing tools likes ORMs that abstract over sql.
385
I wrote a new JIT compiler for PostgreSQL
Sometimes, I don’t know why I do things. It’s one of these times. A few months ago, Python 3.13 got its JIT engine, built with a new JIT compiler construction methodology (copy-patch, cf. research paper ). After reading the paper, I was sold and I just had to try it with PostgreSQL. And what a fun ride it’s been so…
386
Postgres is eating the database world
PostgreSQL isn’t just a simple relational database; it’s a data management framework with the potential to engulf the entire database…
387
Proof of the Singular Value Decomposition
The existence claim for the singular value decomposition (SVD) is quite strong: “Every matrix is diagonal, provided one uses the proper bases for the domain and range spaces” (Trefethen & Bau III, 1997) . MIT professor Gilbert Strang has a wonderful lecture on the SVD, and he includes an existence proof for the SVD…
388
Using PostgreSQL for military geoanalytics tasks
My name is Taras Kloba, Chief Partner Architect at Microsoft. This blog captures my journey through data engineering, certifications, and technology insights.
389
S3 is files, but not a filesystem
"Deep" modules, mismatched interfaces - and why SAP is so painful
390
The CAP theorem. The Bad, the Bad, & the Ugly
The CAP theorem is too simplistic and too widely misunderstood to be of much use for characterizing systems.