391
It’s Time to Move on from Two Phase Commit
The two-phase commit protocol (2PC) has been used in enterprise software systems for over three decades . It has been an an incredibly impa...
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
392
393
New JSON query operators in SQLite 3.38.0
SQLite 3.38.0 introduced improvements to JSON query syntax using -> and ->> operators that are similar to PostgreSQL JSON functions. In this post we...
394
Period tracking app, Flo, found to be selling user data to Meta
What does this vagueness by-design mean for how we choose to self monitor our biological markers?
395
Let's build a full-text search engine
Full-Text Search is one of those tools people use every day without realizing it. If you ever googled "golang coverage report" or tried to find "indoor wireless camera" on an e-commerce website, you used some kind of full-text search.
396
397
398
Apache Arrow and the “Things I Hate About Pandas”
This post is the first of many to come on Apache Arrow, pandas, pandas2, and the general trajectory of my work in recent times and into the foreseeable future. This is a bit of a read and overall fairly technical, but if interested I encourage you to take the time to work through it.
399
Twelve years of distributed SQLite
In September 2014 I published a short post announcing rqlite. The idea was simple: take SQLite, put a Raft log in front of it, and replicate every write to a cluster so that the loss of a node did not mean the loss of the data. The source went on GitHub that same weekend. As…
400
Kafka without ZooKeeper
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
401
Fun facts about SQLite
Some of the interesting and insane facts I learned about SQLite
402
Sqlite 3.30.0
This page provides a high-level summary of changes to SQLite. For more detail, see the Fossil checkin logs at https://sqlite.org/src/timeline and https://sqlite.org/src/timeline?t=release . See the chronology a succinct listing of releases.
403
404
405
Time Series Prediction – A short introduction for pragmatists
Are you trying to predict time series but don't know where to start? This blog post will provide a comparison of the most prominent techniques and show you how …
406
Kafka is dead, long live Kafka
Chances are you probably had a strong reaction to the title of this post. In our experience, Kafka is one of the most polarizing technologies in the data space. Some people hate it, some people swear by it, but almost every technology company uses it.
407
Postgres scaling advice
Planning to scale PostgreSQL? Learn when a single node is enough, how to prepare for sharding, and which scaling steps to consider first.
408
Apache Kafka Goes 1.0
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
409
Call me maybe: Elasticsearch
This post covers Elasticsearch 1.1.0. In the months since its publication, Elasticsearch has added a comprehensive overview of correctness issues and their progress towards fixing some of these bugs.
410
The case for JPEG XL
The recent decision by Chrome developers to no longer support JPEG XL has sent a ripple through the developer community and is a bit premature given the relative newness of the image format.
411
Postgres 11 – A First Look
Postgres 11 is almost here, in fact the latest beta shipped today, and it features a lot of exciting improvements. If you want to get the full list of features it is definitely worth checking out the release notes, but for those who don’t read the release notes I put together a run down of some what I consider the…
412
Pick strong consistency whenever possible
Do you like complex application logic? We don’t either. One of the things we’ve learned here at Google is that application code is simpler and development schedules are shorter when developers can rely on underlying data stores to handle complex transaction processing and keeping data ordered. To quote the original…
413
How the SQLite virtual machine works
Let's look at how SQLite parses, optimizes, and compiles every query that it receives.
414
Pyodide: Bringing the scientific Python stack to the browser
Pyodide is an experimental project from Mozilla to create a full Python data science stack that runs entirely in the browser. We think it’s worthwhile to work on moving the ...
415
Databricks acquires Neon
Databricks agrees to acquire Neon, a serverless Postgres database company, to bring speed and flexibility to production workloads.
416
Sculpture of Housing Prices Ripping San Francisco Apart
This data sculpture depicts a map of housing prices in San Francisco. It's a map of the city, torn at the seams. The height of each area represents the average price per square foot for recent home sales. Where neighboring areas are close in value they are connected, but if neighboring areas are too far
417
JPEG XL: How it started, how it’s going
Significance of Apple's support for JPEG XL and what this means for the widespread adoption of this next-generation image compression format.
418
EdgeDB 2.0
Today we're excited to announce the release of EdgeDB 2.0, the latest version of our graph-relational database.
419
I wrote one of the fastest DataFrame libraries
At the time of writing this, the coronavirus has been in our country for a year, which means I have been sitting at home for a very long time. At the start of the pandemic, I had a few pet projects in Rust under my belt and I noticed that the “are we DataFrame yet” , wasn’t anywhere near my satisfaction. So I wondered…
420
Zero downtime Postgres upgrades
How we upgraded from Postgres 11.9 to 15.3 with zero downtime