211
Pre-Release of Polars 2.0
Preview of Python Polars 2.0, bringing the streaming engine to all lazy queries
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
212
Speeding up SQL queries by orders of magnitude using UNION
SQL's UNION operation isn't usually regarded as a way to optimize query performance, but in many cases it can be used to achieve massive improvements in speed.
213
Jepsen: Datomic Pro 1.0.7075
Datomic is a general-purpose database intended for systems of record. In many ways, Datomic is unusual. At any instant in time, the state of the database is represented by a set of [entity, attribute, value] ( EAV ) triples, known as datoms . Each datom declares that some entity (like a person) has a particular…
214
MySQL man pages silently relicensed away from GPL
It has recently been brought to our attention that the MySQL man pages have been relicensed. The change was made rather silently going from MySQL 5.5.30 to MySQL 5.5.31. This affects all pages in the man/ directory of the source code. You can tell the changes have come during this short timeframe (5.5.30->5.5.31). The…
215
SQLite now allows multiple recursive SELECT statements in a single recursive CTE
Is there any command to see the history of a file beyond renames, similar to git log --follow <file> ?
216
How Web Scraping Is Revealing Lobbying and Corruption in Peru
How Web Scraping is Revealing Lobbying and Corruption in Peru - Discover how web scraping is shedding light on lobbying and corruption issues in Peru.
217
We’re pretty happy with SQLite and not urgently interested in a fancier DBMS
Every once in a while, someone suggests that beets should use a “real database.” I think this means storing music metadata in PostgreSQL or MySQL as an alternative to our current SQLite database. The idea is that a more complicated DBMS should be faster, especially for huge music libraries.
218
Why we're ending support for MySQL
GitLab will be ending support for MySQL starting with our 12.1 release – here's why.
219
220
221
222
Kafka without ZooKeeper
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
223
Sqlite 3.30.0
This page provides a high-level summary of changes to SQLite. For more detail, see the Fossil checkin logs at https://sqlite.org/src/timeline and https://sqlite.org/src/timeline?t=release . See the chronology a succinct listing of releases.
224
225
226
Time Series Prediction – A short introduction for pragmatists
Are you trying to predict time series but don't know where to start? This blog post will provide a comparison of the most prominent techniques and show you how …
227
Kafka is dead, long live Kafka
Chances are you probably had a strong reaction to the title of this post. In our experience, Kafka is one of the most polarizing technologies in the data space. Some people hate it, some people swear by it, but almost every technology company uses it.
228
Postgres scaling advice
Planning to scale PostgreSQL? Learn when a single node is enough, how to prepare for sharding, and which scaling steps to consider first.
229
Apache Kafka Goes 1.0
Major milestone release Apache Kafka 4.0 removes ZooKeeper entirely, provides early access to Queues for Kafka, and enables faster rebalances, in addition to many other new KIPs.
230
The case for JPEG XL
The recent decision by Chrome developers to no longer support JPEG XL has sent a ripple through the developer community and is a bit premature given the relative newness of the image format.
231
Pick strong consistency whenever possible
Do you like complex application logic? We don’t either. One of the things we’ve learned here at Google is that application code is simpler and development schedules are shorter when developers can rely on underlying data stores to handle complex transaction processing and keeping data ordered. To quote the original…
232
How the SQLite virtual machine works
Let's look at how SQLite parses, optimizes, and compiles every query that it receives.
233
Pyodide: Bringing the scientific Python stack to the browser
Pyodide is an experimental project from Mozilla to create a full Python data science stack that runs entirely in the browser. We think it’s worthwhile to work on moving the ...
234
Databricks acquires Neon
Databricks agrees to acquire Neon, a serverless Postgres database company, to bring speed and flexibility to production workloads.
235
JPEG XL: How it started, how it’s going
Significance of Apple's support for JPEG XL and what this means for the widespread adoption of this next-generation image compression format.
236
EdgeDB 2.0
Today we're excited to announce the release of EdgeDB 2.0, the latest version of our graph-relational database.
237
Zero downtime Postgres upgrades
How we upgraded from Postgres 11.9 to 15.3 with zero downtime
238
Quack: The DuckDB Client-Server Protocol
DuckDB instances can now talk to each other using the Quack remote protocol. This lets you run DuckDB in a client-server setup with multiple concurrent writers. In DuckDB's spirit, Quack is simple to set up and builds on proven technologies such as HTTP. It's also fast, which allows it to support workloads ranging…
239
Big data on the cheapest MacBook
How does the latest entry-level MacBook perform on database workloads? We benchmarked it using ClickBench and TPC-DS SF300. We found that it could complete both workloads, sometimes with surprisingly good results.
240
Hard Drive Reliability Update – Sep 2014
At Backblaze we now have 34,881 drives and store over 100 petabytes of data. We continually track how our disk drives are doing, which ones are reliable, and which ones need to be replaced.