1
Are You Sure You Want to Use MMAP in Your Database Management System? (2022)
MMAP Databases = 💩
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 34 posts.
2
SQLite Begin Concurrent
Usually, SQLite allows at most one writer to proceed concurrently. The BEGIN CONCURRENT enhancement allows multiple writers to process write transactions simultanously if the database is in "wal" or "wal2" mode, although the system still serializes COMMIT commands.
3
4
The technology behind GitHub’s new code search
A look at what went into building the world's largest public code search index.
5
Pipeworld: Spreadsheet Dataflow Computing (2021)
Now for something completely different. In the spiritual vein of One Night in Rio: Vacation photos from Plan9 and AWK for multimedia, here is a tool that is the link that ties almost all the projec…
6
Scaling SQLite to 4M QPS on a Single Server (EC2 vs Bare Metal)
Discover how Expensify achieved remarkable scaling: 4M QPS on one server! Dive into optimizing SQLite for impressive performance gains.
7
Big data is dead
Big data is dead. Long live easy data. | Reading time: 18 min read
8
What if OpenDocument used SQLite? (2014)
Suppose the OpenDocument file format, and specifically the "ODP" OpenDocument Presentation format, were built around SQLite. Benefits would include:
9
What is a Vector Database? (2021)
Discover Vector Databases: How They Work, Examples, Use Cases, Pros & Cons, Selection and Implementation. They have combined capabilities of traditional databases and standalone vector indexes while specializing for vector embeddings.
10
LLaMA2 Chat 70B outperformed ChatGPT
AlpacaEval an LLM-based automatic evaluation that is fast, cheap, and reliable. It is based on the AlpacaFarm evaluation set, which tests the ability of models to follow general user instructions. These responses are then compared to reference responses (Davinci003 for AlpacaEval, GPT-4 Preview for AlpacaEval 2.0) by…
11
Datomic is Free
Nubank is making all editions of Datomic free of licensing fees, released under Apache 2.0 and available directly from Maven Central, no signup required.
12
JPEG XL: How it started, how it’s going
Significance of Apple's support for JPEG XL and what this means for the widespread adoption of this next-generation image compression format.
13
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
14
Excel will allow certain auto data conversions to be turned off
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
15
Debunking the Myth of "Anonymous" Data
Today, almost everything about our lives is digitally recorded and stored somewhere. Each credit card purchase, personal medical diagnosis, and preference about music and books is recorded and then used to predict what we like and dislike, and—ultimately—who we are. This often happens without our...
16
Accidental database programming
Join me as we take a look at common application data patterns, and how they relate to the inner-workings of databases. In this post, we discuss data caching, indexing, optimistic mutations, and recursive cache invalidation. We will see how life might be easier if we could just use a frontend optimized database like…
17
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
18
Jepsen: MySQL 8.0.34
MySQL needs little introduction. Over the last 28 years it has become one of the most widely deployed SQL databases. MySQL is primarily used for online transaction processing (OLTP) workloads, but is also deployed as a part of OLAP and queuing systems.
19
Backblaze Drive Stats for Q3 2023
Explore Backblaze's Q3 2023 hard drive stats, revealing insights on 259,533 HDDs, failure rates, and data center performance for enhanced reliability.
20
The part of Postgres we hate the most: Multi-version concurrency control
Andy Pavlo - Carnegie Mellon University,
21
We put a distributed database in the browser and made a game of it
TigerBeetle is a distributed financial transactions database, designed for mission critical safety. How do you test something so critical? Well, we could tell you (and we will), but why not show you?
22
Backblaze Drive Stats for 2022
Check out the 2022 year-end Drive Stats data, and let us know your thoughts in the comments.
23
D1: Improvements to performance and scalability
We've been heads down iterating on D1, and we've just shipped a major new version that's substantially faster, more reliable, and introduces Time Travel: the ability to restore a D1 database to any point in time.
24
SciPy builds for Python 3.12 on Windows are a minor miracle
Moving SciPy to Meson meant finding a different Fortran compiler on Windows, which was particularly tricky to pull off for conda-forge. This blog tells the story about how things looked pretty grim for the Python 3.12 release, and how things ended up working out just in the nick of time.
25
Zero downtime Postgres upgrades
How we upgraded from Postgres 11.9 to 15.3 with zero downtime
26
27
Skip the API, ship your database
The best code is the code unwritten. Avoid building a complex API layer by sharing your database between services.
28
BigQuery prices increasing by more than 100% for many users
New BigQuery pricing editions and autoscaling let you choose the right price-performance for your workloads, and pay for only what you use.
29
Unexpected downsides of UUID keys in PostgreSQL
Understand how using UUIDs as primary keys can affect PostgreSQL performance, and how to tweak your index to avoid UUID performance pitfalls.
30
Pg_jsonschema – JSON Schema Support for Postgres
Today we're releasing pg_jsonschema, a Postgres extension for JSON validation.