1141
The part of Postgres we hate the most: Multi-version concurrency control
Andy Pavlo - Carnegie Mellon University,
New
The latest blog posts to take off on Hacker News. 4,224 posts.
1142
Ways to shoot yourself in the foot with Postgres
Personal website of Phil Booth
1143
Modern Transactional Stack
Transactional databases have long been the most critical component of application design. Why? Because a steadfast database is generally the ultimate enforcement point for correctness in a messy, distributed world. Without them we’d overpay and undercharge. We’d lose riders trying to get home from the airport, and…
1144
The Sell ∀ ∃ as ∃ ∀ Scam
Artificial intelligence, like machine learning before it, is making big money off what I call the “sell ∀ ∃ as ∃ ∀ scam.” The scam works as follows. Build a sy…
1145
1146
Faster LZ is not the answer to 150-250 GB video game downloads
When the JPEG folks were working on image compression, they didn't create a better or faster LZ. Instead they developed new approaches. I se...
1147
How RocksDB Works
Over the past years, the adoption of RocksDB increased dramatically. It became a standard for embeddable key-value stores.
1148
The Inner Workings of Distributed Databases
Comparison of replication options of time-series databases.
1149
33TB of text data for a 1T-parameter model
Important: This page summarizes data scaling only, using tokens to parameters as a ratio, and as derived from large language models like GPT-3, Chinchilla, and beyond, linked to the Compute-Optimal scaling laws like Kaplan and Hoffmann/Chinchilla. Please note that compute scaling laws are outside the scope of my…
1150
1151
1152
Temporal quality degradation in AI models
A recent study from MIT, Harvard, The University of Monterrey, and other top institutions showed an experiment where 91% of their ML models degrade over time . This study is one of the first of its kind, where researchers focus on studying machine learning models' behavior after deployment and how their performance…
1153
SQL:2023 is finished: Here is what's new
SQL:2023 has been wrapped. The final text has been submitted by the working group to ISO Central Secretariat, and it’s now up to the ISO gods when it will be published. Based on past experience, it could be between a few weeks and a few months.
1154
Do you need a vector database?
Spoiler alert: the answer is maybe! Although, my inclusion of the word “actually” betrays my bias. Vector databases are having their day right now. Three different vector DB companies have raised money on valuations up to $700 million (paywall link). Surprisingly, their rise in popularity is not for their “original”…
1155
SQLite performance tuning: concurrent reads, multiple GBs and 100k SELECTs/s
SQLite is an embedded SQL database. It’s extremely easy to setup, buildable as a single C file with libraries existing for basically all common programming languages. It doesn’t need any server setup or configuration since the SQL logic is run in the host process, and the database consists of only
1156
FerretDB: open-source MongoDB alternative
After many months of development, FerretDB is now production-ready. We are excited to announce the general availability of FerretDB v1.0.
1157
SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a Postgres Queue
Embracing our SQL Maxi nature: how we ripped out RabbitMQ from our infrastructure and replaced it with a Postgres queue.
1158
The end of a myth: Distributed transactions can scale
This paper appeared in VLDB'17. The paper presents NAM-DB, a scalable distributed database system that uses RDMA (mostly 1-way RDMA) and a ...
1159
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
1160
1161
Building a Database in the 2020s (2022)
Building a database in the 2020s
1162
1163
How does database sharding work?
Learn what database sharding is, how sharding works, and some common sharding frameworks and tools.
1164
1165
Mapping hospital accessibility with OpenStreetMap
Using OpenStreetMap data to craft a self-hosted interactive map of hospital accessibility in Virginia.
1166
Near-lossless image formats using ultra-fast LZ codecs
I think simple ultra-high speed lossy (or near-lossless) image codecs, built from the new generation of fast LZ codecs, are going to become ...
1167
Parquet: An efficient, binary file format for table data
Quicker, but also more convenient
1168
15k inserts/s with Rust and SQLite (2021)
There is this growing sentiment in tech that stacking more and more layers of complexity to reach the sacrosanct "infinite scalability" is not the way forward. First, because it rarely materializes: you need a lot of other things than fancy tech to reach millions of people. Second, because the tradeoffs
1169
BigQuery prices increasing by more than 100% for many users
New BigQuery pricing editions and autoscaling let you choose the right price-performance for your workloads, and pay for only what you use.
1170
Postgres as a graph database
You don't need Neo4j for graph data. Walking through nodes, edges, and recursive traversals in plain Postgres, with working SQL.