Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 4,225 posts.
CouchDB 2.0
The Apache CouchDB development community is proud to announce the immediate availability of version 2.0. See also the official Apache Press Release. CouchDB 2.0 is 99% API compatible with the 1.x s…
Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems
Learn how to use PostgreSQL as a Dead Letter Queue (DLQ) for event-driven systems. Case study from Wayfair showing how to handle failures in Kafka consumers with PostgreSQL.
Apache Arrow is 10 years old
The Apache Arrow project was officially established and had its first git commit on February 5th 2016, and we are therefore enthusiastic to announce its 10-year anniversary! Looking back over these 10 years, the project has developed in many unforeseen ways and we believe to have delivered on our objective of…
Simdjson 0.3: Faster JSON parser
Last year (2019), we released the simjson library. It is a C++ library available under a liberal license (Apache) that can parse JSON documents very fast. How fast? We reach and exceed 3 gigabytes per second in many instances. It can also parse millions of small JSON documents per second. The new version is much ……
Redis Streams and the Unified Log
Building a log-based architecture that’s fast, efficient, and resilient on the new stream data structure in Redis.
Why I Use Nim instead of Python for Data Processing
Lazy programmers often prefer to substitute computing effort for programming effort.
Announcing Google Cloud Bigtable
As businesses become increasingly data-centric, and with the coming age of the Internet of Things (IoT), enterprises and data-driven orga...
The part of Postgres we hate the most: Multi-version concurrency control
Andy Pavlo - Carnegie Mellon University,
Introduction to K-Means Clustering
Under unsupervised learning, all the objects in the same group (cluster) should be more similar to each other than to those in other clusters; data points from different clusters should be as different as possible. Clustering allows you to find and organize data into groups that have been formed organically, rather…
Decrypting encrypted files from Akira ransomware using a bunch of GPUs
I recently helped a company recover their data from the Akira ransomware without paying the ransom. I'm sharing how I did it, along with the full source code. Update: since this article was written, a new version of Akira ransomware has appeared that can't be decrypted with this method The c
Parsing 10TB of Metadata, 26M Domain Names and 1.4M SSL Certs for $10 on AWS
Last May I was working on hobby project similar to this: https://github.com/zakjan/cert-chain-resolver/. As I found the cert-chain-resolver project a couple of days later I did nothing with the results, but I got some…
What are embeddings?
A deep-dive into machine learning embeddings.
UUIDs are popular, but bad for performance (2019)
MySQL UUIDs are still very popular despite a majority of posts warning against their usage. Learn what UUIDs are and why they are very bad for MySQL performance.
Backblaze Hard Drive Stats Q2 2019
This review looks at the Q2 2019 and lifetime hard drive failure rates of the 108,461 hard drives in use at Backblaze's data centers.
A Short Story About SQL’s Biggest Rival
A short story about SQL's better rival: Michael Stonebraker's storied query language, QUEL.
Life in a post-database world: Using crypto to avoid database writes
Possibly one of the biggest hurdles that stands in the way of fostering innovation and discovering newer and better techniques of doing old things is the ease with which developers and designers to…
MemSQL is now free to use for databases with up to 128GB of RAM usage
SingleStore: Now Free to Use
SQLite as a Document Database (2020)
However recently it added a killer feature: generated columns . (This was added in 3.31.0, released 2020-01-22.)
A data table thousands of years old (2020)
I knew that data tables had been around a long time, but I didn't appreciate how long until I read recently about account-keeping in ancient Mesopotamia.
The DynamoDB Paper
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
Satellogic's Open Satellite Feed
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
Introduction to PostgreSQL physical storage
I initially wrote this post for myself, I wanted to understand enough about the underlying physical storage to be able to grasp other concepts which can affect your database. This post is probably more aimed to people with similar interests, I will try to keep it accurate but the aim is to make it simpler to…
I analysed 20 years of my chats
Importing 1.2 million messages from Telegram, VK, Instagram, Facebook, and Twitter into a structured Obsidian vault with local LLM inference - to measure how my friendships work with decay curves, vocabulary shifts, directional sentiment, and conflict rates.
The New York Times Releases Its Dataset of U.S. Confirmed Coronavirus Cases
Today, The New York Times has made one of the most comprehensive datasets of coronavirus cases in the United States publicly available in response to requests from researchers, scientists…
PostgreSQL Features You May Not Have Tried but Should
pgDash is an in-depth monitoring solution designed specifically for PostgreSQL deployments. pgDash shows you information and metrics about every aspect of your PostgreSQL database server, collected using the open-source tool pgmetrics.
Shardines: SQLite3 Database-per-Tenant with ActiveRecord
There is a pattern I am very fond of - “one database per tenant” in web applications with multiple, isolated users. Recently, I needed to fix an application I had for a long time where this database-per-tenant multitenancy utterly broke down, because I was doing connection management wrong. Which begat the question…
PostgreSQL at low level: stay curious
Yes, I know, it’s a long text, and it was my conscious decision to write it in this way. But fear not! Imagine that you read a book, take a look at the introduction and first few interesting sections, think about it and then find time to read further. I hope I’ve left enough references, so if you don’t get some ideas…