1051
Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems
Learn how to use PostgreSQL as a Dead Letter Queue (DLQ) for event-driven systems. Case study from Wayfair showing how to handle failures in Kafka consumers with PostgreSQL.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 4,222 posts.
1052
Apache Arrow is 10 years old
The Apache Arrow project was officially established and had its first git commit on February 5th 2016, and we are therefore enthusiastic to announce its 10-year anniversary! Looking back over these 10 years, the project has developed in many unforeseen ways and we believe to have delivered on our objective of…
1053
Simdjson 0.3: Faster JSON parser
Last year (2019), we released the simjson library. It is a C++ library available under a liberal license (Apache) that can parse JSON documents very fast. How fast? We reach and exceed 3 gigabytes per second in many instances. It can also parse millions of small JSON documents per second. The new version is much ……
1054
Redis Streams and the Unified Log
Building a log-based architecture that’s fast, efficient, and resilient on the new stream data structure in Redis.
1055
Why I Use Nim instead of Python for Data Processing
Lazy programmers often prefer to substitute computing effort for programming effort.
1056
Announcing Google Cloud Bigtable
As businesses become increasingly data-centric, and with the coming age of the Internet of Things (IoT), enterprises and data-driven orga...
1057
The part of Postgres we hate the most: Multi-version concurrency control
Andy Pavlo - Carnegie Mellon University,
1058
Introduction to K-Means Clustering
Under unsupervised learning, all the objects in the same group (cluster) should be more similar to each other than to those in other clusters; data points from different clusters should be as different as possible. Clustering allows you to find and organize data into groups that have been formed organically, rather…
1059
Decrypting encrypted files from Akira ransomware using a bunch of GPUs
I recently helped a company recover their data from the Akira ransomware without paying the ransom. I'm sharing how I did it, along with the full source code. Update: since this article was written, a new version of Akira ransomware has appeared that can't be decrypted with this method The c
1060
Parsing 10TB of Metadata, 26M Domain Names and 1.4M SSL Certs for $10 on AWS
Last May I was working on hobby project similar to this: https://github.com/zakjan/cert-chain-resolver/. As I found the cert-chain-resolver project a couple of days later I did nothing with the results, but I got some…
1061
What are embeddings?
A deep-dive into machine learning embeddings.
1062
UUIDs are popular, but bad for performance (2019)
MySQL UUIDs are still very popular despite a majority of posts warning against their usage. Learn what UUIDs are and why they are very bad for MySQL performance.
1063
Backblaze Hard Drive Stats Q2 2019
This review looks at the Q2 2019 and lifetime hard drive failure rates of the 108,461 hard drives in use at Backblaze's data centers.
1064
A Short Story About SQL’s Biggest Rival
A short story about SQL's better rival: Michael Stonebraker's storied query language, QUEL.
1065
Life in a post-database world: Using crypto to avoid database writes
Possibly one of the biggest hurdles that stands in the way of fostering innovation and discovering newer and better techniques of doing old things is the ease with which developers and designers to…
1066
MemSQL is now free to use for databases with up to 128GB of RAM usage
SingleStore: Now Free to Use
1067
SQLite as a Document Database (2020)
However recently it added a killer feature: generated columns . (This was added in 3.31.0, released 2020-01-22.)
1068
A data table thousands of years old (2020)
I knew that data tables had been around a long time, but I didn't appreciate how long until I read recently about account-keeping in ancient Mesopotamia.
1069
The DynamoDB Paper
This week at USENIX ATC’22, a group of my colleagues 1 from the AWS DynamoDB team are going to be presenting their paper Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service . This paper is a rare look at a real-world distributed system that runs at massive scale.
1070
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
1071
Satellogic's Open Satellite Feed
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
1072
Introduction to PostgreSQL physical storage
I initially wrote this post for myself, I wanted to understand enough about the underlying physical storage to be able to grasp other concepts which can affect your database. This post is probably more aimed to people with similar interests, I will try to keep it accurate but the aim is to make it simpler to…
1073
I analysed 20 years of my chats
Importing 1.2 million messages from Telegram, VK, Instagram, Facebook, and Twitter into a structured Obsidian vault with local LLM inference - to measure how my friendships work with decay curves, vocabulary shifts, directional sentiment, and conflict rates.
1074
The New York Times Releases Its Dataset of U.S. Confirmed Coronavirus Cases
Today, The New York Times has made one of the most comprehensive datasets of coronavirus cases in the United States publicly available in response to requests from researchers, scientists…
1075
PostgreSQL Features You May Not Have Tried but Should
pgDash is an in-depth monitoring solution designed specifically for PostgreSQL deployments. pgDash shows you information and metrics about every aspect of your PostgreSQL database server, collected using the open-source tool pgmetrics.
1076
Shardines: SQLite3 Database-per-Tenant with ActiveRecord
There is a pattern I am very fond of - “one database per tenant” in web applications with multiple, isolated users. Recently, I needed to fix an application I had for a long time where this database-per-tenant multitenancy utterly broke down, because I was doing connection management wrong. Which begat the question…
1077
PostgreSQL at low level: stay curious
Yes, I know, it’s a long text, and it was my conscious decision to write it in this way. But fear not! Imagine that you read a book, take a look at the introduction and first few interesting sections, think about it and then find time to read further. I hope I’ve left enough references, so if you don’t get some ideas…
1078
1079
1080
FerretDB: open-source MongoDB alternative
After many months of development, FerretDB is now production-ready. We are excited to announce the general availability of FerretDB v1.0.