451
PostgreSQL Parallel Query v2
A recent Twitter poll asked What is your favorite upcoming feature of PostgreSQL V10? In this admittedly unscientific survey, "better para...
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
452
453
Memory Management in Python
To speed-up memory operations and reduce fragmentation Python uses a special manager on top of the general-purpose allocator, called PyMalloc.
454
How to Manage Connections Efficiently in Postgres, or Any Database
Hitting the limit for maximum allowed connections is a common operational problem in Postgres. Here we look at a few techniques for managing connections and making efficient use of those that are available.
455
How to Become a Data Engineer in 2021
The demand for data engineers is growing rapidly. According to hired.com, the demand has increased by 45% in 2019. The median salary for Data Engineers in SF Bay Area is around $160k. So the question…
456
File systems unfit as distributed storage back ends: lessons from Ceph evolution
File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., SOSP’19 Ten years of hard-won lessons packed into just 17 pages (13 if you don’t co…
457
Text classification with Python 3.14's ZSTD module
Python 3.14 added Zstandard to stdlib; its incremental API finally makes classify-by-compression practical.
458
459
460
461
Millions of Tiny Databases
Millions of tiny databases, Brooker et al., NSDI’20 This paper is a real joy to read. It takes you through the thinking processes and engineering practices behind the design of a key part of …
462
463
Postgres 9.2 will feature linear read scalability up to 64 cores
Remember when I blogged about linear read scalability out to 32 cores ? Well, the awesome Nate Boley provided me with access to his brand n...
464
465
Airflow's Problem
In 2022, data engineers manage forests, not trees
466
Short Message Compression Using LLMs
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
467
MongoBleed Explained Simply
CVE-2025-14847 allows attackers to read any arbitrary data from the database's heap memory. It affects all MongoDB versions since 2017, here's a simple explanation:
468
MinIO: A Bare Metal Drop-In for AWS S3
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
469
Python For Feature Film
A look into how Python is used to bring your favorite movies to the big screen.
470
Practical Data Science in Python
Find, classify and remediate PII across your files, email, databases and cloud. Accurate AI-powered PII discovery – on-premise or SaaS.
471
Why SELECT * is bad for SQL performance (2020)
Here’s a list of reasons why SELECT * is bad for SQL performance, assuming that your application doesn’t actually need all the columns. When I write production code, I explicitly specify the columns of interest in the select-list (projection), not only for performance reasons, but also for application reliability…
472
473
Using PostgreSQL as a Dead Letter Queue for Event-Driven Systems
Learn how to use PostgreSQL as a Dead Letter Queue (DLQ) for event-driven systems. Case study from Wayfair showing how to handle failures in Kafka consumers with PostgreSQL.
474
Simdjson 0.3: Faster JSON parser
Last year (2019), we released the simjson library. It is a C++ library available under a liberal license (Apache) that can parse JSON documents very fast. How fast? We reach and exceed 3 gigabytes per second in many instances. It can also parse millions of small JSON documents per second. The new version is much ……
475
Redis Streams and the Unified Log
Building a log-based architecture that’s fast, efficient, and resilient on the new stream data structure in Redis.
476
Why I Use Nim instead of Python for Data Processing
Lazy programmers often prefer to substitute computing effort for programming effort.
477
Decrypting encrypted files from Akira ransomware using a bunch of GPUs
I recently helped a company recover their data from the Akira ransomware without paying the ransom. I'm sharing how I did it, along with the full source code. Update: since this article was written, a new version of Akira ransomware has appeared that can't be decrypted with this method The c
478
Parsing 10TB of Metadata, 26M Domain Names and 1.4M SSL Certs for $10 on AWS
Last May I was working on hobby project similar to this: https://github.com/zakjan/cert-chain-resolver/. As I found the cert-chain-resolver project a couple of days later I did nothing with the results, but I got some…
479
What are embeddings?
A deep-dive into machine learning embeddings.
480
SQLite as a Document Database (2020)
However recently it added a killer feature: generated columns . (This was added in 3.31.0, released 2020-01-22.)