1
The One Billion Row Challenge
Update Jan 4: Wow, this thing really took off! 1BRC is discussed at a couple of places on the internet, including Hacker News, lobste.rs, and Reddit. For folks to show-case non-Java solutions, there …
Gunnar Morling
- Popular posts
- 12
- Total points
- 2,214
- HN comments
- 1,298
- Rank
- #724 personal
Visit morling.dev → RSS feedOn Hacker News Feb 2021 – Feb 2026
Software Engineering 11Databases & Data 5Systems & Performance 3Tools & Productivity 1Networking & Internet 1Infrastructure & DevOps 1
2
What If We Could Rebuild Kafka from Scratch?
The last few days I spent some time digging into the recently announced KIP-1150 ("Diskless Kafka"), as well AutoMQ’s Kafka fork, tightly integrating Apache Kafka and object storage, such as S3. …
3
The Code Review Pyramid (2022)
Table of Contents FAQ When it comes to code reviews, it’s a common phenomenon that there is much focus and long-winded discussions around mundane aspects like code formatting and style, whereas …
4
Finding Java Thread Leaks with JDK Flight Recorder and a Bit of SQL
The other day at work, we had a situation where we suspected a thread leak in one particular service, i.e. code which continuously starts new threads, without taking care of ever stopping them again. …
5
Idempotency keys for exactly-once processing
In distributed systems, there’s a common understanding that it is not possible to guarantee exactly-once delivery of messages. What is possible though is exactly-once processing. By adding a unique …
6
Building a Durable Execution Engine with SQLite
Lately, there has been a lot of excitement around Durable Execution (DE) engines. The basic idea of DE is to take (potentially long-running) multi-step workflows, such as processing a purchase order …
7
Tracking Java native memory with JDK flight recorder
As regular readers of this blog will now, JDK Flight Recorder (JFR) is one of my favorite tools of the Java platform. This low-overhead event recording engine built into the JVM is invaluable for …
8
Talking to Postgres Through Java 16 Unix-Domain Socket Channels
Reading a blog post about what’s coming up in JDK 16 recently, I learned that one of the new features is support for Unix domain sockets (JEP 380). Before Java 16, you’d have to resort to 3rd party …
9
Leader Election with S3 Conditional Writes
In distributed systems, for instance when scaling out some workload to multiple compute nodes, it is a common requirement to select a leader for performing a given task: only one of the nodes should …
10
What's in a good error message?
As software developers, we’ve all come across those annoying, not-so-useful error messages when using some library or framework: "Couldn’t parse config file", "Lacking permission for this operation", …
11
Hardwood: A New Parser for Apache Parquet
Today, it’s my great pleasure to announce the first public release of Hardwood, a new parser for the Apache Parquet file format, optimized for minimal dependencies and great performance. Hardwood is …
12
Building agents using streaming SQL queries
Table of Contents Agents Need to Interact With LLMs Agents Should Be Event-Driven Agents Need Context Agents Require Memory When SQL Is Not Enough Parting Thoughts AI Agents have improved in leaps …