Command-line tools can be faster than a Hadoop cluster (2014)
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 120 posts.
Adam Drake is an advisor to scale-up tech companies. He writes about ML/AI/data, leadership, and building tech teams.
The Chromium project finds that around 70% of our serious security bugs are memory safety problems . Our next major project is to prevent such bugs at source.
2020-05-26: MongoDB identified a bug in the transaction retry mechanism which they believe was responsible for the anomalies observed in this report; a patch is scheduled for 4.2.8.
Discover how Expensify achieved remarkable scaling: 4M QPS on one server! Dive into optimizing SQLite for impressive performance gains.
The rules of logic no longer apply when you cross the line.
A few months ago I saw a blog post touting fancy new SSE3 functions for implementing vector floor, ceil, and round functions. There was the inevitable proud proclaiming of impressive performance an…
Over the past four years, we've been working hard on rebuilding our desktop client's sync engine from scratch. The sync engine is the magic behind the Dropbox folder on your desktop computer, and it's one of the oldest and most important pieces of code at Dropbox. We're proud to announce today that we've shipped this…
DirectX 12, NVIDIA CUDA, OpenGL and OpenCL acceleration are coming to the Windows Subsystem for Linux.
Continuing this week’s “making an article so I don’t have to keep typing it” ZFS series… here’s why you should stop using RAIDZ, and start using mirror vdevs instead.
Explore many performance improvements, big and small, that have gone into the .NET 5 runtime and core libraries to make apps and services leaner and faster.
10 years ago, systemd was announced and swiftly rose to become one of the most persistently controversial and polarizing pieces of software in recent history, and especially in the GNU/Linux world. The quality and nature of debate has not improved in the least from the major flame wars around 2012-2014, and systemd…
When we launched S3 back in 2006, I discussed its virtually unlimited capacity (“…easily store any number of blocks…”), the fact that it was designed to provide 99.99% availability, and that it offered durable storage, with data transparently stored in multiple locations. Since that launch, our customers have used S3…
From the very beginning of Slack, MySQL was used as the storage engine for all our data. Slack operated MySQL servers in an active-active configuration. This is the story of how we changed our data storage architecture from the active-active clusters over to Vitess — a horizontal scaling system for MySQL. Vitess is…
Updated 11/16/2021: x64 emulation for Windows is now generally available in Windows 11. For those interested in experiencing this, a PC running Windows 11 on Arm is required. Today, we're releasing the first preview of x64 emulation
As AI and HPC datasets continue to increase in size, the time spent loading data for a given application begins to place a strain on the total application’s performance. When considering end-to-end…
There's been some recent discussion about whether the X server is abandonware. As the person arguably most responsible for its care and feed...
Most SQL database engines are implemented as a separate server process. Programs that want to access the database communicate with the server using some kind of interprocess communication (typically TCP/IP) to send requests to the server and to receive back results. SQLite does not work this way. With SQLite, the…
Concurrent operations can be grouped relatively neatly into categories based on their cost
Investigating some details of SIMD related frequency transitions on Intel CPUs.
In Prague, the C++ committee took a series of polls on whether to break ABI, and decided not to. There was no applause. But I’m not sure we fully understood what we did and the consequences it could have.
Introduction: Beginning in Insider Build 17063, you’ll be able to use the unix socket (AF_UNIX) address family on Windows to communicate between Win32
Cloudflare is a security company, and the heart of Workers is, in my view, a security project. Running code written by third parties is always a scary proposition, and the primary concern of the Workers team is to make that safe.
Let me tell you about the still-not-defunct real-time log processing pipeline we built at my now-defunct last job. It handled logs from a la...
Documentation and guides from the team at Fly.io.
Examining the extent of AVX related downclocking on Intel’s Ice Lake CPU
(Heads up — this article was published in October 2020. Much of the general discussion is still relevant, but many of these SoCs are getting quite long in the tooth, and some of the software issues mentioned here have been addressed)