Topics /

Software Engineering

The most popular blog posts about software engineering on Hacker News. 1,136 posts.

2023
127

Non-determinism in GPT-4 is caused by Sparse MoE

It’s well-known at this point that GPT-4/GPT-3.5-turbo is non-deterministic, even at temperature=0.0. This is an odd behavior if you’re used to dense decoder-only models, where temp=0 should imply greedy sampling which should imply full determinism, because the logits for the next token should be a pure function of…

131

Regex engine internals as a library

Over the last several years, I’ve rewritten Rust’s regex crate to enable better internal composition, and to make it easier to add optimizations while maintaining correctness. In the course of this rewrite I created a new crate, regex-automata , which exposes much of the regex crate internals as their own APIs for…

139

Rust concepts I wish I learned earlier

This past month, I have been enthralled by the Rust programming language given its unique edge for writing memory-safe, modern programs. Over the years, several languages have emerged as the most preferred by engineers to write resilient, backend software. The tides have shifted from Java/C++ into Go and Rust, which…

140

Emacs 29.1

Today is a great day for Emacs - Emacs 29.1 has just been released1! Every Emacs release is special, but I haven’t been so excited about a new version of Emacs in ages. Why so? Reason #1 - pure GTK front-end (a.k.a. pgtk). This also means that now Emacs supports natively Wayland. Which in tern means that it’s easier…

150

Mjolnir

As much as I loved the beautiful machine , the passive cooling and form factor of the DB4 chassis had limitations. The best GPU I could fit in (and cool down), a 1050 Ti, barely managed to run Diablo 2 Resurrected. Playing could become unpleasant at 30fps in busy levels!