Best of 2023

The blog posts Hacker News loved most in 2023. 189 posts.

Math & Algorithms
62

Symmetry in Chaos

The following is based upon systems of equations found in "Symmetry in Chaos, A Search for Pattern in Mathematics, Art, and Nature" (the second edition) by Michael Field and Martin Golubitsky. They ask the question whether there are aperiodic chaotic attractors that generate symmetric patterns? Can there be order…

72

When gradient descent is a kernel method

Suppose that we sample a large number N N N of independent random functions f i ⁣ : R → R f_i \colon \R \to \R f i ​ : R → R from a certain distribution F \Fc F and propose to solve a regression problem by choosing a linear combination f ˉ = ∑ i λ i f i . \bar{f} = \sum_i \lambda_i f_i. f ˉ ​ = i ∑ ​ λ i ​ f i ​ . For…

74

The New XOR Problem

In 1969, Marvin Minsky and Seymour Papert published Perceptrons: An Introduction to Computational Geometry. In it, they showed that a single-layer perceptron cannot compute the XOR function. The main argument relies on linear separability: Perceptrons are linear classifiers, which essentially means drawing a line to…

81

My favorite prime number generator

Many years ago I've re-posted a Stack Overflow answer with Python code for a terse prime sieve function that generates a potentially infinite sequence of prime numbers ("potentially" because it will run out of memory eventually). Since then, I've used this code many times - mostly because it's short and clear. In this…

84

The Smallest Hash Table

This December I once again did the Advent of Code , in Rust. If you are interested, my solutions are on Github. I wanted to highlight one particular solution to the day 2 problem as it is both optimized completely beyond the point of reason yet contains a useful technique. For simplicity we’re only going to do part 1…

88

Reflected Diffusion Models

Diffusion models are trained to reverse a stochastic process through score matching. However, a lot of diffusion models rely on a small but critical implementation detail called thresholding. Thresholding projects the sampling process to the data support after each discretized diffusion step, stabilizing generation at…

89

We're Knot Friends

It’s April Cools again. For a few summers in high school and undergrad, I was a day camp counselor. I’ve written before about how it helped me develop storytelling skills, but recently I thought of it again because, while I was cleaning out a closet full of old junk, I happened upon a bag of embroidery thread. While…