Topics /

Math & Algorithms

The most popular blog posts about math & algorithms on Hacker News. 266 posts.

2024
37

What Is Entropy?

I wrote a little book about entropy; here’s the current draft: • What is Entropy? If you see typos and other mistakes, or have trouble understanding things, please let me know! An altern…

43

Diffusion Models

I spent 2022 learning to draw and was blindsided by the rise of AI art There is lots to say about this, whether it has been or will be a good thing for artists and society in the long run. I hope to write about it in another post. models like Stable Diffusion. Suddenly, the computer was a better artist than I could…

44

Bayesian Statistics: The three cultures

A traditional subjective Bayesian will assume a data generating distribution (aka a likelihood when viewed as a function of the parameters). Then, conditional on this assumption, they encode their prior beliefs as a prior distribution over parameters. After this, they turn the crank on posterior inference and don’t…

45

The Truth About Linear Regression (2015)

This is basically a compilation of the lecture notes I wrote when teaching 36-401, Modern Regression, in fall 2015 . I offer it here on the chance that it might be of interest to those learning, or teaching, linear regression. There's no shortage of resources on that, but I have tried to present the subject as though…

49

2023 ACM Turing Prize awarded to Avi Wigderson

Avi Wigderson is the recipient of the 2023 ACM A.M. Turing Award for foundational contributions to the theory of computation, including reshaping our understanding of the role of randomness in computation, and for decades of intellectual leadership in theoretical computer science.

50

Where is Noether's principle in machine learning?

Physics likes optimization! Subject to its boundary conditions, the time evolution of a physical system is a critical point for a quantity called an action. This point of view sets the stage for Noether's principle , a remarkable correspondence between continuous invariances of the action and conservation laws of the…

56

Yes, we did discover the Higgs

Ben Recht got my attention with a tweet about his blog post "The Higgs discovery did not take place.” I’m generally a fan of Ben’s writing, but I think he’s off base on a number of issues, and I’ll explain why. [Updated Oct 23rd, 2024] Ben's …

57

How hard can generating 1024-bit primes be?

On the one hand they are easy to explain, they are just numbers that have no factors other than one and themselves, but on the other hand they contain endless complexity. They show up in numerous places, ranging from mathematical concepts and conjectures to interesting looking visualizations and cryptography…