Topics /

Math & Algorithms

The most popular blog posts about math & algorithms on Hacker News. 132 posts.

2016
69

Fast Fourier transform in x86 assembly

I have a simple fast Fourier transform implementation on the page Free small FFT in multiple languages , whose asymptotic time complexity is the optimal Θ( n log n ). I wanted to know how much additional speed-up could be obtained by reorganizing memory access patterns and using SIMD vector arithmetic instructions…

70

Logical Induction

MIRI is releasing a paper introducing a new model of deductively limited reasoning: “Logical induction,” authored by Scott Garrabrant, Tsvi Benson-Tilsen,

71

The Three Cultures of Machine Learning

Everyone should read Leo Breiman's 2001 article, Statistical Modeling: The Two Cultures . (Summary: Traditional statisticians start with a distribution. They try to identify the parameters of the distribution from data that were actually generated from it. Applied statisticians start with data. They have no idea where…

79

Interactive Numerical Optimization Tutorial

Numerical Optimization is one of the central techniques in Machine Learning. For many problems it is hard to figure out the best solution directly, but it is relatively easy to set up a loss function that measures how good a solution is - and then minimize the parameters of that function to find the solution.

87

Why Don't Computer Scientists Learn Math?

I recently attended the Heidelberg Laureate Forum , in which some older researchers--mainly Fields Medalists and Turing Award winners--talked to and with young researchers. The young researchers ranged from a few students just entering university to young faculty members, most being graduate students. They came from…

90

Don’t invert that matrix (2010)

There is hardly ever a good reason to invert a matrix. What do you do if you need to solve Ax = b where A is an n x n matrix? Isn't the solution A−1 b? Yes, theoretically. But that doesn't mean you need to actually find A−1. Solving the equation Ax = b is