Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 14,544 posts.

Software Engineering
Any year
8918

The quadratic sandwich

If you have ever tried to minimize a function with gradient descent, you probably noticed that some functions are a joy to optimize and others are a nightmare. The difference often boils down to two properties: strong convexity and L-smoothness. These two concepts define a “sandwich” of quadratic bounds around your…