Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 2,307 posts.

Any topic
2016
1804

Understanding gradient descent

Gradient descent is a standard tool for optimizing complex functions iteratively within a computer program. Its goal is: given some arbitrary function, find a minumum. For some small subset of functions - those that are convex - there's just a single minumum which also happens to be global. For most realistic…