Christopher Olah personal blog

Calculus on Computational Graphs: Backpropagation (2015)

Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as ten million times faster, relative to a naive implementation. That’s the difference between a model taking a week to train and taking 200,000…
Points
170
HN comments
33
Submissions
2
Cited by
4 commenters

AI & Machine LearningMath & Algorithms2024

On Hacker News

SubmittedTitle on HNPointsComments
Jan 19, 2024Calculus on Computational Graphs: Backpropagation (2015) by throwup23817024
Aug 31, 2015Calculus on Computational Graphs: Backpropagation by inetsee559

Cited in comments

Linked from 4 Hacker News comments by 4 different people, from Jan 2016 to Oct 2021.

Most recent:

Search every comment that links here →

More from Christopher Olah

All 9 posts →

Related posts from the same era