Gwern Branwen personal blog
The Scaling Hypothesis (2021)
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold.
- Points
- 97
- HN comments
- 63
- Submissions
- 1
- Cited by
- 11 commenters
AI & Machine LearningScience & Space2022
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| May 30, 2022 | The Scaling Hypothesis (2021) by oli5679 | 97 | 63 |
Cited in comments
Linked from 12 Hacker News comments by 11 different people, from May 2021 to Jan 2023.
Most recent:
- theptip · Jan 10, 2023
- swid · Oct 7, 2022
- sinenomine · Sep 12, 2022
- cs702 · Aug 25, 2022
- Strilanc · May 28, 2022
- sinenomine · May 12, 2022
