Gwern Branwen personal blog
The Scaling Hypothesis
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold.
- Points
- 0
- HN comments
- 0
- Submissions
- 0
- Cited by
- 12 commenters
Cited in comments
Linked from 17 Hacker News comments by 12 different people, from Mar 2023 to Jul 2026.
Most recent:
- the8472 · Jul 22, 2026
- the8472 · Apr 4, 2025
- cma · Dec 23, 2024
- dredmorbius · Jun 14, 2024
- Strilanc · Apr 8, 2024
- remontoire · Feb 3, 2024
