152334H personal blog
Calculating the cost of a Google DeepMind paper
Recently, GDM released a great paper titled, Scaling Exponents Across Parameterizations and Optimizers, in which they conduct over 10,000 LLM training runs to obtain optimal hyperparameters under different regimes. After reading it (it was great), I wanted to test my understanding of the paper by tallying up all…
- Points
- 303
- HN comments
- 150
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningTech Industry & Business2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jul 30, 2024 | Calculating the cost of a Google DeepMind paper by 152334H | 303 | 150 |
