Google Cloud Blog company blog
Google Cloud TPU Multislice Training
We used Multislice Training to run the world’s largest LLM distributed training job on a compute cluster of 50,944 Cloud TPU v5e chips.
- Points
- 109
- HN comments
- 48
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningInfrastructure & DevOps2023
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Nov 10, 2023 | Google Cloud TPU Multislice Training by infixed | 109 | 48 |
