JAX ML company blog

How to scale your model: A systems view of LLMs on TPUs

Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models: how TPUs (and GPUs) work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your…
Points
185
HN comments
30
Submissions
1
Cited by
5 commenters

AI & Machine LearningSystems & Performance2025

On Hacker News

SubmittedTitle on HNPointsComments
Feb 4, 2025How to scale your model: A systems view of LLMs on TPUs by mattjjatgoogle18530

Cited in comments

Linked from 6 Hacker News comments by 5 different people, from Jun 2025 to May 2026.

Most recent:

Search every comment that links here →

More from JAX ML

All 2 posts →

Related posts from the same era