Top posts

Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,237 posts.

AI & Machine Learning
Any year
707

How to Think About GPUs

We love TPUs at Google, but GPUs are great too. This chapter takes a deep dive into the world of GPUs – how each chip works, how they're networked together, and what that means for LLMs, especially compared to TPUs. While there are a multitude of GPU architectures from NVIDIA, AMD, Intel, and others, here we will…