PyTorch Blog company blog

Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond

Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. Matrix multiplications (matmuls) are the building blocks of today’s ML models. This note presents mm, a visualization...
Points
289
HN comments
34
Submissions
1
Cited by
0 commenters

AI & Machine LearningMath & Algorithms2023

On Hacker News

SubmittedTitle on HNPointsComments
Sep 26, 2023Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond by saeedesmaili28934

More from PyTorch Blog

All 14 posts →

Related posts from the same era