PyTorch Blog company blog
FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention
In theory, Attention is All You Need. In practice, however, we also need optimized attention implementations like FlashAttention. Although these fused attention implementations have substantially improved performance and enabled long...
- Points
- 210
- HN comments
- 24
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSoftware Engineering2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Aug 8, 2024 | FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention by limoce | 210 | 24 |
