Sebastian Raschka personal blog
Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention
This article will teach you about self-attention mechanisms used in transformer architectures and large language models (LLMs) such as GPT-4 and Llama.
- Points
- 142
- HN comments
- 11
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSoftware Engineering2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jan 14, 2024 | Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention by rasbt | 142 | 11 |
