Andrew Chan personal blog
Fast LLM Inference From Scratch (using CUDA)
This post is about building an LLM inference engine using C++ and CUDA from scratch without libraries.
- Points
- 344
- HN comments
- 57
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSystems & Performance2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Dec 14, 2024 | Fast LLM Inference From Scratch (using CUDA) by homarp | 344 | 57 |
