Meta AI company blog
Quantized Llama models with increased speed and a reduced memory footprint
As our first quantized models in this Llama category, these instruction-tuned models retain the quality and safety of the original 1B and 3B models, while achieving 2-4x speedup.
- Points
- 508
- HN comments
- 122
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSystems & Performance2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Oct 24, 2024 | Quantized Llama models with increased speed and a reduced memory footprint by egnehots | 508 | 122 |
