1
SEQUOIA: Exact Llama2-70B on an RTX4090 with half-second per-token latency
Serving Llama2-70B on an RTX4090 with Sequoia
Infini-AI-Lab
- Popular posts
- 1
- Total points
- 131
- HN comments
- 61
- Rank
- #8,325 company
Visit infini-ai-lab.github.io → On Hacker News May 2024 – May 2024