1
RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
Dual GPU setup: run Qwen 3.6 27B at a Q8 quantization at 80+ tokens/sec with 39GB total VRAM
imil.net
- Popular posts
- 3
- Total points
- 583
- HN comments
- 205
- Rank
- #4,312 personal
Visit imil.net → On Hacker News Jul 2019 – Jun 2026
Systems & Performance 2Hardware & Electronics 1AI & Machine Learning 1
2
Fakecracker: NetBSD as a Function Based MicroVM
In November 2018 AWS published an Open Source tool called Firecracker , mostly a virtual machine monitor relying on KVM , a small sized Linux kernel, and a stripped down version of Qemu . What baffled me was the speed at which the virtual machine would fire up and run the service. The whole process is to be compared…
3