Neural Magic Blog

neuralmagic.com

From live events to hands-on product demos to deep technical research, see what we're doing with AI at Red Hat.

Popular posts: 3
Total points: 590
HN comments: 211
Rank: #2,312 company

Visit neuralmagic.com → On Hacker News Sep 2021 – Nov 2024

AI & Machine Learning 3 Systems & Performance 2 Databases & Data 1

Most points Most discussed Most cited Newest

What happens if we remove 50 percent of Llama?

2024231 points132 comments AI & Machine Learning details

Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.