1
Based: Simple linear attention language models
BASED is a linear attention architecture that decodes without a KV-cache, delivering a 24x throughput improvement over Transformers with FlashAttention-2.
Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research.
Visit together.ai → RSS feedOn Hacker News Oct 2023 – Mar 2026
AI & Machine Learning 8Systems & Performance 4Programming Languages 1Databases & Data 1
BASED is a linear attention architecture that decodes without a KV-cache, delivering a 24x throughput improvement over Transformers with FlashAttention-2.