1
How has DeepSeek improved the Transformer architecture?
This Gradient Updates issue goes over the major changes that went into DeepSeek's most recent model.
Epoch AI is a research institute investigating key trends and questions that will shape the trajectory and governance of Artificial Intelligence.
Visit epoch.ai → RSS feedOn Hacker News Jan 2025 – Aug 2026
AI & Machine Learning 8Software Engineering 2Tech Industry & Business 2Security & Privacy 1Math & Algorithms 1Infrastructure & DevOps 1
This Gradient Updates issue goes over the major changes that went into DeepSeek's most recent model.
MirrorCode is Epoch AI's benchmark for long-horizon coding: AI can reimplement entire programs end-to-end, with no access to the original source code.