Blogs / Company blogs

LMSYS Org Blog

lmsys.org

Large Model Systems Organization - developing large models and systems that are open, accessible, and scalable.

Popular posts
4
Total points
707
HN comments
274
Rank
#1,897 company

Visit lmsys.org → On Hacker News May 2023 – Oct 2025

AI & Machine Learning 4Infrastructure & DevOps 1Hardware & Electronics 1

1

Deploying DeepSeek on 96 H100 GPUs

DeepSeek is a popular open-source large language model (LLM) praised for its strong performance. However, its large size and unique architecture, which uses Multi-head Latent Attention (MLA) and Mixture of Experts (MoE), require an advanced system for efficient serving at scale.