Baseten Blog company blog

Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

Train, serve, and scale open-source and custom AI models on the fastest, most reliable inference platform.
Points
247
HN comments
175
Submissions
1
Cited by
0 commenters

AI & Machine LearningInfrastructure & DevOps2025

On Hacker News

SubmittedTitle on HNPointsComments
Aug 7, 2025Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by philipkiely247175

More from Baseten Blog

All 3 posts →

Related posts from the same era