Chroma Research company blog

Context Rot: How increasing input tokens impacts LLM performance

Large Language Models (LLMs) are typically presumed to process context uniformly—that is, the model should handle the 10,000th token just as reliably as the 100th. However, in practice, this assumption does not hold. We observe that model performance varies significantly as input length changes, even on simple tasks…
Points
260
HN comments
59
Submissions
1
Cited by
13 commenters

AI & Machine LearningSoftware Engineering2025

On Hacker News

SubmittedTitle on HNPointsComments
Jul 14, 2025Context Rot: How increasing input tokens impacts LLM performance by kellyhongsn26059

Cited in comments

Linked from 12 Hacker News comments by 13 different people, from Jul 2025 to Apr 2026.

Most recent:

Search every comment that links here →

Related posts from the same era