Garrit Franke personal blog

Don't trust large context windows

I recently watched a video that put a name on something I'd been feeling. The author splits an LLM's context window into two zones. There's the smart zone , where the model is sharp, and the dumb zone , where attention drops off and the model starts forgetting what you told it five minutes ago. The cutoff sits…
Points
277
HN comments
195
Submissions
1
Cited by
0 commenters

AI & Machine LearningSecurity & Privacy2026

On Hacker News

SubmittedTitle on HNPointsComments
Jun 14, 2026Don't trust large context windows by computersuck277195

More from Garrit Franke

All 5 posts →

Related posts from the same era