Tracy Durnell personal blog
AI has poisoned its own well
What will happen to GPT-{n} once LLMs contribute much of the language found online? We find that use of model-generated content in training causes irreversible defects in the resulting models, where tails of the original content distribution disappear. We refer to this effect as Model Collapse and show that it can…
- Points
- 102
- HN comments
- 43
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSociety, Policy & Culture2023
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 19, 2023 | AI has poisoned its own well by serhack_ | 102 | 43 |
