Read the Docs Blog company blog
AI crawlers need to be more respectful
We talk a bit about the AI crawler abuse we are seeing at Read the Docs, and warn that this behavior is not sustainable.
- Points
- 226
- HN comments
- 118
- Submissions
- 1
- Cited by
- 3 commenters
AI & Machine LearningSociety, Policy & Culture2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jul 25, 2024 | AI crawlers need to be more respectful by pneff | 226 | 118 |
Cited in comments
Linked from 6 Hacker News comments by 3 different people, from Jul 2024 to Sep 2026.
Most recent:
- davidfischer · Sep 9, 2026
- davidfischer · Aug 21, 2025
- ericholscher · Mar 20, 2025
- ericholscher · Jan 10, 2025
- ericholscher · Jan 10, 2025
- lovethevoid · Jul 30, 2024
