beussery.com personal blog
Robots.txt Disallow: 20 Years of Mistakes To Avoid
The original page did not respond normally when we last checked (HTTP 503). The archived copy may help.
- Points
- 106
- HN comments
- 60
- Submissions
- 1
- Cited by
- 0 commenters
Web & FrontendInfrastructure & DevOps2014
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 30, 2014 | Robots.txt Disallow: 20 Years of Mistakes To Avoid by hornokplease | 106 | 60 |
