her.esy.fun personal blog

How I protect my Forgejo instance from AI web crawlers

by Yann Esposito her.esy.fun 3 min read

This article describes my nginx configuration and strategy on how to prevent web crawlers from putting down my instance while still serving most people with minimal amount of friction.

Points

189

HN comments

98

Submissions

1

Cited by

0 commenters

Security & PrivacyWeb & Frontend2025

Related posts from the same era

Claude Code is steganographically marking requests

Thereallo20262,445 points750 commentscited by 3 details

Motorola announces a partnership with GrapheneOS

Motorola News20262,358 points884 commentscited by 10 details

Reverse engineering Ticketmaster's rotating barcodes

conduition20242,305 points714 comments details

The newest Instagram “exploit” is the goofiest I've seen

SSid20262,210 points491 commentscited by 3 details

Bypassing airport security via SQL injection

Ian Carroll20242,004 points440 comments details

Anyone can access deleted and private repository data on GitHub

Truffle Security Blog20241,983 points374 commentscited by 8 details