All posts personal blog
Avoiding Webscraping Throttling Using Python and Tor as a Proxy
In order to hide your IP address and to try and limit throttling when web scraping, it might be a good idea to use a proxy such as Tor. This post describes how to use Python based web scraping tools and Tor to hide yourself when scraping websites for data. However, it can also be used more broadly when using Python to…
- Points
- 165
- HN comments
- 90
- Submissions
- 1
- Cited by
- 0 commenters
Software EngineeringTools & Productivity2019
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jul 13, 2019 | Avoiding Webscraping Throttling Using Python and Tor as a Proxy by bored_hacker | 165 | 90 |