Common Crawl Blog company blog
102TB of New Crawl Data Available
We are very please to announce that new crawl data is now available! The data was collected in 2013, contains approximately 2 billion web pages and is 102TB in size (uncompressed).
- Points
- 237
- HN comments
- 37
- Submissions
- 1
- Cited by
- 0 commenters
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Nov 27, 2013 | 102TB of New Crawl Data Available by LisaG | 237 | 37 |