Common Crawl Blog company blog

102TB of New Crawl Data Available

We are very please to announce that new crawl data is now available! The data was collected in 2013, contains approximately 2 billion web pages and is 102TB in size (uncompressed).
Points
237
HN comments
37
Submissions
1
Cited by
0 commenters

Databases & Data2013

On Hacker News

SubmittedTitle on HNPointsComments
Nov 27, 2013102TB of New Crawl Data Available by LisaG23737

More from Common Crawl Blog

All 3 posts →

Related posts from the same era