Mwmbl Blog company blog

Indexing a billion pages

It’s two years since we launched Mwmbl, the open source, non-profit search engine, on Boxing Day 2021. A good time to take stock of where we are and where we’re going. We’ve indexed over 100 million pages Thanks to our volunteers, who crawl the web using the Firefox extension and command line script, we’re crawling up…
Points
122
HN comments
35
Submissions
1
Cited by
0 commenters

Databases & DataInfrastructure & DevOps2023

On Hacker News

SubmittedTitle on HNPointsComments
Dec 23, 2023Indexing a billion pages by daoudc12235

Related posts from the same era