Mwmbl Blog company blog
Indexing a billion pages
It’s two years since we launched Mwmbl, the open source, non-profit search engine, on Boxing Day 2021. A good time to take stock of where we are and where we’re going. We’ve indexed over 100 million pages Thanks to our volunteers, who crawl the web using the Firefox extension and command line script, we’re crawling up…
- Points
- 122
- HN comments
- 35
- Submissions
- 1
- Cited by
- 0 commenters
Databases & DataInfrastructure & DevOps2023
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Dec 23, 2023 | Indexing a billion pages by daoudc | 122 | 35 |