Christian S. Perone personal blog
Large language model data pipelines and Common Crawl
This article provides a short introduction to the pipeline used to create the data to train large language models (LLMs) such as LLaMA using Common Crawl (CC).
- Points
- 139
- HN comments
- 12
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningDatabases & Data2024
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 18, 2024 | Large language model data pipelines and Common Crawl by sonabinu | 139 | 12 |
