Together AI Blog company blog
RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
- Points
- 236
- HN comments
- 60
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningDatabases & Data2023
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Oct 30, 2023 | RedPajama v2 Open Dataset with 30T Tokens for Training LLMs by programd | 236 | 60 |
