Microsoft company blog
Microsoft Zero and DeepSpeed: Memory Efficient Large Neural Network Training
The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. Microsoft is releasing an open-source library called DeepSpeed, which vastly advances large model training by improving scale, speed…
- Points
- 218
- HN comments
- 20
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningSystems & Performance2020
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Feb 10, 2020 | Microsoft Zero and DeepSpeed: Memory Efficient Large Neural Network Training by bobrenjc93 | 218 | 20 |
