Yi Tay personal blog
What happened to BERT and T5?
A Blogpost series about Model Architectures Part 1: What happened to BERT and T5? Thoughts on Transformer Encoders, PrefixLM and Denoising objectives
- Points
- 251
- HN comments
- 68
- Submissions
- 1
- Cited by
- 0 commenters
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jul 19, 2024 | What happened to BERT and T5? by fzliu | 251 | 68 |