1
I trained a small transformer in 1.5hrs and it beats many LLMs
I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRM
Hi, I’m Mithil. I graduated from IIT Bombay with a B.Tech in Engineering Physics.
Visit mvakde.github.io → RSS feedOn Hacker News Sep 2026 – Sep 2026
I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRM