1
How to scale LLMs better with an alternative to transformers
Monarch Mixer: Revisiting BERT, Without Attention or MLPs
We are a CS research group at Stanford led by Professor Chris Ré. Machine learning is fundamentally changing the ways that people build and maintain software, and we’re interested in understanding those shifts and building the foundations for the next generation of machine learning systems.
Visit hazyresearch.stanford.edu → On Hacker News Apr 2023 – Nov 2025
AI & Machine Learning 9Systems & Performance 6Science & Space 1Software Engineering 1Databases & Data 1
Monarch Mixer: Revisiting BERT, Without Attention or MLPs