Skip to content

Hazy Research company blog

How to scale LLMs better with an alternative to transformers

hazyresearch.stanford.edu 8 min read

Monarch Mixer: Revisiting BERT, Without Attention or MLPs

Read on hazyresearch.stanford.edu → Discuss on HN (31) Archived copy

Points: 156
HN comments: 31
Submissions: 1
Cited by: 0 commenters

AI & Machine Learning Software Engineering 2023

On Hacker News

Submitted	Title on HN	Points	Comments
Jul 27, 2023	How to scale LLMs better with an alternative to transformers by tuxguy	156	31

More from Hazy Research

All 9 posts →

GPUs Go Brrr

20241,104 points263 commentscited by 3AI & Machine Learning details

We bought the whole GPU, so we're damn well going to use the whole GPU

2025504 points110 comments AI & Machine Learning details

From deep to long learning?

2023499 points117 commentscited by 4AI & Machine Learning details

AMD GPUs Go Brrr

2025268 points92 comments AI & Machine Learning details

HipKittens: Fast and furious AMD kernels

2025244 points91 comments AI & Machine Learning details

Look Ma, No Bubbles: Designing a Low-Latency Megakernel for Llama-1B

2025236 points31 comments AI & Machine Learning details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

Building a Virtual Machine Inside ChatGPT

Jonas Degrave20222,029 points908 commentscited by 16 details

The man who killed Google Search?

Ed Zitron20241,884 points878 commentscited by 47 details

ChatGPT Plugins

OpenAI Blog20231,875 points1,106 commentscited by 14 details