1
We reverse-engineered Flash Attention 4
Asynchrony, fast approximate exponents, and 10x more efficient softmax.
Modal Blog
Cloud infrastructure for teams that develop, train, and serve AI applications at scale.
- Popular posts
- 5
- Total points
- 678
- HN comments
- 272
- Rank
- #1,986 company
Visit modal.com → On Hacker News Mar 2024 – Jan 2026
Infrastructure & DevOps 4AI & Machine Learning 3Software Engineering 2Networking & Internet 1
2
Lambda on hard mode: serverless HTTP in Rust
In this post, we'll talk about how Modal handles real-time HTTP requests and WebSockets in serverless functions.