1
Compression is prediction
Compression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.
ngrok Blog
ngrok is developer infrastructure that routes and secures traffic to your apps, APIs, and AI models, wherever they run. Start on localhost, ship to prod.
- Popular posts
- 6
- Total points
- 1,973
- HN comments
- 600
- Rank
- #625 company
Visit ngrok.com → RSS feedOn Hacker News Sep 2024 – Aug 2026
Software Engineering 3AI & Machine Learning 3Math & Algorithms 2Infrastructure & DevOps 2Web & Frontend 1Databases & Data 1
2
Quantization from the Ground Up
A complete guide to quantization: how LLMs store parameters as floats, why shrinking them to 4 or 8 bits barely hurts accuracy, and how to measure the tradeoff.
3
I ported Kubernetes to the browser
Almost 100,000 lines of LLM-generated code in 2 months, and none of it is slop.
4
Prompt caching for cheaper LLM tokens
A far more detailed explanation of prompt caching than anyone asked for: how tokens, embeddings, and attention make cached LLM tokens 10x cheaper and faster.
5
How we built ngrok's data platform
At ngrok, we manage a ~100TiB, 500+ table data lake, managed by a very small team. Here's a look at how we built it and what unique challenges we solved.
6
How Kubernetes Probes Work
Learn how probes work interactively on simulated Kubernetes clusters running in your browser.