Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
ML, Biotech, Hardware, and Coordination Problems. Sometimes I write about hard problems and how to solve them.
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 7 posts.
ML, Biotech, Hardware, and Coordination Problems. Sometimes I write about hard problems and how to solve them.
The global memory crunch and the great repricing of consumer electronics
an adventure in image processing and taking very wide photographs (blog post; 4,600 words)
A startup called Taalas , recently released an ASIC chip running Llama 3.1 8B (3/6 bit quant) at an inference rate of 17,000 tokens per seconds. That's like writing around 30 A4 sized pages in one second. They claim it's 10x cheaper in ownership cost than GPU based inference systems and is 10x less electricity hog…
For years, the best way to get 10 gigabit networking on laptops was to buy an expensive, large, and hot 10 GbE Thunderbolt adapter. With new RTL8159-based 10G USB 3.2 adapters coming onto the market, the bulky adapters might be a thing of the past. Just look at the size of the thing in comparison to my Thunderbolt…
I spend time investigating a non-existing bug today because I misunderstood a USB term. So I made myself a cheat sheet. Maybe it will save time to someone.
The microcomputer is an incredible, revolutionary invention. Like the electric light, the printing press, and the wheel, it has changed the world. Without microcomputers, the internet, and perhaps even "life as we know it" would not be possible!