Topics /

AI & Machine Learning

The most popular blog posts about ai & machine learning on Hacker News. 3,090 posts.

Any year
481

How Taalas “prints” LLM onto a chip?

A startup called Taalas , recently released an ASIC chip running Llama 3.1 8B (3/6 bit quant) at an inference rate of 17,000 tokens per seconds. That's like writing around 30 A4 sized pages in one second. They claim it's 10x cheaper in ownership cost than GPU based inference systems and is 10x less electricity hog…

499

Has AI already killed self-help nonfiction books?

My head has been spinning after getting a spreadsheet roughly a week ago. Before we dive into my dirty laundry, let’s state the obvious: millions of people have a vague sense that AI is changing things. And LLMs sure are convenient for getting answers quickly. My team and I use Claude and other tools daily. […]