Topics /

AI & Machine Learning

The most popular blog posts about ai & machine learning on Hacker News. 402 posts.

2023
305

Large Transformer Model Inference Optimization

[Updated on 2023-01-24: add a small section on Distillation.] Large transformer models are mainstream nowadays, creating SoTA results for a variety of tasks. They are powerful but very expensive to train and use. The extremely high inference cost, in both time and memory, is a big bottleneck for adopting a powerful…

306

The Decade of Deep Learning

As the 2010’s draw to a close, it’s worth taking a look back at the monumental progress that has been made in Deep Learning in this decade.[1] Driven by the development of ever-more powerful comput

319

The AI hype bubble is the new crypto hype bubble

Back in 2017 Long Island Ice Tea – known for its undistinguished, barely drinkable sugar-water – changed its name to "Long Blockchain Corp." Its shares surged to a peak of 400% over their pre-announcement price. The company announced no specific integrations with any kind of blockchain, nor has it made any such…

326

Why TinyML is still so hard to get excited about

This week, I went to the tinyML Summit in Burlingame, Calif. TinyML, or running small machine learning models on constrained devices, is one of the most exciting technologies I’ve encountered. But it’s also the one most likely to put people to sleep when I talk about it. Using local computing to handle object or even…