Topics /

AI & Machine Learning

The most popular blog posts about ai & machine learning on Hacker News. 3,091 posts.

Any year
1865

Notes on training BERT from scratch on an 8GB consumer GPU

I trained a BERT model (Devlin et al, 2019) from scratch on my desktop PC (which has a Nvidia 3060 Ti 8GB GPU). The model architecture, tokenizer, and trainer all came from Hugging Face libraries, and my contribution was mainly setting up the code, setting up the data (~20GB uncompressed text), and leaving my computer…

1887

ML from Scratch, Part 2: Logistic Regression (2018)

In this second installment of the machine learning from scratch we switch the point of view from regression to classification: instead of estimating a number, we will be trying to guess which of 2 possible classes a given input belongs to. A modern example is looking at a photo and deciding if its a cat or a dog.

1888

Policy on the AI Exponential

In one of the side plots to The Lord of the Rings , two of the Hobbits attempt to rouse Treebeard—a wise but ponderous sentient tree—to defend his forest from an army that is cutting it down. The problem is that Treebeard operates at a very different speed than the Hobbits. It takes him a full day simply to say hello…