New

The latest blog posts to take off on Hacker News. 21,815 posts.

Software Engineering
Any year
645

WASI 0.3

WASI 0.3 is official, and async is now native to WebAssembly Components. The WASI Subgroup voted to ratify WASI 0.3.0, rebasing WASI onto the WebAssembly Component Model’s async primitives. The 0.3.0 specification is now stable, and runt...

654

Making a vintage LLM from scratch

In this blog post, I will share the adventures I had creating my own LLM, from (almost) scratch, trained only on old texts. I made my own base-training and fine-tuning scripts, data processing pipelines and custom datasets. ("almost from scratch" means I did use existing programming languages and libraries, I didn't…