Topics /

AI & Machine Learning

The most popular blog posts about ai & machine learning on Hacker News. 6,334 posts.

Any year
6035

Prompting LLMs is not engineering

prompt engineering is nothing but an attempt to reverse-engineer a non-deterministic black box for which any of the parameters below are unknown: - training set - weights - constraints on the model - layers between you and the model that transform both your input and the model's output that can change at any time …

6049

Making a vintage LLM from scratch

In this blog post, I will share the adventures I had creating my own LLM, from (almost) scratch, trained only on old texts. I made my own base-training and fine-tuning scripts, data processing pipelines and custom datasets. ("almost from scratch" means I did use existing programming languages and libraries, I didn't…

6054

TorchLean: Formalizing Neural Networks in Lean

Neural networks are increasingly deployed through software stacks whose behavior is defined by tensor layouts, preprocessing choices, compiler boundaries, floating-point arithmetic, GPU kernels, and external model exporters. TorchLean is a Lean 4 codebase for neural network specification, execution, and verification…

6056

Implementing the Goodfellow GANs paper

Generative Adversarial Networks (GANs), discovered by Ian Goodfellow in 2014, were an early method in the area of generative AI. I will focus on image generation as set out in the paper Generative Adversarial Nets 1 . This paper is the focal point of the post, I will guide you through the implementation of the paper…