Micrograd.jl
A series on automatic differentiation in Julia. Part 1 provides an overview and defines explicit chain rules.
The latest blog posts to take off on Hacker News. 3,091 posts.
A series on automatic differentiation in Julia. Part 1 provides an overview and defines explicit chain rules.
Generate calendar entries from an image using Anthropic Claude 3.5. Convert lesson dates in an image to a calendar ICS file
As part of our zoom reading group ( wow, 4.5 years old now ), we discussed a paper that uses LLMs for automatic root cause analysis (RCA) fo...
Anthropic have enabled CORS support for their JSON APIs, which means it’s now possible to call the Claude LLMs directly from a user’s browser. This massively significant new feature is …
Stephen Wolfram explores minimal models and their visualizations, aiming to explain the underneath functionality of neural nets and ultimately machine learning.
(Not an anti-AI post — Copilot is great, I use it all the time.)
Turning models into products runs into five challenges
... and how that provides winning evals
Predictability machines and personality
A quiz to see how you compare to language models.
1) Foundational math. 2) Classical machine learning. 3) Deep learning. 4) Cutting-edge machine learning.
Assumed audience: ML researchers who frequently work with PyTorch , but are interested in trying out JAX or have yet to be convinced.
Possibly the one you're Googling about.
I don't think that AI models (by which I mean: large language models) are over-hyped. In this post I will list 50 ways I've used them.
Throughout the last year I’ve written in detail about the rot in tech — the spuriousness of charlatans looking to accumulate money and power, the desperation of the most powerful executives to maintain control and rapacious growth, and the speciousness of the latest hype cycle — but at the end of
Recently, GDM released a great paper titled, Scaling Exponents Across Parameterizations and Optimizers, in which they conduct over 10,000 LLM training runs to obtain optimal hyperparameters under different regimes. After reading it (it was great), I wanted to test my understanding of the paper by tallying up all…
Exploring memory-efficient techniques for LLMs
A free survey course on LLMs, taught by practitioners.
Matthew Honnibal is a computational linguist from Sydney based in Berlin, Germany. He's the author of the spaCy Natural Language Processing library and the co-founder of Explosion.
I offer "no economic boost," you receive "P(doom)"
One of the use cases I thought was reasonable to expect from ChatGPT and Friends (LLMs) was summarising. It turns out I was wrong. What ChatGPT isn’t summarising at all, it only looks like it…
A Blogpost series about Model Architectures Part 1: What happened to BERT and T5? Thoughts on Transformer Encoders, PrefixLM and Denoising objectives
Large language models (LLM) have been all the rage for quite some time now. Looking beyond the hype though, they have severe limitations: hallucinations, lack o
In the previous two golden ages (1950s-1960s and the 1980s), our expectations outpaced the capabilities of the technology at the time, leading to disappointment. In contrast, the AI technology of the current golden age, which began in the mid-2010s, has consistently exceeded our expectations.