1861
AI isn’t good enough
On a recent cross-country trip—I (Paul) drove from California to Illinois and back again.
New
The latest blog posts to take off on Hacker News. 3,091 posts.
1862
Visualizing Neural Networks
A visual example-focused introduction to neural networks.
1863
Early Days of AI
Rather then view LLMs, Transformers, and diffusion models as part of a continuum with past "AI", it is worth thinking of this as an entirely new era and discontinuity from the past
1864
I Made Stable Diffusion XL Smarter by Finetuning It on Bad AI-Generated Images
And then telling it to not generate those images!
1865
Open Challenges in LLM Research
[LinkedIn discussion, Twitter thread]
1866
1867
How Is LLaMa.cpp Possible?
If you want to read more of my writing, I have a Substack . Articles will be posted simultaneously to both places.
1868
My deep learning rig (2022)
A lot of people have asked about the computers I used to train TorToiSe. I’ve been meaning to snap some pictures, but it’s never “convenient” to turn these servers off so I keep procrastinating. We had some severe thunderstorms today here i
1869
Why host your own LLM?
In the Terminator movies, good relationships beat technological superiority. Kyle Reese and Sarah Connor outwit the advanced T-800 who in turn helps Sarah and John beat the ultra-advanced T-1000. OpenAI’s GPT-4 is currently the most advanced publicly available language model. There are also analyses showing it’s…
1870
1871
1872
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
1873
There is no hard takeoff
Back in 2014, Elon Musk referred to AI as summoning the demon. And it wasn’t hard to see that view. Soon, Go agents would beat top humans learning from self play. By the end of 2017, the same algorithm mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could play Atari too.
1874
Artificial General Intelligence – A gentle introduction
[On-line document since 2007, last updated in September 2026] [Translations: 中文 , Español , lietuvių kalba ]
1875
Llama from scratch, or how to implement a paper without crying
Llama from scratch I want to provide some tips from my experience implementing a paper. I'm going to cover my tips so far from implementing a dramatically...
1876
Testing Intel’s Arc A770 GPU for Deep Learning
This post covers my experience training image classification models with Intel’s PyTorch extension on the Arc A770 GPU.
1877
Nvidia's CUDA Monopoly
CUDA (Compute Unified Device Architecture) is a closed-source low-level API that interfaces software with NVIDIA GPUs.
1878
1879
Non-determinism in GPT-4 is caused by Sparse MoE
It’s well-known at this point that GPT-4/GPT-3.5-turbo is non-deterministic, even at temperature=0.0. This is an odd behavior if you’re used to dense decoder-only models, where temp=0 should imply greedy sampling which should imply full determinism, because the logits for the next token should be a pure function of…
1880
Catching up on the weird world of LLMs
I gave a talk on Sunday at North Bay Python where I attempted to summarize the last few years of development in the space of LLMs—Large Language Models, the technology …
1881
Edge detection doesn’t explain line drawing
Reasons to be skeptical of the conventional wisdom about line drawing perception
1882
Patterns for building LLM-based systems and products
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
1883
Nvidia H100 GPUs: Supply and Demand
This post is an exploration of the supply and demand of GPUs, particularly Nvidia H100s.
1884
Gzip beats BERT? Part 2: dataset issues, improved speed, and results
Summary : Update to my last post analyzing the gzip+knn paper. Some of the datasets have heavily contaminated train/test tests. I show some ways to significantly speed-up the gzip method. I present more results of my "fair" reimplementation .
1885
1886
LLMs Unleashed: The Power of Fine-Tuning
Disclaimer: This article mentions https://terra-cotta.ai/, an LLM experimentation platform I am building Introduction ChatGPT, Bard, and other large language models (LLMs) are very useful for a wide variety of tasks from writing code to answering complex questions to aiding with education. However, these models are…
1887
Which GPU(s) to Get for Deep Learning
Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.
1888
We're not Platonists, we've just learned the bitter lesson
Machine Alignment Monday, 7/24/23
1889
What we know about LLMs
~Will Thompson's personal website~
1890
From Python to Elixir Machine Learning
Moving on from Python Machine Learning might seem impossible. Let me break down why and how you can do it.