301
"Superintelligence" 10 years later
10 years on, some things have changed and some did not
New
The latest blog posts to take off on Hacker News. 673 posts.
302
Diffusion Forcing: Next-Token Prediction Meets Full-Sequence Diffusion
Official Website of Diffusion Forcing
303
AI's $600B Question
The AI bubble is reaching a tipping point. As we continue to follow the GPUs, navigating what comes next will be essential.
304
Block AI bots, scrapers and crawlers with a single click
To help preserve a safe Internet for content creators, we’ve just launched a brand new “easy button” to block all AI bots. It’s available for all customers, including those on our free tier
305
I Received an AI Email
At first I thought it was from a reader.
306
Why AI Infrastructure Startups Are Insanely Hard to Build
Level of difficulty: insane
307
GraphRAG is now on GitHub
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more:
308
Trying Kolmogorov-Arnold Networks in Practice
There's been a fair bit of buzz about Kolmogorov-Arnold networks online lately. Some research papers were posted around claiming that they offer better accuracy or faster training compared to traditional neural networks/MLPs for the same parameter count.
309
The History of Machine Learning in Trackmania
Trackmania: the world's most competitive racing game. In this post, we begin our journey towards training a neural network to superhuman performance, by chronicling the history of previous attempts.
310
My Python code is a neural network
This post translates a Python program to a recurrent neural network. It visualizes the network and explains each step of the translation in detail.
311
My finetuned models beat OpenAI's GPT-4
Finetunes of Mistral, Llama3 and Solar LLMs are more accurate for my test data than OpenAI’s models.
312
A Model of a Mind
This article explains a simple model of how minds might work. I’m motivated by the success of AI-based language models to look at the future of digital minds. I’ll present a conceptual data-flow architecture that can account for several key features of minds: the ability to initiate actions (agency), learning…
313
A simplified Python simulation of diffusion
Understanding the real world is not always easy. A Python simulation can help. And let's find ways of making it efficient, too.
314
The super effectiveness of Pokémon embeddings using only raw JSON and images
Embeddings encourage engineers to go full YOLO because it’s actually rewarding to do so!
315
316
CriticGPT: Finding GPT-4's mistakes with GPT-4
CriticGPT, a model based on GPT-4, writes critiques of ChatGPT responses to help human trainers spot mistakes during RLHF
317
How to think about creating a dataset for LLM fine-tuning evaluation
I summarise the kinds of evaluations that are needed for a structured data generation task.
318
Claude 3.5 Sonnet
There is a new clear best (non-tiny) LLM.
319
Figma AI
We’re introducing a suite of AI-powered features to help you push past creative blocks and bring your best ideas to life.
320
Anthropic: Expanding Access to Claude for Government
Claude 3 Haiku and Sonnet are now available in the AWS Marketplace for the US Intelligence Community and in AWS GovCloud.
321
Making AI better at math tutoring
Too many students struggle with math. In fourth grade, only 36% of students are proficient in math. By ... Read more
322
Waymo One is now open to everyone in San Francisco
The wait is over. Starting today, anyone can hail a ride with Waymo in San Francisco. Rain, shine or Karl the Fog, just download the app, and ride.
323
Researchers run high-performing LLM on the energy needed to power a lightbulb
UC Santa Cruz researchers show that it is possible to eliminate the most computationally expensive element of running large language models, called matrix multiplication, while maintaining performance.
324
Language models on the command line
I gave a talk about accessing Large Language Models from the command-line last week as part of the Mastering LLMs: A Conference For Developers & Data Scientists six week long …
325
A journey into Kindle AI slop hell
A journey into Kindle A.I. slop hell with Leah Beckmann
326
Llama.ttf: A font which is also an LLM
llama.ttf is a font file which is also a large language model and an inference engine for that model.
327
Why your brain is 3 milion more times efficient than GPT-4
Wild ramblings, raport from the field about choosing Vector Database for a particular project and a little bit of a rant about the current state of AI and how it's perceived, why human brains are a wonder of nature, and why it's far from 'thinking' and 'consciousness'.
328
ChatGPT is biased against resumes with credentials that imply a disability
UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the “Tom Wilson Disability Leadership Awa
329
HybridNeRF: Efficient Neural Rendering
Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although this representation is flexible and easy to optimize, most real-world objects can…
330
Shape Rotation 101: An Intro to Einsum and Jax Transformers
Acknowledgements First, I would like to acknowledge my friends and kind internet strangers who helped me with this post. This post heavily adapts from ...