1
Things we learned about LLMs in 2024
A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past …
New
The latest blog posts to take off on Hacker News. 673 posts.
2
3
OpenAI’s board, paraphrased: ‘All we need is unimaginable sums of money’
OpenAI is to this decade’s generative-AI revolution what Netscape was to the 1990s’ internet revolution.
4
How I run LLMs locally
I document how I run Large Language Models locally.
5
Can LLMs accurately recall the Bible?
I've often found myself uneasy when LLMs (Large Language Models) are asked to quote the Bible. While they can provide insightful discussions about faith, their tendency to hallucinate responses raises concerns when dealing with scripture, which we regard as the inspired Word of God. To explore these concerns, I
6
All You Need Is 4x 4090 GPUs to Train Your Own Model
How I built an ML rig for training LLMs locally, exploring hardware choices, setup tricks, and lessons learned along the way.
7
Google's Results Are Infested, Open AI Is Using Their Playbook from the 2000s
Google search results are becoming annoying to use and Open AI is about to eat Google's lunch.
8
Does current AI represent a dead end?
Eerke Boiten, Professor of Cyber Security at De Montfort University Leicester, explains his belief that current AI should not be used for serious applications.
9
Building AI Products–Part I: Back-End Architecture
In 2023, we launched an AI-powered Chief of Staff for engineering leaders—an assistant that unified information across team tools and tracked critical project developments. Within a year, we attrac...
10
The Open Source AI Definition
version 1.0 See FAQsSee list of endorsementsSee ChecklistEndorse the OSAID Preamble Why we need Open Source Artificial Intelligence (AI) Open Source has demonstrated that massive benefits accrue to…
11
Short Message Compression Using LLMs
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
12
13
Trying out QvQ – Qwen's new visual reasoning model
I thought we were done for major model releases in 2024, but apparently not: Alibaba’s Qwen team just dropped the Apache 2.0 licensed Qwen licensed (the license changed) QvQ-72B-Preview, “an …
14
AIs Will Increasingly Fake Alignment
This post goes over the important and excellent new paper from Anthropic and Redwood Research, with Ryan Greenblatt as lead author, Alignment Faking in Large Language Models.
15
16
Narrative Jailbreaking for Fun and Profit
Posted on Monday 23 Dec 2024. 1,634 words, 1 link. By Matt Webb.
17
18
Exploring LoRA – Part 1: The Idea Behind Parameter Efficient Fine-Tuning
“The What and Why of Adapter based Parameter Efficient Fine Tuning: Understanding Its Purpose and Significance”
19
Can AI do maths yet? Thoughts from a mathematician
So the big news this week is that o3, OpenAI’s new language model, got 25% on FrontierMath. Let’s start by explaining what this means.
20
I sensed anxiety and frustration at NeurIPS 24
last week at NeurIPS’24, one extremely salient thing was the anxiety and frustration felt and expressed by late-year PhD students and postdocs who were confused by the job market that looks and feels so much different from what they expected perhaps when they were applying for PhD programs five or so years ago. and…
21
Welcome to LLMflation - LLM inference cost is going down fast ⬇️
For LLM of equivalent performance, the inference cost is decreasing by 10x every year. What cost $60/million tokens in 2021 costs $.06/million tokens today.
22
OpenAI O3 breakthrough high score on ARC-AGI-PUB
OpenAI o3 scores 75.7% on ARC-AGI public leaderboard.
23
Building Effective "Agents"
Practical guidance from Anthropic on building reliable AI agents, from simple composable patterns to fully autonomous systems.
24
A comparison to Waymo’s auto liability insurance claims at 25M miles
Understanding the safety impact of Automated Driving Systems (ADS) is crucial for their widespread adoption, yet robust real-world evaluation remains a critical area of development. By leveraging insurance industry third-party auto liability claims, we analyze the Waymo ADS performance across 25.3 million fully…
25
The era of open voice assistants
Home Assistant Voice Preview Edition is the best way to get started with our open and privacy-focused voice assistant.
26
27
Alignment faking in large language models
A paper from Anthropic's Alignment Science team on Alignment Faking in AI large language models
28
How we made our AI code review bot stop leaving nitpicky comments
Lessons learned from our challenges reducing LLM output: Discover everything that went wrong when trying to make our models say less.
29
Waymo will bring autonomous vehicles to Tokyo
こんにちは(Konnichiwa) and hello, Japan! We're thrilled to announce that Waymo, in partnership with Nihon Kotsu and GO, will bring our autonomous vehicles to Tokyo for our first international road trip. There, our Driver will learn and adapt to left-hand traffic and new driving nuances associated with operating in one of…
30
Veo 2: Our video generation model
Our leading video generation model