Beren Millidge

Scattered Thoughts

Popular posts: 2
Total points: 361
HN comments: 256
Rank: #7,440 personal

Visit beren.io → RSS feedOn Hacker News Apr 2023 – Oct 2023

Software Engineering 2 AI & Machine Learning 2

Most points Most discussed Most cited Newest

LLMs confabulate not hallucinate

2023243 points233 comments AI & Machine Learning details

Minor terminological nitpick. People often describe the LLM as ‘hallucinating’ information whenever it makes up information which seems like it should fit for a given query even when it is trivially false. While evocative, this isn’t actually correct terminology. We already have a perfect word for this precise…

Scaffolded LLMs as natural language computers

2023118 points23 comments AI & Machine Learning details

Recently, LLM-based agents have been all the rage – with projects like AutoGPT showing how easy it is to wrap an LLM in a simple agentic loop and prompt it to achieve real-world tasks. More generally, we can think about the class of ‘scaffolded’ 1 LLM systems – which wrap...