91
New
The latest blog posts to take off on Hacker News. 789 posts.
92
Microsoft is eating the world
If OpenAI was a public company, it's stock would have been down about 38% today in a shocking turn of events.
93
OpenAI's misalignment and Microsoft's gain
The end of a dramatic weekend in tech is that OpenAI has split and Microsoft is partnered with one and has hired the other; this is the ultimate failure case of what should have been a for-profit c…
94
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
95
Bootstrapping self awareness in GPT-4: Towards recursive self inquiry
Or, Look Ma – I Made GPT-4 Self Aware!
96
The architecture of today's LLM applications
Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today.
97
A Timeline of the OpenAI Board
Yesterday, Sam Altman and Greg Brockman were fired from the Board of Directors of OpenAI.
98
I disagree with Geoff Hinton regarding "glorified autocomplete"
“People say, It’s just glorified autocomplete . . . Now, let’s analyze that. Suppose you want to be really good at predicting the next word. If you want to be really good, you have to understand what’s being said. That’s the only way. So by training something to be really good at predicting the next word, you’re…
99
A PCIe Coral TPU Finally Works on Raspberry Pi 5
Coral.ai TPUs are AI accelerators used for tasks like machine vision and audio processing. Raspberry Pis are often integrated into small robotics and IoT products—or used to analyze live video feeds with Frigate. Until today, nobody I know of has been able to get a PCI Express Coral TPU working on the Raspberry Pi…
100
Emu Video and Emu Edit, our latest generative AI research milestones
Today, we’re announcing new research into controlled image editing based solely on text instructions and a method for text-to-video generation based on diffusion models.
101
A failed AI girlfriend product, and my lessons
Lessons from Dolores, my failed AI girlfriend product: built on the Stanford AI Town paper with GPT and ElevenLabs voices, why it earned $50 and I gav
102
Google's advanced music generation model and two new AI experiments
Announcing our most advanced music generation model and two new AI experiments, designed to open a new playground for creativity
103
Exploring GPTs: ChatGPT in a trench coat?
The biggest announcement from last week’s OpenAI DevDay (and there were a LOT of announcements) was GPTs. Users of ChatGPT Plus can now create their own, custom GPT chat bots …
104
Writing a GPT-4 script to check Wikipedia for the first unused acronym
Curious what the first ‘unused’ alphabetic acronym is, I have GPT-4 write a script to check English Wikipedia. After three bugs, the first unused one turns out as of 2023-09-29 to be the three-letter acronym ‘CQK’, with another 2.6k TLA unused, and 393k four-letter acronyms unused. Exploratory analysis suggests…
105
Is the reversal curse in LLMs real?
A recent paper The Reversal Curse points out an apparent failure in large large language models like GPT-4. From the abstract: We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is
106
GraphCast: AI model for weather forecasting
Our state-of-the-art model delivers 10-day weather predictions at unprecedented accuracy in under one minute
107
Infinite Context LLMs: Going Beyond RAG with Extended Minds
In this blog we discuss how the transformer architecture naturally extends over external memories, and share empirical results which leverage this capability. These methods are innate (don't require fine tuning) and outperform popular retrieval augmented generation methods.
108
Hacking Google Bard – From Prompt Injection to Data Exfiltration
Recently Google Bard got some powerful updates, including Extensions. Extensions allow Bard to access YouTube, search for flights and hotels, and also to access …
109
110
Fast and Portable Llama2 Inference on the Heterogeneous Edge
Fast and Portable Llama2 Inference on the Heterogeneous Edge.
111
GPU Survival Toolkit for the AI age
Why CPU Knowledge Is No Longer Enough In today's AI age, the majority of developers train in the CPU way. This knowledge has been part of our academics as well, so it's obvious to think and problem-solve in a CPU-oriented way. However, the problem with CPUs is that they rely
112
Google Cloud TPU Multislice Training
We used Multislice Training to run the world’s largest LLM distributed training job on a compute cluster of 50,944 Cloud TPU v5e chips.
113
Don't build AI products the way everyone else is doing it
More and more, people are building products as thin wrappers over other models, especially LLMs. This can cause major issues, and there is a better way.
114
We're sorry we created the Torment Nexus
( This is the text of a talk I delivered at the Next Frontiers Applied Fiction Day in Stuttgart on Friday November 10th, 2023. Note: early draft, contains some typos, I'll fix them next week when I get home. )
115
116
Is AI the next crypto? Insights from HN comments
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
117
The OpenAI Keynote
OpenAI’s developer keynote was exciting, both because AI was exciting, and because OpenAI has the potential to be a meaningful consumer tech company.
118
GPTs: Custom versions of ChatGPT
You can now create custom versions of ChatGPT that combine instructions, extra knowledge, and any combination of skills.
119
New models and developer products
GPT-4 Turbo with 128K context and lower prices, the new Assistants API, GPT-4 Turbo with Vision, DALL·E 3 API, and more.
120
Formalising modern research mathematics in real time
(This is a guest post by Bhavik Mehta) On March 16, 2023, a paper by Campos, Griffiths, Morris, and Sahasrabudhe appeared on the arXiv, announcing an exponential improvement to the upper bound on R…