The latest blog posts to take off on Hacker News. 3,091 posts.
We introduce a novel sequential modeling approach which enables learning a Large Vision Model ( LVM ) without making use of any linguistic data. To do this, we define a common format, "visual sentences", in which we can represent raw images and videos as well as annotated data sources such as semantic segmentations…
Spying and surveillance are different but related things. If I hired a private detective to spy on you, that detective could hide a bug in your home or car, tap your phone, and listen to what you said. At the end, I would get a report of all the conversations you had and the contents of those conversations. If I hired…
I trusted a lot today. I trusted my phone to wake me on time. I trusted Uber to arrange a taxi for me, and the driver to get me to the airport safely. I trusted thousands of other drivers on the road not to ram my car on the way. At the airport, I trusted ticket agents and maintenance engineers and everyone else who…
This is a fun one. I’ve spent more time than I’d care to admit staring at LLM output. And there’s something that I’ve noticed: LLM-generated prose has a kind of… vibe. It’s difficult to describe,…
Mozilla’s innovation group and Justine Tunney just released llamafile, and I think it’s now the single best way to get started running Large Language Models (think your own local copy …
Just because it matters doesn’t mean it’s defensible or profitable
Custom GPTs by OpenAI are practically free new hires. But as as new hires go, most are not very useful.
Inside every AI is a bigger AI, trying to get out
For most people I interact with, I’m just another text-based program for the most of the time. If input and output are so simple, could I be replaced by the model? For this to work, the model would need to not only understand my writing style but also know a lot about me. The best source for this is my Telegram…
Emergency special: The information we need to understand what Q* is was right in front of us, but the memes are more fun than reality.
Will OpenAI’s Q* change the world?
You can use AI tools like Claude to help you write full-length content. By going paragraph-by-paragraph, you can direct the AI while seemingly maintaining your own voice and ideas. However, despite my attempts to use AI with writing, I’ve found that it’s harder to pull off than I thought. I can get close, but due to…
The anthropologist helped popularize both techno-optimism and the concept of existential risk
Approximately four GPTs and seven years ago, OpenAI’s founders brought forth on this corporate landscape a new entity, conceived in liberty, and dedicated to the proposition that all men might live…
If OpenAI was a public company, it's stock would have been down about 38% today in a shocking turn of events.
The end of a dramatic weekend in tech is that OpenAI has split and Microsoft is partnered with one and has hired the other; this is the ultimate failure case of what should have been a for-profit c…
Things I Learned From Hundreds of Experiments
Or, Look Ma – I Made GPT-4 Self Aware!
Yesterday, Sam Altman and Greg Brockman were fired from the Board of Directors of OpenAI.
“People say, It’s just glorified autocomplete . . . Now, let’s analyze that. Suppose you want to be really good at predicting the next word. If you want to be really good, you have to understand what’s being said. That’s the only way. So by training something to be really good at predicting the next word, you’re…
Coral.ai TPUs are AI accelerators used for tasks like machine vision and audio processing. Raspberry Pis are often integrated into small robotics and IoT products—or used to analyze live video feeds with Frigate. Until today, nobody I know of has been able to get a PCI Express Coral TPU working on the Raspberry Pi…
Lessons from Dolores, my failed AI girlfriend product: built on the Stanford AI Town paper with GPT and ElevenLabs voices, why it earned $50 and I gav
The biggest announcement from last week’s OpenAI DevDay (and there were a LOT of announcements) was GPTs. Users of ChatGPT Plus can now create their own, custom GPT chat bots …
Curious what the first ‘unused’ alphabetic acronym is, I have GPT-4 write a script to check English Wikipedia. After three bugs, the first unused one turns out as of 2023-09-29 to be the three-letter acronym ‘CQK’, with another 2.6k TLA unused, and 393k four-letter acronyms unused. Exploratory analysis suggests…
A recent paper The Reversal Curse points out an apparent failure in large large language models like GPT-4. From the abstract: We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is
Recently Google Bard got some powerful updates, including Extensions. Extensions allow Bard to access YouTube, search for flights and hotels, and also to access …
( This is the text of a talk I delivered at the Next Frontiers Applied Fiction Day in Stuttgart on Friday November 10th, 2023. Note: early draft, contains some typos, I'll fix them next week when I get home. )
