New
The latest blog posts to take off on Hacker News. 789 posts.
I had ChatGPT write a Decemberists song and recorded it
And I recorded it. Here's "Sailor's Song."
How to train large models on many GPUs? (2021)
[Updated on 2022-03-13: add expert choice routing.] [Updated on 2022-06-10]: Greg and I wrote a shorted and upgraded version of this post, published on OpenAI Blog: “Techniques for Training Large Neural Networks”
Understanding and coding the self-attention mechanism of large language models
Step-by-step tutorial explaining scaled dot-product self-attention for large language models, with Python code that builds the mechanism from scratch.
A new way to build with Large Language Models
Ultravox is a real-time voice AI infrastructure layer that powers fast, natural, and scalable voice agents.
AI Joins Hunt for ET: Study Finds 8 Potential Alien Signals
A University of Toronto undergrad among an international team of researchers unleashing deep learning in the search for extraterrestrial civilizations.
We compete with GitHub. Bing does not show our website
A genuine question on why we are not getting indexed by Bing.
A GPT in 60 Lines of NumPy
Implementing a GPT model from scratch in NumPy.
Use GPT-3 incorrectly: reduce costs 40x and increase speed by 5x
Cosine trains AI models and specialised coding agents for organisations that need frontier capability within secure environments.
Supabase Clippy – ChatGPT for Supabase Docs
Creating a ChatGPT interface for the Supabase documentation.
We come to bury ChatGPT, not to praise it
Large language models (LLMs) like the GPT family learn the statistical structure of language by optimising their ability to predict missing words in sentences (as in ‘The cat sat on the [BLANK]’). Despite the impressive technical ju-jitsu of transformer models and the billions of parameters they learn, it’s still a…
Run CLIP on iPhone to search photos
How I run CLIP (ViT-B-32) on iPhone to search the Photos album offline with Queryable: exporting Core ML text and image encoders for CLIP photo search
Storing OpenAI embeddings in Postgres with pgvector
An example of how to build an AI-powered search engine using OpenAI's embeddings and PostgreSQL.
Bard and new AI features in Search
Introducing Bard (now Gemini), Google's conversational AI service — plus, new AI features in Search.
I used GPT to build a search tool for my second brain note-taking system
In this post, I discuss how I used GPT embeddings to build a smart search tool for my second brain note-taking system.
Artificial intelligence just lost a leader
Plus a position-search announcement from NSF Roger Schank just passed away. Roger was a top leader of AI. I overlapped with him for my time at Yale. In 1974, he became a professor of computer scien…
Understanding the limits of large language models
Reading level: No programming knowledge required, but trying ChatGPT first is advised.
ChatGPT: The Slickest Con Artist of All Time
Or 10 tweets about ChatGPT
Trey Parker and Matt Stone’s deep fake company announces $20M investment
LOS ANGELES, CA, December 20, 2022 — Deep Voodoo, the artificial intelligence entertainment startup formed by Trey Parker and Matt Stone, announced today that it has secured a $20 million investment led by Connect Ventures, an investment partnership between leading entertainment and sports agency Cr
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation
Should AI systems treat different demographic groups unequally?
Anki and GPT-3
Tools for thought, programming, games, homeschooling, and learning
Microsoft Teams Premium: powered by OpenAI’s GPT-3.5
Unlock new experiences with Microsoft Teams Premium for customers looking to make meetings more intelligent, personalized, and protected.
ChatGPT is a bullshit generator but it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
LLM discourse needs more nuance
With this write-up, I want to outline my current thinking around large language models like OpenAI's chatGPT.
New AI classifier for indicating AI-written text
We’re launching a classifier trained to distinguish between AI-written and human-written text.
C++ Neural Network in a Weekend (2020)
A blog about game engines, graphics, C++, and more.
Training NanoGPT on My Journal
Wouldn't it be great to have a pet AI chat bot that knows you really well, and can give you free consulting, coaching and therapy ? What could possibly go wrong if an intelligent corporate-controlled system has unlimited access to your private data to provide you the best possible service? Well... a lot of things.
The Transformer Family
Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sections with more recent papers. Version 2.0 is a superset of…