211
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
212
What is a transformer model? (2022)
Transformer models apply an evolving set of mathematical techniques, called attention or self-attention, to detect subtle ways even distant data elements in a series influence and depend on each other.
213
We're sorry we created the Torment Nexus
( This is the text of a talk I delivered at the Next Frontiers Applied Fiction Day in Stuttgart on Friday November 10th, 2023. Note: early draft, contains some typos, I'll fix them next week when I get home. )
214
215
"Attention", "Transformers", in Neural Network "Large Language Models"
I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
216
217
218
A misleading open letter about sci-fi AI dangers ignores the real risks
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
219
Stochastic gradient descent written in SQL
Edit – this post generated a few insightful comments on Hacker News. I’ve also put the code in a notebook for ease of use. Introduction Modern MLOps is complex because it involves too many components. …
220
Use GPT-3 incorrectly: reduce costs 40x and increase speed by 5x
Cosine trains AI models and specialised coding agents for organisations that need frontier capability within secure environments.
221
Text Is All You Need
Personhood appears to be simpler than we thought
222
Bard is getting better at logic and reasoning
Two improvements are launching in Bard to help you get more accurate responses and export to Google Sheets.
223
Certified 100% AI-free organic content
This is a last call to introduce a "made by an organically-sourced human" label.
224
AI: First New UI Paradigm in 60 Years?
AI is introducing the third user-interface paradigm in computing history, shifting to a new interaction mechanism where users tell the computer what they want, not how to do it — thus reversing the locus of control.
225
Mojo is available for local download
Since our launch of the Mojo programming language on May 2nd, more than 120K+ developers have signed up to use the Mojo Playground and 19K+ developers actively discuss Mojo on Discord and GitHub. Today, we’re excited to announce the next big step in Mojo’s evolution: Mojo is now available for local download …
226
GPU Survival Toolkit for the AI age
Why CPU Knowledge Is No Longer Enough In today's AI age, the majority of developers train in the CPU way. This knowledge has been part of our academics as well, so it's obvious to think and problem-solve in a CPU-oriented way. However, the problem with CPUs is that they rely
227
Custom instructions for ChatGPT
We’re rolling out custom instructions to give you more control over how ChatGPT responds. Set your preferences, and ChatGPT will keep them in mind for all future conversations.
228
I used GPT to build a search tool for my second brain note-taking system
In this post, I discuss how I used GPT embeddings to build a smart search tool for my second brain note-taking system.
229
High-Speed AI Drone Overtakes World-Champion Drone Racers
Remember when IBM’s Deep Blue won against Gary Kasparov at chess in 1996, or Google’s AlphaGo crushed the top champion Lee Sedol at Go, a much more complex game, in 2016? These competitions where machines prevailed over human champions are key milestones in the history of artificial intelligence. Now a group of…
230
Creating a landing page using AI tools and no code
A step-by-step guide to making a landing page with AI and no-code tools: AI-written code and copy, fonts, colour palettes, images, audio and video.
231
A new old kind of R&D lab
Answer.AI will figure out the fundamental research needed to tame AI, and the development path needed to make it useful in practice
232
Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond
Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. Matrix multiplications (matmuls) are the building blocks of today’s ML models. This note presents mm, a visualization...
233
Now add a walrus: Prompt engineering in DALL-E 3
Last year I wrote about my initial experiments with DALL-E 2, OpenAI’s image generation model. I’ve been having an absurd amount of fun playing with its sequel, DALL-E 3 recently. …
234
MK-1
AMD acquires MK1, welcoming their world-class team and marking another key milestone in our strategy to advance AI performance and efficiency.
235
Reddit is OpenAI’s moat
Interpreting Reddit's API changes in light of how it serves OpenAI.
236
Deep Neural Nets: 33 years ago and 33 years from now (2022)
Musings of a Computer Scientist.
237
238
LLM Powered Autonomous Agents
Building agents with LLM (large language model) as its core controller is a cool concept. Several proof-of-concepts demos, such as AutoGPT, GPT-Engineer and BabyAGI, serve as inspiring examples. The potentiality of LLM extends beyond generating well-written copies, stories, essays and programs; it can be framed as a…
239
SDXL Turbo: A Real-Time Text-to-Image Generation Model
SDXL Turbo is a new text-to-image mode based on a novel distillation technique called Adversarial Diffusion Distillation (ADD), enabling the model to create image outputs in a single step and generate real-time text-to-image outputs while maintaining high sampling fidelity.
240
How to train your own large language models
From raw code to a model serving users: the data pipelines, training infrastructure, and evaluation work behind Replit’s language models.