OpenAI and Anthropic cut their LLM prices by up to 80% within a few months. Why?
What is “the true cost of a token”?
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,090 posts.
What is “the true cost of a token”?
Writeup for my first major machine learning project.
By today’s standards, the Artificial Intelligence in Street Fighter 2 World Warrior isn’t very sophisticated. These days, when most people talk about AI they’re talking about mach…
This post is a long form essay version of a talk about PyTorch internals, that I gave at the PyTorch NYC meetup on May 14, 2019.
I came across a GH thread related to chess engine development that made me think of why hobby programming communities are increasingly hostile toward LLM development. While the thread doesn’t give a lot of insight into answering the question, it prompted me to think about it a bit. I’ve seen similar sentiments…
TLDR: I gain a lot of fulfillment by making things. I don't consider things built by others at my request to be made by me, and are therefore much less fulfilling. And then I feel sad. This article starts strong and then heads off into the weeds.
Cosine similarity - the duct tape of AI. Convenient but often misused. Let's find out how to use it better.
Proving you're a human on a web flooded with generative AI content
Apple’s accidental moat
Machine learning is a trendy topic, so naturally it’s often used for inappropriate purposes where a simpler, more efficient, and more reliable solution suffices. The other day I saw an illustrative and fun example of this: Neural Network Cars and Genetic Algorithms . The video demonstrates 2D cars driven by a neural…
Robotics is one of those things the business funny papers regularly wonder about; it seems like consumer robotics is a revolutionary trillion dollar market which is perpetually 20-years away -more…
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
Loops, harnesses, and why even loop skeptics may end up with them.
I'm Jesse. I make stuff. Software, hardware. Very occasionally, trouble.
Ever since Deep Learning hit the scene in speech recognition, word error rates have fallen dramatically. But despite articles you may have read, we still don’t have human-level speech recognition. Speech recognizers have many failure modes. Acknowledging these and taking steps towards solving them is critical to…
OpenAI gave a last-minute presentation at the Black Hat security on Wednesday about “the Hugging Face Incident” (previously on this blog). The video was published yesterday. It’s short and information …
Update (April 9, 2025): Since publishing this post, a human support agent from Anthropic has reached out to me. I appreciate them following up.
Not a joke
Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing …
AI is being done wrong.
I am publishing a comprehensive deep dive, not just a technical overview, but also strategic and financial coverage of the Google TPU.
Written in collaboration with Joseph Miller. See the discussion of this post over on LessWrong.
It is important to provide credit.
This post is part of a series about machine learning and artificial intelligence. Click on the blog tag “huskyai” to see related posts. Overview: …
A week ago the Copy Fail vulnerability came out, and Hyunwoo Kim immediately realized that the fixes were insufficient, sharing a patch the same day. In doing this he followed standard procedure for Linux, especially within networking: share the security impact with a closed list of Linux security engineers, while…
I think it’s now possible to train a large language model with similar functionality to GPT-3 for $85,000. And I think we might soon be able to run the resulting …
I gave a talk on Wednesday at the Bay Area AI Security Meetup about prompt injection, the lethal trifecta and the challenges of securing systems that use MCP. It wasn’t …