2221
GPT-J-6B: 6B JAX-Based Transformer
Summary: We have released GPT-J-6B, 6B JAX-based (Mesh) Transformer LM (Github).GPT-J-6B performs nearly on par with 6.7B GPT-3 (or Curie) on various zero-shot down-streaming tasks.You can try out …
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,092 posts.
2222
The Bitter Lesson of LLM Extensions
From ChatGPT Plugins to Agent Skills, a look at how we've been trying (and failing) to extend LLMs for the last three years.
2223
Chain of Thought for Humans
These past few weeks, I’ve been conducting interviews, and I often open with “make sure you articulate your thoughts out loud, so I can follow along with your thinking”. This is primarily because I…
2224
LLMs predict my coffee
Why not benchmark with physical experiments?
2225
Unlabeled Object Recognition in Google+
Google+ released an amazing feature that uses object recognition to tag photos. Here is a Reddit thread discussing it. Generalized object r...
2226
Starting from scratch: Training a 30M Topological Transformer
Tauformer is a topological transformer (see paper ) that replaces dot‑product attention with a Laplacian-derived scalar (taumode) per token/head, then attends using distances in that scalar space. Below is a post-style overview of the idea and the first training signals from a 30M-parameter run.
2227
Differentiable Dithering
Problem Let's say we want to reduce the number of colors in an image. For example consider the picture of fruit below:
2228
Formal Verification Gates for AI Coding Loops
Formal verification gates for AI coding loops, in the language you're already shipping.
2229
Speech to Birdsong Conversion
A blog about signals, programming, music, and other stuff.
2230
Deep Learning in the Real World: Dealing with Non-Differentiable Loss Functions
Over the past few years, deep learning has been taking by storm many industries. From voice recognition to image analysis and synthesis, neural networks have turned out to be very efficient at solv…
2231
LLMs are good at playing you
Large language models seem just like humans, but some of this is in our heads.
2232
Hackers influence ChatGPT and Gemini to direct users to scam centers
Think you can trust AI to give you correct answer? Think again.
2233
Meta's Muse appears to use an OpenAI model labeled muse-special
While Muse was building my website, one subagent ran on a model called azure/muse-special. So I dug through the filesystem again.
2234
Why are neural networks and cryptographic ciphers so similar? (2025)
Several neural network design principles are almost identical to cipher design principles.
2235
Generating MIDI Music with GPT-2
Generating Irish/folk/classical music in ABC format using GPT-2-117M, with good results.
2236
2237
Dungeon crawling or lucid dreaming?
I’ve done several experiments with a text-generating neural network called GPT-2. Trained at great expense by OpenAI (to the tune of tens of thousands of dollars worth of computing power), GPT-2 learned to imitate all kinds of text from the internet. I’ve interacted with the basic model, discovering its abilities to…
2238
Machine Learning, Kolmogorov Complexity, and Squishy Bunnies (2019)
Computer Science, Machine Learning, Programming, Art, Mathematics, Philosophy, and Short Fiction
2239
2240
FastText is the best text classification library for a quick baseline
Text classification is a very frequent use case for machine learning (ML) and natural language processing (NLP). It’s used for things like spam detection in emails, sentiment analysis for social media posts, or intent detection in chat bots. In this series I am going to compare several libraries that can be used to…
2241
Is Google’s AI research about to implode?
What does Timnit Gebru’s firing and the recent papers coming out of Google tell us about the state of research at the world’s biggest AI…
2242
AI is too expensive
If you liked this piece, you should subscribe to my premium newsletter. It’s $70 a year, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 5,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic and OpenAI’s
2243
2244
The Competitive Moat That AI Can't Replicate
In a world racing to automate every interaction, the organisations that invest in genuine human connection are quietly building something no algorithm can copy.
2245
Claude Code: Anatomy of a Misfeature
On Canada Day (July 1), 2026, Anthropic shipped a surprising "easter egg" to users of Claude Code: `2.1.198` includes an efficiency bypass which allows agents to continue on without being blocked on direction from a human.
2246
Price per 1M tokens is meaningless
It stops being all about the vibes when the API bill hits you. Many companies are now discovering that AI can indeed be pricey. One habit that might be driving up your AI bill is comparing models by $X per 1M tokens ....
2247
Google and Ambient Computing
Google presented a vision of ambient computing that goes beyond the smartphone. The company is well-placed, but faces challenges both in the marketplace and in the mirror.
2248
2249
ChatGPT has trouble giving an answer before explaining its reasoning
ChatGPT is a fancy auto-complete : what it does is finding the most likely continuation of text for the text it has already printed out (or as a reply for the prompt, when it is starting printing stuff out), according to the large corpus of text it has been trained with.
2250
The AI Great Leap Forward
In 1958, Mao ordered every village to produce steel. The steel was useless. The crops rotted. Today's top-down AI mandates are producing the same pattern: ba...