PyTorch Internals: Ezyang's Blog
This post is a long form essay version of a talk about PyTorch internals, that I gave at the PyTorch NYC meetup on May 14, 2019.
The latest blog posts to take off on Hacker News. 3,091 posts.
This post is a long form essay version of a talk about PyTorch internals, that I gave at the PyTorch NYC meetup on May 14, 2019.
I got tired with all the AI scrapers that were bullying my git server, so I made a tool to stop them for good.
i <3 firebase
Ever wondered how AI agents actually work behind the scenes?
Blindspots in LLMs I’ve noticed while AI coding. Sonnet family emphasis. Maybe I will eventually suggest Cursor rules for these problems.
Reverse Engineering Reality
Old data, new models
Turning LLMs into coding experts and how to take advantage of them.
LLMs are making software engineers dumber.
The real threat isn’t AI using open knowledge — it’s AI companies killing the projects that make knowledge free
Last year I created a fun little experiment where I asked a bunch of LLMs to rank 97 hackernews users using their comment history based on whether they would be good candidates for the role of “software engineer at google”. (yes yes, seems silly I know, you can read part 1 and part 2 but […]
I have been a skeptic of some of the more breathless claims made for Generative AI since at least October 2023, when I participated in a panel organized by S...
I have noticed something in the past 12 months, something a little profound. I have noticed that I am no longer scared that a project will be too big or too complex for me, or that a project will use a technology or programming language I don’t know.
Model Context Protocol (MCP) is an open standard that connects AI models to tools and data sources efficiently. This guide breaks down MCP’s architecture, benefits, and how it differs from traditional APIs
I shared a controversial take the other day at an event and I decided to write it down in a longer format: I’m afraid AI won't give us a compressed 21st century.
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
AMD is sending us the two MI300X boxes we asked for. They are in the mail.
HN Discussion
How does it work? Every meeting of the flemish government in Belgium is live streamed on a youtube channel. When a livestream starts the software is searching for phones and tries to identify a distracted politician. This is done with the help of AI and face recognition. The video of the distracted politician are then…
For a very long time, it appeared obvious to outside observers of the time flow that Skynet would never win the war, and never annihilate humanity.
Moving on from a toy self-attention mechanism, it's time to find out how to build a real trainable one. Following Sebastian Raschka's book 'Build a Large Language Model (from Scratch)'. Part 8/??
We solve 20% of ARC-AGI-1 with no pretraining by minimizing the description length during inference time, with the only data involved being the target puzzle itself.
DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?
Dive into the world of AI engineering with this exploration of Deep Research in report generation. Learn how LLM-as-a-judge systems, machine learning, and ev...
A surprisingly common complaint I see from developers who have tried using LLMs for code is that they encountered a hallucination—usually the LLM inventing a method or even a full …
OpenAI's latest model raises more questions than answers, but no, the AI bubble isn't popping quite yet.
My (ops-but-sometimes-writes-scripts-to-help-out) coworker just tapped on my shoulder and asked me to look at his code that wasn't working. It was a bit something like this: