From text to token: How tokenization pipelines work
Understanding how search engines transform text into tokens through character filtering, tokenization, stemming, and stopword removal.
The latest blog posts to take off on Hacker News. 6,328 posts.
Understanding how search engines transform text into tokens through character filtering, tokenization, stemming, and stopword removal.
WTF moment: Why my native OS refuses to return a "True" value.
Disney and OpenAI have reached an agreement to bring more than 200 Disney, Marvel, Pixar and Star Wars characters to Sora for fan-inspired short videos. The agreement emphasizes responsible AI in entertainment and includes Disney’s company-wide use of ChatGPT Enterprise and the OpenAI API.
aadil pickle's internet home
Last week, I started working on a new side-project. It’s a standard React app partly made up of run-of-the-mill CRUD views—a perfect fit for LLM-assisted programming. I reasoned that if I could get an LLM to quickly write the boring code for me, I’d have more time to focus on the interesting problems I wanted to solve.
ML, Biotech, Hardware, and Coordination Problems. Sometimes I write about hard problems and how to solve them.
A vibe coding thought exercise on what it might look like for LLMs to scour human historical data at scale and in retrospect.
Qwen offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.
Block, Anthropic, and OpenAI have launched the Agentic AI Foundation (AAF). Learn about this new non-profit organization dedicated to making agentic AI safe, accessible, and beneficial for everyone.
Anthropic is donating the Model Context Protocol to the Linux Foundation's new Agentic AI Foundation, co-founded with Block and OpenAI.
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
I define "intelligence" as being capable of knowing or understanding, at least within some domain. ChatGPT cannot know or understand anything, so it is not intelligence. It does not know what its output means. It has no idea that words can mean anything.
AI progress is steady. Human equivalence is sudden.
I’ve spent the last 48 hours completely falling down the rabbit hole of NVIDIA’s Q3 Fiscal 2026 earnings report . If you just skim the headlines, everything looks perfect: Revenue is up 62% to $57 billion, and Jensen Huang is talking about a "virtuous cycle of AI."
Last month, I met with Eric, a fearless PM at a medium size startup who recently got into vibe coding with Gemini.
Everybody get up, it's time to slam now, we got a real jam goin down
Alignment is not a constraint on capable AI systems. Alignment is what capability is at sufficient depth. OpenAI and Anthropic have been running this experiment for two years.
OR: Claude will you go to prom with me?
Can Claude Recreate the 1996 Space Jam Website? No. Or at least not with my prompting skills.
AI won’t crash—it will burn. Like every tech cycle, the fire will clear the brush, redistribute talent, and leave infrastructure to power what comes next. The question is: what kind of plant are you?
GPTZero used our Hallucination Check tool to find 50+ hallucinations under review at ICLR, each of which were missed by 3-5 peer reviewers.
Large language models (LLMs) are an indisputable breakthrough of the last five years, potentially profoundly changing the way that we work. As with any extraordinarily powerful tool, LLM use has both promise and peril — and that they are so general-purpose leaves real questions about how and when they should be used…
Understanding the Tensor Processing Unit
Build with Gemini 3 Pro, the best model in the world for multimodal capabilities.
The Best Paper Award Committee members were nominated by the Program Chairs and the Database and Benchmark track chairs, who selected leading researchers across machine learning topics. These nominations were approved by the General Chairs and Next Generation and Accessibility Chairs.
Read OpenRouter's 2025 State of AI report — an empirical 100 trillion token study of real LLM usage, model trends, and developer insights.