What are transformer models and how do they work?
Explore the fundamentals of transformer models, which have revolutionized natural language processing.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,325 posts.
Explore the fundamentals of transformer models, which have revolutionized natural language processing.
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Today we are introducing Phi-4, our 14B parameter state-of-the-art small language model (SLM) that excels at complex reasoning in areas such as math, in...
Cosine similarity - the duct tape of AI. Convenient but often misused. Let's find out how to use it better.
Jeff Dean is a Google Senior Fellow in the Research Group, where he leads the Google Brain project. He spoke to the YC AI [https://ycombinator.wpengine.com/yc-ai/] group this summer. Here are his slides:
Introducing EmbeddingGemma 2, an open multimodal embedding model optimized for privacy-first use cases
ChatGPT Health is a dedicated experience that securely connects your health data and apps, with privacy protections and a physician-informed design.
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Note: This is the pronunciation of QwQ: /kwju:/ , similar to the word “quill”. What does it mean to think, to question, to understand? These are the deep waters that QwQ (Qwen with Questions) wades into. Like an eternal student of wisdom, it approaches every problem - be it…
Proving you're a human on a web flooded with generative AI content
Teachable Machine, an experiment that makes it easier for anyone to explore machine learning. Teach a machine using your camera – live in the browser, no coding required.
Apple’s accidental moat
Machine learning is a trendy topic, so naturally it’s often used for inappropriate purposes where a simpler, more efficient, and more reliable solution suffices. The other day I saw an illustrative and fun example of this: Neural Network Cars and Genetic Algorithms . The video demonstrates 2D cars driven by a neural…
A 4B open-source model post-trained with Castform retrieved search results as accurately as GPT-5.6 Sol, while costing 100x less.
A research preview of an agent that can use its own browser to perform tasks for you. Available to Pro users in the U.S.
Robotics is one of those things the business funny papers regularly wonder about; it seems like consumer robotics is a revolutionary trillion dollar market which is perpetually 20-years away -more…
Python has become the most popular language in many rapidly evolving sectors, such as deep learning and data sciences. Yet its easy readability comes at the cost of performance. Of course, we all complain about program performance from time to time, and Python should certainly not take all the blame. Still, it's fair…
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
Loops, harnesses, and why even loop skeptics may end up with them.
Intel Gaudi 3 AI accelerator brings global enterprises choice for generative AI, building on the performance and scalability of its Gaudi 2 predecessor.
I'm Jesse. I make stuff. Software, hardware. Very occasionally, trouble.
Ever since Deep Learning hit the scene in speech recognition, word error rates have fallen dramatically. But despite articles you may have read, we still don’t have human-level speech recognition. Speech recognizers have many failure modes. Acknowledging these and taking steps towards solving them is critical to…
OpenAI gave a last-minute presentation at the Black Hat security on Wednesday about “the Hugging Face Incident” (previously on this blog). The video was published yesterday. It’s short and information …
Sinister variations on the positive state of flow
Qwen offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.
Qwen offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.
Claude 2 brings improved performance, a 100K token context window, and 2x better harmlessness, available via API and the claude.ai beta.
Update (April 9, 2025): Since publishing this post, a human support agent from Anthropic has reached out to me. I appreciate them following up.
Not a joke