Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book
New research could have big implications for copyright lawsuits against generative AI.
The latest blog posts to take off on Hacker News. 1,227 posts.
New research could have big implications for copyright lawsuits against generative AI.
Over the past few years, we've seen that next-token prediction scales, denoising diffusion scales, contrastive learning scales, and so on, all the way to the point where we can train models with billions of parameters with a scalable objective that can eat up as much data as we can throw at it. Then, what about…
Also: another paper that seals the deal
This new paper by 11 authors from organizations including IBM, Invariant Labs, ETH Zurich, Google and Microsoft is an excellent addition to the literature on prompt injection and LLM security. …
Current recommendations of agentic coding.
The first public passenger locomotive, Locomotion No. 1, began service in September 1825. The first mass-casualty railway disaster happened seventeen years…
We’re excited to share V-JEPA 2, the first world model trained on video that enables state-of-the-art understanding and prediction, as well as zero-shot planning and robot control in new environments.
A year ago, Mihail Eric wrote a blog post detailing his experiences working on AI inside Amazon: How Alexa Dropped the Ball on Being the Top Conversational System on the Planet. It’s a great …
People think they can use Fine-Tune for Knowledge Injection. People are Wrong
We are past the event horizon; the takeoff has started. Humanity is close to building digital superintelligence, and at least so far it’s much less weird than it seems like it should be. Robots...
Somehow I forgot to blog my site: https://lowbackgroundsteel.ai/ . I created it back in March 2023 as a clearinghouse for online resources t...
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
After 2+ years and a tremendous waste of energy and money, my firm Calm Company Fund resolved a lawsuit against us on very favorable terms. What started as one of the most challenging periods of my life became an unexpected masterclass in using AI to level the playing field against well-funded opponents. If you’re…
LLM agents make bad pairs because they code faster than humans think. I'll admit, I've had a lot of fun using GitHub Copilot's agent mode in VS Code this month.…
A lot of people think LLMs are expensive to operate. That was true a couple of years ago, but these people haven't updated their views after an approximately 1000x reduction in prices over two years.
My input stream is full of it: Fear and loathing and cheerleading and prognosticating on what generative AI means and whether it’s Good or Bad and what we should be doing. All the channels: Blogs and peer-reviewed papers and social-media posts and business-news stories. So there’s lots of AI angst out there, but this…
This is the second part of my ongoing self-education in how to adapt my programming experience to a world with computers that talk. The first part, How I program with LLMs , covered ways LLMs can be adapted into our existing tools (basically, autocomplete) and how careful prompting can replace traditional web search…
Protect your organization with Idira®. Modernize identity governance, automate access reviews, and secure every identity across your hybrid cloud environment.
The shameless spin around Stargate UAE
I decided today to take a look at CloudFlare’s new OAuth provider library, which they apparently coded almost entirely with Anthropic’s Claude LLM: This library (including the schema do…
I presented an invited keynote at the AI Engineer World’s Fair in San Francisco this week. This is my third time speaking at the event—here are my talks from October …
Recent generations of frontier language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes…
I’ve been curious about what happens inside Claude Code so I’ve spent a couple hours digging through prompts that it sends back to Anthropic.
Re: My AI Skeptic Friends Are All Nuts There was a post recently that was dissing AI Skeptics. While the post is funny at times, I feel like it’s absolutely and completely missing the point of the skepticism. Or at least I feel that it is glossing over some massive pain points of said skepticism. Let’s go over some of…
My personal website
Note: This post comes with a NotebookLM podcast (1linked at the bottom), and three generated audio recordings. You can read the conversation I had
A ridiculously deep dive into Oblivion’s controversial AI system and its legacy
New revenue benchmarks for gen AI startups in year one, based on dozens of enterprise and consumer AI companies we’ve spent significant time with.