Multifaceted: The linguistic echo chambers of LLMs
This is a fun one. I’ve spent more time than I’d care to admit staring at LLM output. And there’s something that I’ve noticed: LLM-generated prose has a kind of… vibe. It’s difficult to describe,…
The AI hype bubble is the new crypto hype bubble
Back in 2017 Long Island Ice Tea – known for its undistinguished, barely drinkable sugar-water – changed its name to "Long Blockchain Corp." Its shares surged to a peak of 400% over their pre-announcement price. The company announced no specific integrations with any kind of blockchain, nor has it made any such…
The secret sauce of TikTok’s recommendations
Dive into the inner workings of TikTok’s awesome real-time recommendation system and learn what makes it one of the best in the field!
VideoPoet A large language model for zero-shot video generation
A Large Language Model for Zero-Shot Video Generation. VideoPoet demonstrates simple modeling method that can convert any autoregressive language model into a high quality video generator.
AI model weight providers should not police uses, no matter how awful they are
The Electronic Frontier Foundation, a digital civil liberties advocacy group, recently published a good article entitled “ISPs Should Not Police Online Speech—No Matter How Awful It Is.” 1 It argues that providers within the internet “stack” should refrain from censoring traffic according to their own values. That…
What if AI didn't make you a bad writer, but a better thinker?
AI will make us smarter and better at our jobs. But if we don't watch out, it will create chaos.
Gptcommit: Never write a commit message again (with the help of GPT-3)
With gptcommit, you no longer have to spend time writing your commit messages. Install gptcommit and let GPT-3 do the writing for you.
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
How to Think Computationally about AI, the Universe and Everything
In his TED Talk, Stephen Wolfram covers the emergence of space by the application of computational rules to spacetime, gravity and quantum mechanics to AI and LLMs. Computational irreducibility and the ruliad.
What Will Transformers Transform?
Generative Pre-trained Transformer models (GPTs) are now all the rage and have inspired op-eds being written by everyone from Henry Kissinger (WSJ) to Noam Chomsky (NYTimes) in just the last month. That sure is some hype level.
Stable LM 3B: Bringing Sustainable, High-Performance LMs to Smart Devices
Our latest language model, Stable LM 3B, is a compact language model designed to operate on portable digital devices like handhelds and laptops.
The many ways that digital minds can know – A better way to think about LLMs
LLMs do all the things people say they do at once, even if those people vociferously disagree, and they’re all useful.
Why TinyML is still so hard to get excited about
This week, I went to the tinyML Summit in Burlingame, Calif. TinyML, or running small machine learning models on constrained devices, is one of the most exciting technologies I’ve encountered. But it’s also the one most likely to put people to sleep when I talk about it. Using local computing to handle object or even…
What I learned using private LLMs to write an undergraduate history essay
I used private and public LLMs to answer an undergraduate essay question I spent a week working on nearly 30 years ago, in an effort to see how the experience would have changed in that time. There were two rules:
AI and Open Source in 2023
The Highs and Lows: A Year in Review
StableLM Zephyr 3B
StableLM Zephyr 3B is a new chat model representing the latest iteration in our series of lightweight LLMs, preference tuned for instruction following and Q&A-type tasks.
Visual Studio’s IntelliSense list can now steer GitHub Copilot code completions
GitHub Copilot in Visual Studio now works with IntelliSense. v1.85 or above is needed, users may need to manually update.
Batch computing and the coming age of AI systems
There’s a lot of excitement right now about human-in-the-loop systems supercharged by foundation models including chat assistants ( ChatGPT ), word processing ( Microsoft Office ), graphic design ( Stable Diffusion ), and code editing ( Copilot ). However, these systems only begin to scratch the surface of the role…
Fireside Chat with Clem Delangue, CEO of Hugging Face
We discuss Hugging Face, Open Source, and AI
A LLM+OLAP Solution
The exploration of a LLM+OLAP solution is a bumpy journey, but phew, it now works well for the Tencent case, and they're writing down every lesson learned to share with you.
Hidet: A Deep Learning Compiler for Efficient Model Serving
Hidet is a powerful deep learning compiler that simplifies the process of implementing high-performing deep learning operators on modern accelerators (e.g., NVIDIA GPUs). With the new feature of torch.compile(...) in PyTorch 2.0, integrating...
Planning for AGI and Beyond
Our mission is to ensure that artificial general intelligence—AI systems that are generally smarter than humans—benefits all of humanity.
2023: The Year of AI
Explore the significant AI advancements, impactful partnerships, and legal debates that defined 2023.
AI’s compute fragmentation: what matrix multiplication teaches us
AI is powered by a virtuous circle of data, algorithms (“models”), and compute. Growth in one pushes needs in the others and can grossly affect the developer experience on aspects like usability and performance. Today, we have more data and more AI model research than ever before, but compute isn’t scaling at the same…