Zamba2-7B
Zyphra is excited to release Zamba2-7B, a state-of-the-art small language model. At the 7B scale, we outperform the leading models of Mistral, Google’s Gemma and Meta’s Llama3 series in both quality and performance.
The latest blog posts to take off on Hacker News. 673 posts.
Zyphra is excited to release Zamba2-7B, a state-of-the-art small language model. At the 7B scale, we outperform the leading models of Mistral, Google’s Gemma and Meta’s Llama3 series in both quality and performance.
Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think
On one side, LLMs show unseen capabilities in reasoning, but on the other - reasoning in LLMs is not ideal.
FLUX is now much faster on Replicate, and we’ve made our optimizations open-source so you can see exactly how they work and build upon them.
How AI Could Transform the World for the Better
We're excited to launch INTELLECT-1, the first globally-distributed training run of a 10-billion-parameter model, inviting anyone to contribute compute and participate. This brings us one step closer towards open source AGI.
Important new study from Apple
I am somehow very late to learning CUDA. I didn’t even know until recently that CUDA is just C++ with a small amount of extra stuff. If I had known that there is so little friction to learnin…
The Nobel Prize in Chemistry 2024 was divided, one half awarded to David Baker "for computational protein design", the other half jointly to Demis Hassabis and John Jumper "for protein structure prediction"
His boundless ambition is putting AI, and the world, on a dangerous path.
Google’s NotebookLLM is the first AI podcast I’d actually listen to. Give it a web page or document, and it will generate you a podcast about it.
Some thoughts on AI and LLMs, based on being Head of Engineering for JumboCode , a club of 180 students at Tufts University that builds software for non-profits.
Today, Waymo and Hyundai Motor Company announced they have entered into a multi-year, strategic partnership.
YC is at our best when backing founders with an ethos of building for others, including strong open source developers like the founders of Continue [https://continue.dev] and many others. Earlier this week, a startup in the current batch, PearAI, was criticized online for an inappropriate approach to open source…
An Architect model describes how to solve the coding problem, and an Editor model translates that into file edits. This Architect/Editor approach produces SOTA benchmark results.
Careful with those human analogies
Introducing canvas
Breaking down revenue growth, the consumer subscription businesses and the importance of partnerships to the API business
I’m at OpenAI DevDay in San Francisco, and I’m trying something new: a live blog, where this entry will be updated with new notes during the event. See OpenAI DevDay: …
Announcing Liquid Foundation Models: state-of-the-art local AI with a smaller memory footprint and faster inference.
Audio Overview is a fun new feature of Google’s NotebookLM which is getting a lot of attention right now. It generates a one-off custom podcast against content you provide, where …
The market needs to be irrational for you to stay solvent.
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
Principal AI Architect. Creator of open-strix, a harness for building agent teams. Writing about AI architecture, stateful agents, and what happens when you give AI memory.
We’re happy to officially launch torchao, a PyTorch native library that makes models faster and smaller by leveraging low bit dtypes, quantization and sparsity. torchao is an accessible toolkit of techniques written...
The AMD Community is entering an exciting new phase—growing into a broader ecosystem of dedicated resources designed to better support and connect you.
Our AI method has accelerated and optimized chip design, and its superhuman chip layouts are used in hardware around the world. AlphaChip was one of the first reinforcement learning approaches used to solve a real-world engineering problem. It generates superhuman or comparable chip layouts in hours, rather than weeks…