451
My class required AI
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
452
33TB of text data for a 1T-parameter model
Important: This page summarizes data scaling only, using tokens to parameters as a ratio, and as derived from large language models like GPT-3, Chinchilla, and beyond, linked to the Compute-Optimal scaling laws like Kaplan and Hoffmann/Chinchilla. Please note that compute scaling laws are outside the scope of my…
453
A guide to prompting AI, for what it is worth
A little bit of magic, but mostly just practice
454
We compete with GitHub. Bing does not show our website
A genuine question on why we are not getting indexed by Bing.
455
RoboCat – A Self-Improving Robotic Agent
Robots are quickly becoming part of our everyday lives, but they’re often only programmed to perform specific tasks well. While harnessing recent advances in AI could lead to robots that could help in many more ways, progress in building general-purpose robots is slower in part because of the time needed to collect…
456
New bioinspired robot flies, rolls, walks, and more
Developed at Caltech's Center for Autonomous Systems and Technologies, a new robot can autonomously choose from a variety of motions to move through a complex environment.
457
Cloud GPU Resources and Pricing
Detailed comparison table of cloud GPU providers for deep learning.
458
The RWKV language model: An RNN with the advantages of a transformer
I explain what is so unique about the RWKV language model.
459
Intuitively Understanding Harris Corner Detector
If you ever tried to learn how the Harris corner detection algorithm works, you might have noticed that the process is not intuitive at all. First, you start with an energy function, approximate it using Taylor approximation, get a matrix from that, then find the eigenvalues of that matrix, etc. But when you come to…
460
OpenAI: Facts from a Weekend
Approximately four GPTs and seven years ago, OpenAI’s founders brought forth on this corporate landscape a new entity, conceived in liberty, and dedicated to the proposition that all men might live…
461
Use.GPU Goes Trad
Old is new again
462
SHOW-1 and Showrunner Agents in Multi-Agent Simulations
South Park AI is an example of how to generate high-quality episodic content through the use of showrunner agents in the simulation. #AI #simulation #multi-agent
463
Remembering Doug Lenat and his quest to capture the world with logic
Stephen Wolfram shares memories of Doug Lenat, early AI pioneer and developer of the CYC system. Their discussions around AI & logic and the potential combined uses of their respective discoveries.
464
465
Refact Code LLM: 1.6B LLM for code that reaches 32% HumanEval
Today we're introducing Refact LLM: 1.6B code model with infill real-time code completion (including fill-in-the-middle(FIM) capability) and chat.
466
Remaking old computer graphics with AI image generation
Can AI Image generation tools make re-imagined, higher-resolution versions of old video game graphics? Over the last few days, I used AI image generation to reproduce one of my childhood nightmares. I wrestled with Stable Diffusion, Dall-E and Midjourney to see how these commercial AI generation tools can help retell…
467
468
Free Dolly: First truly open instruction-tuned LLM
Introducing Dolly, the first open-source, commercially viable instruction-tuned LLM, enabling accessible and cost-effective AI solutions.
469
Double neural bypass restores movement, sense of touch after paralysis
Using brain implants, artificial intelligence and novel stimulation technology, double neural bypass technology restores quadraplegic man’s sense of touch and movement.
470
MetNet-3: A state-of-the-art neural weather model
Posted by Samier Merchant, Google Research, and Nal Kalchbrenner, Google DeepMind Forecasting weather variables such as precipitation, temperature,...
471
Advocating for Open Models in AI Oversight: Stability AI's Letter to U.S. Senate
Stability AI emphasizes the importance of open models in a letter coinciding with the United States Senate hearing on AI oversight. Openness and transparency will improve safety, foster competition, and ensure strategic leadership in critical AI capabilities. Discover how open models can democratize
472
ChatGPT for Robotics
We use ChatGPT to allow a user to intuitively control multiple robots such as drones, robot arms, home assistant robots using only language.
473
Do large language models need all those layers?
Finding that 70% of attention heads and 20% of feed-forward networks can be excised with minimal effect on in-context learning suggests that large language models are undertrained.
474
GPT-3 will ignore tools when it disagrees with them
Augmenting GPT-3 with tools is a popular technique right now. But is GPT-3 really using them?
475
Mojo is now available on Mac
We released Mojo local download for Linux systems on September 7th, and in just over a month we’ve seen tens of thousands of downloads and amazing community projects such as llama.🔥and Infermo. We deeply value your feedback, as Mojicians, and we appreciate every single PR, feature request, and bug report.
476
Most AI startups are doomed
Just because it matters doesn’t mean it’s defensible or profitable
477
Reflected Diffusion Models
Diffusion models are trained to reverse a stochastic process through score matching. However, a lot of diffusion models rely on a small but critical implementation detail called thresholding. Thresholding projects the sampling process to the data support after each discretized diffusion step, stabilizing generation at…
478
479
Teach your LLM to answer with facts, not fiction
Learn how to train LLM for accurate answers with VectorSQL which allows you to execute finely-grained vector searches to target and retrieve the required information
480
Simulating History with ChatGPT
The Case for LLMs as Hallucination Engines