My class required AI
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 789 posts.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
Important: This page summarizes data scaling only, using tokens to parameters as a ratio, and as derived from large language models like GPT-3, Chinchilla, and beyond, linked to the Compute-Optimal scaling laws like Kaplan and Hoffmann/Chinchilla. Please note that compute scaling laws are outside the scope of my…
A little bit of magic, but mostly just practice
A genuine question on why we are not getting indexed by Bing.
Robots are quickly becoming part of our everyday lives, but they’re often only programmed to perform specific tasks well. While harnessing recent advances in AI could lead to robots that could help in many more ways, progress in building general-purpose robots is slower in part because of the time needed to collect…
Developed at Caltech's Center for Autonomous Systems and Technologies, a new robot can autonomously choose from a variety of motions to move through a complex environment.
Detailed comparison table of cloud GPU providers for deep learning.
I explain what is so unique about the RWKV language model.
If you ever tried to learn how the Harris corner detection algorithm works, you might have noticed that the process is not intuitive at all. First, you start with an energy function, approximate it using Taylor approximation, get a matrix from that, then find the eigenvalues of that matrix, etc. But when you come to…
Approximately four GPTs and seven years ago, OpenAI’s founders brought forth on this corporate landscape a new entity, conceived in liberty, and dedicated to the proposition that all men might live…
Old is new again
South Park AI is an example of how to generate high-quality episodic content through the use of showrunner agents in the simulation. #AI #simulation #multi-agent
Stephen Wolfram shares memories of Doug Lenat, early AI pioneer and developer of the CYC system. Their discussions around AI & logic and the potential combined uses of their respective discoveries.
Today we're introducing Refact LLM: 1.6B code model with infill real-time code completion (including fill-in-the-middle(FIM) capability) and chat.
Can AI Image generation tools make re-imagined, higher-resolution versions of old video game graphics? Over the last few days, I used AI image generation to reproduce one of my childhood nightmares. I wrestled with Stable Diffusion, Dall-E and Midjourney to see how these commercial AI generation tools can help retell…
Introducing Dolly, the first open-source, commercially viable instruction-tuned LLM, enabling accessible and cost-effective AI solutions.
Using brain implants, artificial intelligence and novel stimulation technology, double neural bypass technology restores quadraplegic man’s sense of touch and movement.
Posted by Samier Merchant, Google Research, and Nal Kalchbrenner, Google DeepMind Forecasting weather variables such as precipitation, temperature,...
Stability AI emphasizes the importance of open models in a letter coinciding with the United States Senate hearing on AI oversight. Openness and transparency will improve safety, foster competition, and ensure strategic leadership in critical AI capabilities. Discover how open models can democratize
We use ChatGPT to allow a user to intuitively control multiple robots such as drones, robot arms, home assistant robots using only language.
Finding that 70% of attention heads and 20% of feed-forward networks can be excised with minimal effect on in-context learning suggests that large language models are undertrained.
Augmenting GPT-3 with tools is a popular technique right now. But is GPT-3 really using them?
We released Mojo local download for Linux systems on September 7th, and in just over a month we’ve seen tens of thousands of downloads and amazing community projects such as llama.🔥and Infermo. We deeply value your feedback, as Mojicians, and we appreciate every single PR, feature request, and bug report.
Just because it matters doesn’t mean it’s defensible or profitable
Diffusion models are trained to reverse a stochastic process through score matching. However, a lot of diffusion models rely on a small but critical implementation detail called thresholding. Thresholding projects the sampling process to the data support after each discretized diffusion step, stabilizing generation at…
Learn how to train LLM for accurate answers with VectorSQL which allows you to execute finely-grained vector searches to target and retrieve the required information
The Case for LLMs as Hallucination Engines