Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 155 posts.
I participated in a webinar this morning about prompt injection, organized by LangChain and hosted by Harrison Chase, with Willem Pienaar, Kojin Oshiba (Robust Intelligence), and Jonathan Cohen and Christopher …
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
Recently Google Bard got some powerful updates, including Extensions. Extensions allow Bard to access YouTube, search for flights and hotels, and also to access …
We introduce FunSearch, a method for searching for “functions” written in computer code, and find new solutions in mathematics and computer science. FunSearch works by pairing a pre-trained LLM, whose goal is to provide creative solutions in the form of computer code, with an automated “evaluator”, which guards…
The recent paper, “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors by Jiang et al. [ link ] recently received a lot of attention on twitter.
Humans are hard-wired to dream, to create, to innovate. Each of us seeks to do work that gives us purpose — to write a great novel, to make a discovery, to build strong communities, to care for the sick. The urge to connect to the core of our work lives in all of us. But...
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
If you installed PyTorch-nightly on Linux via pip between December 25, 2022 and December 30, 2022, please uninstall it and torchtriton immediately, and use the latest nightly binaries (newer than...
We examine the Llama-2 models under 3 real-world use cases and show that fine-tuning yields significant accuracy improvements.
A recent paper The Reversal Curse points out an apparent failure in large large language models like GPT-4. From the abstract: We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is
On Saturday 11th March I wrote about how Large language models are having their Stable Diffusion moment. Today is Monday. Let’s look at what’s happened in the past three days. …
Talk to your smart home and let it talk back with our new voice assistant features.
Mozilla’s innovation group and Justine Tunney just released llamafile, and I think it’s now the single best way to get started running Large Language Models (think your own local copy …
Stephen Wolfram shares memories of Doug Lenat, early AI pioneer and developer of the CYC system. Their discussions around AI & logic and the potential combined uses of their respective discoveries.
We use ChatGPT to allow a user to intuitively control multiple robots such as drones, robot arms, home assistant robots using only language.
Augmenting GPT-3 with tools is a popular technique right now. But is GPT-3 really using them?
A lot of people have asked about the computers I used to train TorToiSe. I’ve been meaning to snap some pictures, but it’s never “convenient” to turn these servers off so I keep procrastinating. We had some severe thunderstorms today here i
If you’ve spent any time with GPT-3 or ChatGPT, you’ve likely thought about how useful it would be if you could point them at a specific, current collection of text …
Neural Radiance Field training can be accelerated through the use of grid-based representations in NeRF's learned mapping from spatial coordinates to colors and volumetric density. However, these grid-based approaches lack an explicit understanding of scale and therefore often introduce aliasing, usually in the form…
GitHub Copilot is evolving to bring chat and voice interfaces, support pull requests, answer questions, and adopt OpenAI's GPT-4.
Microsoft knowingly released a broken product for short-term hype
Let’s fix these pesky Transformer outliers using Softmax One and QuietAttention.
The thing I’m most excited about in our weird new AI-enhanced reality is the way it allows me to be more ambitious with my projects. As an experienced developer, ChatGPT …
ChatGPT lies to people. This is a serious bug that has so far resisted all attempts at a fix. We need to prioritize helping people understand this, not debating the …
We’re happy to announce that OpenAI and Microsoft are extending our partnership.
We’re committing $30M to build Mozilla.ai: A startup — and a community — building a trustworthy, independent, and open-source AI ecosystem. We’re o
Evals, RAG, fine-tuning, caching, guardrails, defensive UX, and collecting user feedback.
