Persimmon-8B
We’re open-sourcing Persimmon-8B, the most powerful fully permissively-licensed language model with <10 billion parameters.
We’re open-sourcing Persimmon-8B, the most powerful fully permissively-licensed language model with <10 billion parameters.
Disclaimer: This article mentions https://terra-cotta.ai/, an LLM experimentation platform I am building Introduction ChatGPT, Bard, and other large language models (LLMs) are very useful for a wide variety of tasks from writing code to answering complex questions to aiding with education. However, these models are…
Harold Cohen (1928 – 2016) explored AI and art for nearly 50 years before we saw the rising popularity of these new machine learning tools. In those five decades, Cohen worked on a single program called Aaron that involved teaching a robot to create drawings. Aaron’s education took a similar pa
A short simulation of Neal Stephenson's Illustrated Primer using GPT-4 and DALL·E 3.
Introducing v0
LLMs are not a direct solution to most of the NLP use-cases companies have been working on. They are extremely useful, but if you want to deliver reliable software you can improve over time, you can't just write a prompt and call it a day. Once you're past prototyping and want to deliver the best system you can…
Low-rank adaptation (LoRA) is a technique for fine-tuning models that has some advantages over previous methods:
On a recent cross-country trip—I (Paul) drove from California to Illinois and back again.
Nvidia is an amazing company that has executed a contrarian vision for decades, and has rightly become one of the most valuable corporations on the planet thanks to its central role in the AI revol…
The UK’s flagship institute for artificial intelligence, the Alan Turing Institute, has been at best irrelevant to the development of modern AI in the UK.
Posted by Fabian Pedregosa and Eleni Triantafillou, Research Scientists, Google Deep learning has recently driven tremendous progress in a wide arr...
Discover SDXL 0.9, Stability AI's cutting-edge release in the Stable Diffusion suite. Unleashing remarkable image and composition precision, this upgrade revolutionizes generative AI imagery. From hyper-realistic media production to design and industrial advancements, explore the limitless possibili
A series of patterns for building an AI co-pilot application.
I trained a BERT model (Devlin et al, 2019) from scratch on my desktop PC (which has a Nvidia 3060 Ti 8GB GPU). The model architecture, tokenizer, and trainer all came from Hugging Face libraries, and my contribution was mainly setting up the code, setting up the data (~20GB uncompressed text), and leaving my computer…
At long last, a real-world use case for AI!
The new TPU v5p is a core element of AI Hypercomputer, which is tuned, managed, and orchestrated specifically for gen AI training and serving.
In this edition of the newsletter, we direct our attention to one of the most prominent highlights of the summer: the release of the Llama 2 base and chat models, as well as CodeLlama, the latest highlights in the open-source AI large language model (LLM) landscape.
Bard can now help with programming and software development tasks, across more than 20 programming languages.
Responding to the French National Assembly’s decision to permit the use of mass video surveillance technology powered by Artificial Intelligence (AI) during the 2024 Olympics, Mher Hakobyan, Amnesty International’s Advocacy Advisor on AI Regulation, said: “France’s decision to allow the use of mass surveillance…
Before I joined Replit, I had never written a line of code. A few weeks ago, I built a Slack Bot that uses Google LLMs to provide daily channel summaries. You can fork the template or get started with 100 Days of Code. None of this was possible without Replit. Let me explain why: Getting started with no setup
Google could do more than just win the chatbot war: it is the one company that could make a universal assistant. The question is if the company is willing to risk it all.
Another question might be; why do machine learning at all? I'm not big into ML/AI though I've been poking it more recently as the open models, such as Stable Diffusion and the more practical Whisper, caught my curiosity. I have a very decent GPU (3090 Ti) and I've poked around a bit. I don't consider ML a super…
Protect sensitive data from phishing and social engineering with Varonis Interceptor, AI-native email security with 99.9% detection and real-time response.
We present basic math related to computation and memory usage for transformers
SeamlessM4T allows people to communicate effortlessly through speech and text across different languages.
A study by Google's DeepMind and the University of Illinois at Urbana-Champaign has found that self-correction in large language models (LLMs) isn't universally effective.
Alles wat Jan bezighoudt, interesseert en irriteert... en ook een beetje onzin...
Snowflake is acquiring Neeva, a search company founded to make search even more intelligent at scale by leveraging generative AI and other innovations.
I think by now everybody reading this will have seen how the new generation of Large Language Models like ChatGPT are able to produce somewhat useful code. Like any advance in software development—from IDEs to high-level languages—this has generated some discussion on the future employment prospects in our field.