Training Deep Networks with Data Parallelism in Jax
Misha Laskin personal website. Includes a blog and projects focused on artifical intelligence.
Misha Laskin personal website. Includes a blog and projects focused on artifical intelligence.
I came across a random tweet, found a Wikipedia page and bumped into some smart people and long story short, apparently compression is equivalent to general intelligence.
How to give GPT access to large amounts of data
Welcome to the new world.
OpenAI’s developer keynote was exciting, both because AI was exciting, and because OpenAI has the potential to be a meaningful consumer tech company.
The entire team has joined OpenAI.
Introducing our machine learning model for generating CAD models from a text prompt.
UPDATE 10/23: The update to the Paint app for Windows 11 that includes Paint Cocreator is now rolling out to Windows Insiders in the Release Preview Channel (version 11.2309.20.0 or higher
Embeddings, why they’re useful, and how we can store and use them in Convex.
An operational guide on finetuning Llama 2, ready for commercial use.
Introducing MPT-7B, the first entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention…
Scaling GAIA-1: a 9-billion parameter generative world model for autonomous driving
It took me a few minutes to create a fake me giving a fake lecture.
In this update, we are excited to welcome the following models joining the Chatbot Arena:
Recently, LLM-based agents have been all the rage – with projects like AutoGPT showing how easy it is to wrap an LLM in a simple agentic loop and prompt it to achieve real-world tasks. More generally, we can think about the class of ‘scaffolded’ 1 LLM systems – which wrap...
How large language models process multilingual data differently
Researchers mined an old drug forum and fed the entries to an AI. The result could augur a new class of psychedelic-based antidepressants.
The University of Turku and one of Europe’s largest private AI labs Silo AI, with its large language model (LLM) arm SiloGen, are today announcing a large-scale initiative on open and trustworthy L
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
To keep knowledge open and accessible to all, we must come together to build the future of AI.
We’re kicking off a public discussion across the web and AI communities to develop new machine-readable means to provide web publisher choice and control.
How the veneer of AI is used to legitimize awful ideas