As is probably apparent from the sequence of blog posts about the topic in the last year, I have been thinking about and working on integer optimizations in the JIT compiler a lot. This work was mainl
Three experimental generative AI features are coming to Chrome on Macs and Windows PCs to make browsing easier and more personalized.
Meta is currently operating many data centers with GPU training clusters across the world. Our data centers are the backbone of our operations, meticulously designed to support the scaling demands …
Release of “Fugaku-LLM” – a large language model trained on the supercomputer “Fugaku”
Posted by Long Zhao, Senior Research Scientist, and Ting Liu, Senior Staff Software Engineer, Google Research An astounding number of videos are av...
This is a set of notes on the Quinn Emanuel report on Cruise's handling of the 2023-10-02 accident where a Cruise autonomous vehicle (AV) hit a pedestrian, stopped, and then started moving again with the pedestrian stuck under the bottom of the AV, dragging the pedestrian 20 feet. After seeing some comments about this…
A few months ago, we ran a benchmark on a traditional parser and Mistral 7B (Open Source LLM). The quality of the parsed result from Mistral 7B is quite impressive given it is only 7B parameters. One thing we weren't satisfied with is the processing time. Recently, I stumbled
Posted on Monday 23 Dec 2024. 1,634 words, 1 link. By Matt Webb.
This post gives a beginner’s introduction to Chapel’s GPU programming features
Last summer , I participated in Google Summer of Code for the first time, working with GRAME on improving support for using the Faust audio programming language on the web .
We support journalism, partner with news organizations, and believe The New York Times lawsuit is without merit.
This post goes over the important and excellent new paper from Anthropic and Redwood Research, with Ryan Greenblatt as lead author, Alignment Faking in Large Language Models.
Generative Adversarial Networks (GANs), discovered by Ian Goodfellow in 2014, were an early method in the area of generative AI. I will focus on image generation as set out in the paper Generative Adversarial Nets 1 . This paper is the focal point of the post, I will guide you through the implementation of the paper…
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction Since the surge in interest sparked by Mixtral, research on mixture-of-expert (MoE) models has gained significant momentum. Both researchers and practitioners are keenly interested in understanding how to effectively train such models and assessing their…
Meta's release of Llama 3.2 marks a turning point where open-source AI models match and even surpass proprietary models.
An intuitive explanation of the James-Stein estimator.
HN discussion
Posted by Christian Plagemann, Director, and Katya Cox, Product Manager, Google Research Learning a language can open up new opportunities in a per...
[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes from human annotation, such as classification task or RLHF…
I offer "no economic boost," you receive "P(doom)"
None of what I write in this newsletter is about sowing doubt or "hating," but a sober evaluation of where we are today and where we may end up on the current path. I believe that the artificial intelligence boom — which would be better described as a generative AI boom
At Google IO 2024, Google announced Ollama support in Firebase Genkit, a new open-source framework for developers to build, deploy and monitor production-ready AI-powered apps.
Want to use open-source LLM models from Hugging Face on your local development environment? With localllm and Cloud Workstations, you can.
TL;DR – We are excited to announce voyage-3 and voyage-3-lite embedding models, advancing the frontier of retrieval quality, latency, and cost. voyage-3 outperforms OpenAI v3 large by 7.55% on aver…
How do we prepare them for what we're not prepared for?
