31
GraphCast: AI model for weather forecasting
Our state-of-the-art model delivers 10-day weather predictions at unprecedented accuracy in under one minute
32
GitHub Copilot emits GPL code
Demonstrating that GitHub Copilot trains on non-permissive licenses and cannot filter suggestions properly, while Codeium avoids legal risk.
33
Autonomous excavator constructs a six-metre-high dry-stone wall
ETH Zurich researchers taught an autonomous excavator to construct dry stone walls itself using boulders weighing several tonnes and demolition debris.
34
Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
Cerebras open sources seven GPT-3 models from 111 million to 13 billion parameters. Trained using the Chinchilla formula, these models set new benchmarks for accuracy and compute efficiency.
35
Don't build AI products the way everyone else is doing it
More and more, people are building products as thin wrappers over other models, especially LLMs. This can cause major issues, and there is a better way.
36
Jina AI launches open-source 8k text embedding
Jina AI introduces jina-embeddings-v2, the world's first open-source model boasting an 8K context length. Matching the prowess of OpenAI's proprietary models, this innovation is now publicly accessible on Huggingface, signaling a significant milestone in the landscape of text embeddings.
37
TypeChat
July 20, 2023 by Anders Hejlsberg, Steve Lucco, Daniel Rosenwasser, Pierce Boggan, Umesh Madan, Mike Hopcroft, and Gayathri Chandrasekaran
38
GPTs: Custom versions of ChatGPT
You can now create custom versions of ChatGPT that combine instructions, extra knowledge, and any combination of skills.
39
Amazon will invest up to $4B in Anthropic
Amazon will invest up to $4 billion in Anthropic and become its primary cloud provider, with models trained on AWS Trainium and Inferentia.
40
Nvidia DGX GH200: 100 Terabyte GPU Memory System
At COMPUTEX 2023, NVIDIA announced NVIDIA DGX GH200, which marks another breakthrough in GPU-accelerated computing to power the most demanding giant AI workloads.
41
Microsoft will assume liability for legal copyright risks of Copilot
With customers ask whether they can use Microsoft’s Copilot services without worrying about copyright claims, we are providing a straightforward answer: yes, you can, and if you are challenged on copyright grounds, we will assume responsibility for the potential legal risks involved.
42
Claude 2.1
Claude 2.1 brings a 200K token context window, a 2x reduction in hallucination rates, beta tool use, and system prompts.
43
AI Canon
A curated list of resources we’ve relied on to get smarter about modern AI, including generative AI, LLMs, and transformer models.
44
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
45
How to Finetune GPT-Like Large Language Models on a Custom Dataset
From the PyTorch Lightning creators. Own your AI, don't rent it. Lightning is the AI cloud to build, train, and deploy your own models on 36,000+ NVIDIA GPUs.
46
Hello Dolly: Democratizing the magic of ChatGPT with open models
Introducing 'Hello Dolly,' a project to democratize AI by integrating ChatGPT and open models, making advanced AI accessible to everyone.
47
Mistral: Our first AI endpoints are available in early access
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
48
G-3PO: A protocol droid for Ghidra, or GPT-3 for reverse-engineering
(A Script that Solicits GPT-3 for Comments on Decompiled Code)
49
50
51
PyTorch 2.0
We are excited to announce the release of PyTorch® 2.0 which we highlighted during the PyTorch Conference on 12/2/22! PyTorch 2.0 offers the same eager-mode development and user experience, while fundamentally changing and supercharging...
52
OpenAI and Microsoft extend partnership
We’re happy to announce that OpenAI and Microsoft are extending our partnership.
53
Do Machine Learning Models Memorize or Generalize?
An interactive introduction to grokking and mechanistic interpretability.
54
Don't believe ChatGPT – we do not offer a "phone lookup" service
TL;DR ChatGPT claims we offer an API to turn a mobile phone number into the location of the phone. We do not.
55
Teaching with AI
We’re releasing a guide for teachers using ChatGPT in their classroom—including suggested prompts, an explanation of how ChatGPT works and its limitations, the efficacy of AI detectors, and bias.
56
This Voice Doesn't Exist – Generative Voice AI
We’re deploying our own generative model which lets users design entirely new synthetic voices. Discover more about generative voice AI
57
Decomposing language models into understandable components
Interpretability research decomposing a transformer layer into thousands of interpretable features that can steer model behavior.
58
Mozilla.ai: Investing in Trustworthy AI
We’re committing $30M to build Mozilla.ai: A startup — and a community — building a trustworthy, independent, and open-source AI ecosystem. We’re o
59
60
What are transformer models and how do they work?
Explore the fundamentals of transformer models, which have revolutionized natural language processing.