RLHF: Reinforcement Learning from Human Feedback
[LinkedIn discussion, Twitter thread]
The latest blog posts to take off on Hacker News. 789 posts.
[LinkedIn discussion, Twitter thread]
Explore resources and tools created to inspire creativity, perform deep learning, and equip your company with Voice AI best practices.
SemiAnalysis published something of a bombshell leaked document this morning: Google “We Have No Moat, And Neither Does OpenAI”. The source of the document is vague: The text below is …
It’s been a long time since I’ve worked in the field of ML (or what some call AI), and we’ve come a long way from simple text classification to what’s being casually called generative AI today. While the technology has made many advances, the foundational concepts of machine learning have remained analogous over time…
GitLab AI-powered security feature to leverage Google Cloud's foundation models to empower customers to identify and remediate vulnerabilities more efficiently while maintaining privacy standards...
Large Language Models have been in the limelight since the release of ChatGPT, with new models being announced seemingly every week. This guide walks through the essential ideas of how these models came to be.
Writing at the end of the world, from Hveragerði, Iceland
Do Androids dream of electric sheep?
Update 2025: The post below describes ChatGPT and similar LLMs as they functioned at the time of writing in 2023. More recent systems do have a behind-the-scenes “inner monologue” which enables them t
What will GPT unlock for the nerdy kid sitting in a 7th-grade classroom today?
Isn't there somebody you forgot to ask?
Unfortunately for the countless hapless people I've talked to in the past few months, this was inexorable. Ever since ChatGPT exploded in popularity, my inner designer has been bursting at the seams.
The current paradigm will not lead to an overnight superintelligence explosion.
A new study published in JAMA Internal Medicine compared written responses from physicians with those from ChatGPT to real-world health questions. A panel of licensed healthcare professionals preferred ChatGPT’s responses 79% of the time.
DeepFloyd IF is a state-of-the-art text-to-image model released on a non-commercial, research-permissible license that allows research labs to examine and experiment with advanced text-to-image generation approaches. In line with other Stability AI models, Stability AI intends to release a DeepFloyd
Comprehensive guide to understand the Serverless GPU Inference landscape.
Hidet is a powerful deep learning compiler that simplifies the process of implementing high-performing deep learning operators on modern accelerators (e.g., NVIDIA GPUs). With the new feature of torch.compile(...) in PyTorch 2.0, integrating...
Talk to your smart home and let it talk back with our new voice assistant features.
In this guide, I will share the standard architecture for data-informed language model applications and explain forthcoming improvements in knowledge retrieval.
Research on programming tools published at CHI 2023.
Recreating the used bookstore experience via contrastive learning, t-SNE, and 100M book reviews.
How we are now leveraging embeddings and vector databases to generate prompts for ChatGPT.
This essay was originally written in December 2022 as I pondered the future of my job. I sat on it because I wasn’t sure of the optics of posting such an essay while employed by Google Brain. But then Google made my decision easier by laying me off in January. My severance check cleared, and last week, Brain and…
A little bit of magic, but mostly just practice
Debugging is difficult. Debugging across multiple languages is especially challenging, and debugging across devices often requires a team with varying skill sets and expertise to reveal the underlying…
This document will explain what neural networks are and how they work, which will help you understand how AI and machine learning work. In the scenario below you'll play the part of the neural network.