4591
Why I chose OpenAI over academia
Part 2 of a blog post about my time on the computer science job market in 2021-2022, in which I discuss my personal decision-making process between offers.
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,334 posts.
4592
LLMs don't do formal reasoning
Important new study from Apple
4593
The Future of Compute: Nvidia's Crown Is Slipping
Demand consolidation, changing compute mix, custom silicon, and distributed training will hurt NVIDIA's pole position.
4594
Sprinkling self-doubt on ChatGPT
I replaced my ChatGPT personalization settings with this prompt a few weeks ago and promptly forgot about it: Be extraordinarily skeptical of your own…
4595
MIT's Ad Hoc Committee on AI Use in Teaching, Learning, and Research Training
Through five intense months of meetings, research, and outreach across the MIT community, the Ad Hoc Committee on AI Use in Teaching, Learning, and Research Training sought to understand the role of generative AI in the life and educational mission of the Institute and recommend how to navigate its challenges and…
4596
Some notes on the Stable Diffusion safety filter
How deep learning models are moderated
4597
4598
GPT-J-6B: 6B JAX-Based Transformer
Summary: We have released GPT-J-6B, 6B JAX-based (Mesh) Transformer LM (Github).GPT-J-6B performs nearly on par with 6.7B GPT-3 (or Curie) on various zero-shot down-streaming tasks.You can try out …
4599
The Bitter Lesson of LLM Extensions
From ChatGPT Plugins to Agent Skills, a look at how we've been trying (and failing) to extend LLMs for the last three years.
4600
Benchmarking OpenTelemetry: Can AI trace your failed login?
A lot of vendors pitch AI SRE. We tested 14 models across 11 programming languages; even the best ones struggle with instrumenting code with the leading open-source standard, OpenTelemetry.
4601
Chain of Thought for Humans
These past few weeks, I’ve been conducting interviews, and I often open with “make sure you articulate your thoughts out loud, so I can follow along with your thinking”. This is primarily because I…
4602
LLMs predict my coffee
Why not benchmark with physical experiments?
4603
Unlabeled Object Recognition in Google+
Google+ released an amazing feature that uses object recognition to tag photos. Here is a Reddit thread discussing it. Generalized object r...
4604
Starting from scratch: Training a 30M Topological Transformer
Tauformer is a topological transformer (see paper ) that replaces dot‑product attention with a Laplacian-derived scalar (taumode) per token/head, then attends using distances in that scalar space. Below is a post-style overview of the idea and the first training signals from a 30M-parameter run.
4605
License Plate Detection Without Machine Learning
Learn how to detect vehicles license plates without heavy Machine Learning techniques, just standard image processing routines.
4606
Differentiable Dithering
Problem Let's say we want to reduce the number of colors in an image. For example consider the picture of fruit below:
4607
LLM Observability in the Wild – Why OpenTelemetry Should Be the Standard
LLM Observability breaks in wild today as new libraries like OpenInference don't adhere to OpenTelemetry standards leading to silos and suboptimal performance for users who want to tie LLM observability with rest of their observability stack
4608
How to Escape Saddle Points Efficiently
The BAIR Blog
4609
4610
Formal Verification Gates for AI Coding Loops
Formal verification gates for AI coding loops, in the language you're already shipping.
4611
Advancing AI theory with first-principles understanding of deep neural networks
Deep neural networks have long been considered too complex to understand from first principles — but new research does just that, presenting a theoretical framework for DNNs.
4612
Speech to Birdsong Conversion
A blog about signals, programming, music, and other stuff.
4613
Deep Learning in the Real World: Dealing with Non-Differentiable Loss Functions
Over the past few years, deep learning has been taking by storm many industries. From voice recognition to image analysis and synthesis, neural networks have turned out to be very efficient at solv…
4614
4615
Using Deep Learning to model personal visual aesthetics
Visual aesthetics are very personal, often subconscious, and hard to express. In a world with an overload of photographic content, a lot of time and effort is spent manually curating photographs…
4616
Open-Sourcing Ax and BoTorch: New AI Tools for Adaptive Experimentation
We are open-sourcing BoTorch and Ax, two new tools that leverage adaptive experimentation to efficiently tackle optimization challenges in tuning software configurations, machine learning hyperparameters, ranking systems, and more.
4617
Continuing our work to improve recommendations on YouTube
That's why we update our recommendations system all the time—we want to make sure we’re suggesting videos that people actually want to watch.
4618
The Agent SDK
The Agent SDK is the framework we use to build our own managed agents like Bugbot, Security Reviewer, and Rollouts. Define agents in code and deploy them with one command.
4619
OpenAI Frontier
OpenAI Frontier is an enterprise platform for building, deploying, and managing AI agents with shared context, onboarding, permissions, and governance.
4620
AI translates Hokkien, an unwritten language, for the first time
Peng-Jen Chen is well aware of how language barriers can affect people’s ability to communicate. Chen grew up in Taiwan speaking Mandarin Chinese, but his father, Sheng-Jiang Chen, a 70-year-old retired factory lead technician, hails from Southern Taiwan, where Taiwanese Hokkien is widely spoken. Though the two…