2971
AI changes the economics of software rewrites
AI changes rewrite economics because codebases with clear, common patterns get more leverage than proprietary or inconsistent systems.
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,092 posts.
2972
2973
Bootstrapping self awareness in GPT-4: Towards recursive self inquiry
Or, Look Ma – I Made GPT-4 Self Aware!
2974
2975
OpenAI Begins Tackling ChatGPT Data Leak Vulnerability
OpenAI seems to have implemented some mitigation steps for a well-known data exfiltration vulnerability in ChatGPT. Attackers can use image markdown rendering …
2976
What Happens If OpenAI Dies?
If you liked this piece, you should subscribe to my premium newsletter. It's $70 a year, $18 a quarter, or $7 a month, and in return you get a weekly newsletter that’s usually anywhere from 10,000 to 18,000 words, including vast, detailed analyses of NVIDIA, Anthropic
2977
Understanding Stein's Paradox (2021)
An intuitive explanation of the James-Stein estimator.
2978
2979
A commit history of BERT and its forks
What a commit history of version-controlled research papers could look like?
2980
Building a ChatGPT-enhanced Python REPL
In this blog I share my experience in building a Python REPL augmented with ChatGPT. I explore how the application is built, and speculate on software engineering patterns and paradigms that might emerge in systems built on Large Language Models (LLMs). GEPL - Generate, Evaluate, Print, Loop Link to this section…
2981
Attacks on machine learning models
HN discussion
2982
IA or AI?
I’ve been reading a paper [1] written two decades ago, which itself is an account of events two decades before that. It is Alan Kay nominally writing about the history of a programming langua…
2983
Combine GPTs with private knowledge for actually useful AIs
Custom GPTs by OpenAI are practically free new hires. But as as new hires go, most are not very useful.
2984
Reinforcement Learning at Facebook
If you ever wanted to learn about machine learning you could do worse than have Jason Gauci teach you. Jason has worked on YouTube recommendations. He was an early contributor to TensorFlow the open-source machine learning platform. His thesis work was cited by DeepMind. But what I find so fascinating with Jason is he…
2985
2986
2987
Building agents using streaming SQL queries
Table of Contents Agents Need to Interact With LLMs Agents Should Be Event-Driven Agents Need Context Agents Require Memory When SQL Is Not Enough Parting Thoughts AI Agents have improved in leaps …
2988
Machine Learning in Rust
This post is aimed at readers who are familiar with Rust and want some insight into why it is great for machine learning.
2989
The State of Generative Models
In the face of disruptive technologies, moats created by closed source are temporary. Even OpenAI’s closed source approach can’t prevent others from catching up. So we anchor our value in our team — our colleagues grow through this process, accumulate know-how, and form an organization and culture capable of…
2990
Thinking about high-quality human data
[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes from human annotation, such as classification task or RLHF…
2991
We're not Platonists, we've just learned the bitter lesson
Machine Alignment Monday, 7/24/23
2992
After AI takes everything
Prompted by letters from three engineers, the author asks what remains for humans as AI takes over execution, naming judgment, taste, and derivation as irreplaceable, and warns against the erosion of subjecthood.
2993
All the existential risk, none of the economic impact
I offer "no economic boost," you receive "P(doom)"
2994
How New Are Yann LeCun's “New” Ideas?
spoiler alert: not very
2995
AI is going to hack Jira
Hide your kids, hide your wife: how the Agile Industrial Complex has set us all up to be duped by AI codegen
2996
Google Calculating Which Employees Are About to Quit
[Google] recently began crunching data from employee reviews and promotion and pay histories in a mathematical formula Google says can identify which of its 20,000 employees are most likely to quit.
2997
The Subprime AI Crisis
None of what I write in this newsletter is about sowing doubt or "hating," but a sober evaluation of where we are today and where we may end up on the current path. I believe that the artificial intelligence boom — which would be better described as a generative AI boom
2998
Nvidia DGX Spark as a daily driver
I bought an NVIDIA DGX Spark! It's actually quite a competent general purpose computer while being super tiny and power efficient. It basically just has an ARM CPU, a decent NVIDIA GPU (with the same number of CUDA cores as the RTX 5070), 128 GB of unified memory, and a 4 TB SSD.
2999
3000
A Multi-Level View of LLM Intentionality
Prompted by Keith Frankish's recent streamed discussion of LLM intentionality on YouTube , there's a particular idea I wanted to share which...