61
Chess-GPT's Internal World Model
A Chess-GPT Linear Emergent World Representation
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 422 posts.
62
Formal Theory of Creativity and Fun and Intrinsic Motivation Explains Science, Art, Music, Humor (Juergen Schmidhuber). Artificial Scientists, Artificial Artists, Developmental Robotics, Curiosity, Attention, Surprise, Novelty, Discovery, Open-Ended Learning, Formal Theory of Beauty, Creating Novel…
Formal Theory of Creativity & Fun & Intrinsic Motivation (1990-2010) by Jürgen Schmidhuber
63
The Metamorphosis of Prime Intellect
The Mortal Passage Trilogy: An Epic in Four Stories is now available. That link leads to Amazon, but you can find it on iTunes, Barnes & Noble, Kobo, and elsewhere too.
64
Scott’s Supreme Quantum Supremacy FAQ
You’ve seen the stories—in the Financial Times, Technology Review, CNET, Facebook, Reddit, Twitter, or elsewhere—saying that a group at Google has now achieved quantum computation…
65
"A computer can never be held accountable"
This legendary page from an internal IBM training in 1979 could not be more appropriate for our new age of AI. A computer can never be held accountable Therefore a …
66
How does GPT obtain its ability? Tracing emergent abilities of language models
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
67
GPT-3
May 2020 Gwern.net newsletter: GPT-3 scaling, implications, deep theory; anime GAN updates, and 1 book review.
68
The Gentle Singularity
We are past the event horizon; the takeoff has started. Humanity is close to building digital superintelligence, and at least so far it’s much less weird than it seems like it should be. Robots...
69
Which GPUs to get for deep learning
Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.
70
A Timeline of the OpenAI Board
Yesterday, Sam Altman and Greg Brockman were fired from the Board of Directors of OpenAI.
71
Deep Learning, NLP, and Representations
neural networks , deep learning , representations , NLP , recursive neural networks
72
Dario Amodei
How AI Could Transform the World for the Better
73
CaMeL offers a promising new direction for mitigating prompt injection attacks
In the two and a half years that we’ve been talking about prompt injection attacks I’ve seen alarmingly little progress towards a robust solution. The new paper Defeating Prompt Injections …
74
The Scaling Hypothesis
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold.
75
Hacking with AI SASTs: An overview of ‘AI Security Engineers’ / ‘LLM Security Scanners’ for Penetration Testers and Security Teams
Reviewing AI Security Engineers: How ZeroPath found 200+ bugs in curl and why AI SASTs are becoming a viable replacement for traditional tools.
76
77
Nepenthes is a tarpit to catch AI web crawlers
Making web crawlers eat shit since 2023
78
My LLM codegen workflow
A detailed walkthrough of my current workflow for using LLms to build software, from brainstorming through planning and execution.
79
Representation Engineering: Mistral-7B on Acid
Playing around with the Representation Engineering paper, I made some interesting control vectors, and a Python package to make your own.
80
The Dual LLM pattern for building AI assistants that can resist prompt injection
I really want an AI assistant: a Large Language Model powered chatbot that can answer questions and perform actions for me based on access to my private data and tools. …
81
The Neural Net Tank Urban Legend
AI folklore tells a story about a neural network trained to detect tanks which instead learned to detect time of day; investigating, this probably never happened.
82
The Scaling Hypothesis (2021)
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold.
83
Machine intelligence, part 2
This is part two of a a two-part post—the first part is here. THE NEED FOR REGULATION Although there has been a lot of discussion about the dangers of machine intelligence recently, there...
84
GPT-2 as step toward general intelligence (2019)
A machine learning researcher writes me in response to yesterday’s post, saying:I still think GPT-2 is a brute-force statistical pattern matcher which blends up the internet and gives you bac…
85
How Much OpenAI Spends on Inference and Its Revenue Share with Microsoft
EDIT: I am updating this post to reflect that these numbers are based on accrual accounting, meaning that these amounts are from the quarters I am referencing. Anyone telling you otherwise is misinformed. As with my Anthropic exclusive from a few weeks ago, though this feels like a natural premium
86
Block AI Scrapers with Anubis proof-of-work
I got tired with all the AI scrapers that were bullying my git server, so I made a tool to stop them for good.
87
Three Major Singularity Schools
( Originally appeared on the Machine Intelligence Research Institute blog, September 2007.)
88
Microgpt
Musings of a Computer Scientist.
89
A GPT in 60 Lines of NumPy
Implementing a GPT model from scratch in NumPy.
90
My AI Adoption Journey
My experience adopting any meaningful tool is that I've necessarily gone through three phases: (1) a period of inefficiency (2) a period of adequacy, then finally (3) a period of workflow and life-altering discovery.