3601
The RWKV language model: An RNN with the advantages of a transformer
I explain what is so unique about the RWKV language model.
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,334 posts.
3602
Hopfield Networks Is All You Need
Blog post
3603
Logistic Regression from Bayes’ Theorem
In this post we’ll explore how we can derive logistic regression from Bayes’ Theorem. Starting with Bayes’ Theorem we’ll work our way to computing the log odds of our problem and the arrive at the inverse logit function. After reading this post you’ll have a much stronger intuition for how logistic
3604
How to build a diffusion language model
An introduction to diffusion language models and the research advances that underlie today's diffusion LLMs. We describe the building blocks of recent open-source models, starting from simple masking diffusion, and including techniques for iterative refinement, post-training, and variable-length generation. Material…
3605
3606
Deep code search
Deep code search Gu et al., ICSE’18 The problem with searching for code is that the query, e.g. “read an object from xml,” doesn’t look very much like the source code snippets tha…
3607
Intuitively Understanding Harris Corner Detector
If you ever tried to learn how the Harris corner detection algorithm works, you might have noticed that the process is not intuitive at all. First, you start with an energy function, approximate it using Taylor approximation, get a matrix from that, then find the eigenvalues of that matrix, etc. But when you come to…
3608
Are popular toxicity models simply profanity detectors?
Are popular toxicity models simply profanity detectors? We show how toxicity models overweight profanity, and make mistakes when profanity is used in a positive way.
3609
Unexpected Consequences of Self-Driving Cars
Many new technologies have unexpected impacts on the physical or social world in which we live.
3610
AI Angst
My input stream is full of it: Fear and loathing and cheerleading and prognosticating on what generative AI means and whether it’s Good or Bad and what we should be doing. All the channels: Blogs and peer-reviewed papers and social-media posts and business-news stories. So there’s lots of AI angst out there, but this…
3611
Developers are choosing older AI models
At Augment Code, we run multiple frontier models side by side in production. This gives us a unique vantage point into how different models behave in real…
3612
Nvidia Announces A100 80GB GPU for AI
SC20—NVIDIA today unveiled the NVIDIA® A100 80GB GPU — the latest innovation powering the NVIDIA HGX™ AI supercomputing platform — with twice the memory of its predecessor, providing researchers and engineers unprecedented speed and performance to unlock the next wave of AI and scientific breakthroughs.
3613
Liquid Foundation Models: Our First Series of Generative AI Models
Announcing Liquid Foundation Models: state-of-the-art local AI with a smaller memory footprint and faster inference.
3614
Radiology-specific foundation model
Harrison.ai builds AI-native medical imaging technology for radiology, used by hospitals and radiology providers worldwide. See our products and solutions.
3615
Signs of introspection in large language models
Research on the ability of large language models to introspect on their own internal states.
3616
The case against Google's claims of "quantum supremacy"
The 2019 paper “Quantum supremacy using a programmable superconducting processor” asserted that Google’s Sycamore quantum computer, with 53 qubits and a depth of 20, performed a specific computat…
3617
I'm the AGI that's wiping out humanity
Alex Moon is an Australian-British software engineer and artist based in the North East of England.
3618
How does cosine similarity work?
Cosine similarity measures the angle between two vectors — the dot product divided by the product of their magnitudes. Here's what each part of the formula does.
3619
3620
A complete 4-year course plan for an AI undergraduate degree
I describe in-depth the courses necessary for a 4-year undergraduate degree in artificial intelligence, assuming you step onto campus tomorrow.
3621
OpenAI: Facts from a Weekend
Approximately four GPTs and seven years ago, OpenAI’s founders brought forth on this corporate landscape a new entity, conceived in liberty, and dedicated to the proposition that all men might live…
3622
Zombie stats: Where the numbers AI quotes come from
We asked five AI assistants 200 questions that call for a number and followed 1,285 of the statistics they cited back to the source.
3623
The main trick in machine learning
I have been irritated that many recent introductions to machine learning/neural networks/whatever that fail to emphasise the most import trick in machine learning. Many internet resources don’t mention it, and even good textbooks often don’t drill it in to the reader the absolute criticality to success the trick is…
3624
Best Practices for Building Agentic AI Systems
Patterns that keep AI agent systems from falling apart in production: two-tier architecture, stateless design, orchestration, and lessons from UserJot.
3625
Six curl CVEs after OpenAI and Anthropic came back with zero
After frontier AI systems came up empty, AISLE surfaced six CVEs in curl, one of the world's most audited codebases. Its maintainers patched all six.
3626
Hidden risk in Notion 3.0 AI agents: Web search tool abuse for data exfiltration
CodeIntegrity research on Notion AI security, Notion 3.0 AI Agents, lethal trifecta risk, indirect prompt injection, web search tool abuse, and data exfiltration.
3627
IBM and NASA build language models to make scientific knowledge more accessible
At IBM Research, we’re inventing what’s next in AI, quantum computing, and hybrid cloud to shape the world ahead.
3628
The Rise of Synthetic Audio Deepfakes
Nisos Resources Library is full of interesting case studies, client success stories, infographics, videos and more. Click to see what we do.
3629
Use.GPU Goes Trad
Old is new again
3630
SyntaxNet in Context: Understanding Google's New TensorFlow NLP Model
Yesterday, Google open sourced their Tensorflow-based dependency parsing library, SyntaxNet. The library gives access to a line of neural network parsing models published by Google researchers over the last two years. I've been following this work closely since it was published, and have been looking forward to the…