1
Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 32 posts.
2
Do Machine Learning Models Memorize or Generalize?
An interactive introduction to grokking and mechanistic interpretability.
3
Decomposing language models into understandable components
Interpretability research decomposing a transformer layer into thousands of interpretable features that can steer model behavior.
4
FunSearch: Making new discoveries in mathematical sciences using LLMs
We introduce FunSearch, a method for searching for “functions” written in computer code, and find new solutions in mathematics and computer science. FunSearch works by pairing a pre-trained LLM, whose goal is to provide creative solutions in the form of computer code, with an automated “evaluator”, which guards…
5
He made linear algebra fun
Mathematics Professor Gilbert “Gil” Strang taught his last class to thousands after teaching calculus, analysis, and linear algebra for more than 60 years at MIT and online. He reflects on his life at the Institute and as an instructor with MIT OpenCourseWare.
6
Fundamental Math for Game Developers
Let's review the most important math topics used by game devs, reflect about math education, and discuss techniques that can be used to improve the way we learn new math topics.
7
Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond
Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. Matrix multiplications (matmuls) are the building blocks of today’s ML models. This note presents mm, a visualization...
8
A Curious Integral
Note: These pages make extensive use of the latest XHTML and CSS Standards . They ought to look great in any standards-compliant modern browser. Unfortunately, they will probably look horrible in older browsers, like Netscape 4.x and IE 4.x. Moreover, many posts use MathML, which is, currently only supported in…
9
Penrose 3.0
Create beautiful diagrams just by typing math notation in plain text.
10
PageRank algorithm for graph databases
What is PageRank algorithm? How can it be used in various graph database use cases? How to use it in Memgraph? If these questions are keeping you up at night, here is a blog post that will finally put your mind at ease.
11
12
13
The Sell ∀ ∃ as ∃ ∀ Scam
Artificial intelligence, like machine learning before it, is making big money off what I call the “sell ∀ ∃ as ∃ ∀ scam.” The scam works as follows. Build a sy…
14
The infamous coin toss
In 2011 I gave a 15-minute talk to a lay audience in London. The topic I had chosen was ergodicity breaking, and the challenge was clear: how do you get this across? I invented a coin-toss gamble, which has since become a go-to illustration of ergodicity break
15
A Mechanistic Interpretability Analysis of Grokking
Neel Nanda reverse engineers neural networks that have "grokked" modular addition, showing that they operate using Discrete Fourier Transforms and tr…
16
17
Modern Image Processing Algorithms Implementation in C
Learn how modern image analysis and processing algorithms works under the hood with their C/C++ implementation on PixLab's APIs & FACEIO, facial recognition framework using the SOD Embedded Computer Vision Library.
18
Beyond automatic differentiation
Posted by Matthew Streeter, Software Engineer, Google Research Derivatives play a central role in optimization and machine learning. By locally app...
19
Basic math related to computation and memory usage for transformers
We present basic math related to computation and memory usage for transformers
20
LHC experiments see first evidence of a rare Higgs boson decay
The discovery of the Higgs boson at CERN’s Large Hadron Collider (LHC) in 2012 marked a significant milestone in particle physics. Since then, the ATLAS and CMS collaborations have been diligently investigating the properties of this unique particle and searching to establish the different ways in which it is produced…
21
C.R. Rao: A Life in Statistics (2020)
Presently into the 100th year of his life of vast experience, living in his Buffalo residence, here is a video message communicated by his daughter when he turned 99, at the beginning of a year-long celebration, with conferences in his honour at various places.
22
Improving mathematical reasoning with process supervision
We’ve trained a model to achieve a new state-of-the-art in mathematical problem solving by rewarding each correct step of reasoning (“process supervision”) instead of simply rewarding the correct final answer (“outcome supervision”). In addition to boosting performance relative to outcome supervision, process…
23
Scientists use quantum device to slow chemical process by factor of 100B
In a world-first experimental result, scientists at the University of Sydney have used a quantum computer to coax an atom to behave the same way as a photo-chemical process that underpins the speed of human vision and solar energy harvesting - only at speeds 100 billion times slower than in nature.
24
Reconciliation is a knapsack problem
Yesterday, we announced adding AI to our recon engine. Today, we're underscoring how reconciliation is a pain point by delving into the math.
25
Unexpected link between pure mathematics and genetics
An interdisciplinary team of mathematicians, engineers, physicists, and medical scientists have uncovered an unexpected link between pure mathematics and genetics.
26
27
A new quantum algorithm for classical mechanics with an exponential speedup
Posted by Robin Kothari and Rolando Somma, Research Scientists, Google Research, Quantum AI Team Quantum computers promise to solve some problems e...
28
How to create a game using hyperbolic geometry? (2020)
puzzle roguelike on a hyperbolic plane
29
Eytzinger Binary Search
This tutorial is loosely based on a 46-page paper by Paul-Virak Khuong and Pat Morin “Array layouts for comparison-based searching” and describes one particular way of performing efficient binary search by rearranging elements of a sorted array in a cache-friendly way.
30
Chemists develop new way to split water
The news portal offers current information about studies, research and life at Münster University.