LLMs don't do formal reasoning
Important new study from Apple
Important new study from Apple
One weird hobby of mine is reasonable properties of cryptographic schemes that nobody promised they do or don’t have. Whether that’s invisible salamanders or binding through shared secr…
Lambda Screen allows you to draw images using terms of pure lambda calculus. By using fixed-point combinators, you can even create infinitely detailed fractals.
This is a tale of two approaches to regular expression matching. One of them is in widespread use in the standard interpreters for many languages, including Perl. The other is used only in a few places, notably most implementations of awk and grep. The two approaches have wildly different performance characteristics:
Goodhart's Law is useless. It tells you about a phenomenon, but it doesn't tell you how to solve it. We look at how organisations actually prevent Goodhart's Law, and illustrate this with Amazon's Weekly Business Review as an example.
(I've been editing this post on and off for almost a year. I'm not really happy with it, but I suspect I never will be.)
Wolfram tech and its dedicated website now easily predict eclipses. A look at advances in understanding and science from ancient eclipse data thousands of years old through current eclipse calculations.
A useful theorem attributed to the probably first mathematician ever, Thales of Miletus (ca. 624 BC-ca. 546 BC) is one of most elementary and intuitive ever stated.
In many large-scale web services, multiple layers of stateless and stateful services are seperated by load balancers. Load balancing can be done with dedicated hardware, with dedicated software load balancers, using DNS trickery or through a load-balancing mechanism in the client. In large systems, the resources and…
What is Damas-Hindley-Milner?
Recently one of my colleagues was reading Alan Turing’s groundbreaking 1936 article “On Computable Numbers with an Application to the Entscheidungsproblem.” This is the article in…
I recently stumbled upon a blog post by Alejandra González (a.k.a @blyxyas) that seeks to compress a tic-tac-toe game state into as few bits as possible. She arrived at a solution in 18 bits. This got me thinking, can we do better?
This morning, I came accross Cameron Sun’s Probabilistic Tic-Tac-Toe on HN . However, the comments were disappointing, with people proposing probabilistic models, linear programming, minimax algorithms, and heuristic evaluations to develop AI approaches for the game, none of which quite correct. In this post, I’ll…
I’m a professional mathematician. That means somebody pays me to do math. I’m also a recreational mathematician. That means you might have to pay me to get me to stop. Wearing my recreational mathe…
where my words occasionally escape /dev/null
Alok Singh's Blog
Are you kidding? Edward Barbeau is now a professor emeritus of mathematics at the University of Toronto. Over the years he has been working to increase the interest in mathematics in general, and e…
Random numbers can be useful in graphics and game development, but they have a pesky and sometimes undesirable habit of clumping together. This is a problem in path tracing and monte carlo integrat…
About a weird, lovely short story
Research in Software Engineering from Rahul Gopinath
Drawing with the Fourier Series
A possibly new algorithm for LLM Inference. Adjust smoothly - and in real time - how many calculations you'd like to do during inference.
We build complex mathematical formulas bottom-up using pure lambda calculus. Includes instructions of how to translate Taylor series and other approximations to lambda terms.
For mathematical insight, according to the structuralist imperative, investigate mathematical structure and consider mathematical concepts only as invariant under isomorphism.
There are lots of interesting little subproblems in compilation like instruction selection, register allocation and instruction scheduling. These can be expressed in declarative interlinked way to constraint solvers.
The way that most physicists teach and talk about partial differential equations is horrible, and has surprisingly big costs for the typical understanding of the foundations of the field even among professionals. The chief victims are students of thermodynamics and analytical mechanics, and I've me
Authors: Yanbo Zhang, Benedikt Hartl, Hananel Hazan, Michael Levin
The underpinning of information theory is Shannon’s formula for the entropy H of a discrete probability distribution P. Derived in 1948 in the paper “A mathematical theory of communication”, this is given by \[ H[P] = -\sum_{i=1}^N p_i \log p_i \] where \( p_i = p(x_i) \) is the probability of sampling \( x_i \) from…