The Call of the Open Sidewalk [The Call of the Open…2023239 points149 commentsSecurity & Privacy details
Update: NIST released a draft that modified their recommendations (Oct 2024) 1) . RSA 2048 is to be only considered “deprecated” after 2030. The draft states:
Many logos, drawings and other graphical designs have the following shape in it. What is this shape? If you thought: "Ah-ha! I'm smart and r...
Projects and Ramblings
In this post I derive the physics of pumping a swing and the physics of jumping from a swing. Then, using both pieces I compute the optimal strategy of jumping from a swing to maximize the traveled distance. I propose this game as a new Olympic sport.
a personal blog
Just days after we celebrated my wife’s 40th birthday, she came down with COVID, meaning she’s been isolating and I’ve been spending almost all my time dealing with our kids. But …
A recent paper The Reversal Curse points out an apparent failure in large large language models like GPT-4. From the abstract: We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is
Ready, set , begin… (you don’t know how hard I tried to resist to making that pun). We begin our inquiry with the theory of sets. Set theory and category theory share many similarities. We can view category theory as a generalization of set theory. That is, it’s meant to describe the same thing as set theory…
The following is based upon systems of equations found in "Symmetry in Chaos, A Search for Pattern in Mathematics, Art, and Nature" (the second edition) by Michael Field and Martin Golubitsky. They ask the question whether there are aperiodic chaotic attractors that generate symmetric patterns? Can there be order…
I have been steeping myself in probabilistic exercises recently, because it’s an area where I feel like I could benefit from building better intuition. I have found a recurring key to solving many of them: conditioning on an intermediary state, and then computing the value of that intermediary state separately. This…
Erik van Zwet, Sander Greenland, Guido Imbens, Simon Schwab, Steve Goodman, and I write :
Apparently Randall Munroe gets a lot of messages saying that the “random” button on xkcd is biased.
Artificial intelligence, like machine learning before it, is making big money off what I call the “sell ∀ ∃ as ∃ ∀ scam.” The scam works as follows. Build a sy…
In 2011 I gave a 15-minute talk to a lay audience in London. The topic I had chosen was ergodicity breaking, and the challenge was clear: how do you get this across? I invented a coin-toss gamble, which has since become a go-to illustration of ergodicity break
The single most undervalued fact of linear algebra: matrices are graphs, and graphs are matrices
tl;dr: part 1 explains what an explanation algorithm is, and part 2 describes an open source SQL data differ.
Neel Nanda reverse engineers neural networks that have "grokked" modular addition, showing that they operate using Discrete Fourier Transforms and tr…
From the highly eclectic blog of Mark Dominus
Update (April 14): On the suggestion of my TA Justin Yirka, I gave GPT-4 problem 2 from the final exam, along with its own answers and my and Justin’s grading comments, and asked it whether i…
A different view on two's complement math.
Suppose that we sample a large number N N N of independent random functions f i : R → R f_i \colon \R \to \R f i : R → R from a certain distribution F \Fc F and propose to solve a regression problem by choosing a linear combination f ˉ = ∑ i λ i f i . \bar{f} = \sum_i \lambda_i f_i. f ˉ = i ∑ λ i f i . For…
The definitons of the transform (to expansion coefficients) and the inverse transform are given below:
In 1969, Marvin Minsky and Seymour Papert published Perceptrons: An Introduction to Computational Geometry. In it, they showed that a single-layer perceptron cannot compute the XOR function. The main argument relies on linear separability: Perceptrons are linear classifiers, which essentially means drawing a line to…
