Deep learning, which is the reemergence of artificial neural networks, has recently succeeded as an approach towards artificial intelligence. In many fields, including computational linguistics, deep learning approaches have largely displaced earlier machine learning approaches, due to the superior performance they…
A machine learning craftsmanship blog.
Solving systems of linear equations is a staple food of linear algebra. It can be applied as a part of many machine learning tasks, although it is not always...
TLA, the Temporal Logic of Actions is the core of TLA+. It is a temporal logic that minimizes the use of temporal reasoning in favor of more ordinary mathematics. It is a general mathematical framework for describing and reasoning about algorithms and systems.
The Dow Jones Industrial Average (or 'the Dow', ^DJI, DJIA), is a stock market index created back in 1896 by Charles Dow, a journalist. The goal of the index is provide a view of the stock market's health. The Dow is an index of just 30 (arbitrarily chosen) stocks, weighted by the stock prices of its component…
Divide and conquer has been a core strategy in software engineering. We decompose our systems into smaller modules with focused, simple…
Just announced $latex {\dots}&fg=000000$ Oded Goldreich is one of the top researchers in cryptography, randomness, and complexity theory. Today Ken and I wish to thank the Knuth Prize Committee…
Douglas G. Steigerwald joined the faculty of the Department of Economics at the University of California, Santa Barbara after completing an M.A. in Statistics and a Ph.D. in Economics at the University of California, Berkeley. His research and teaching focus on frontier econometric methods at the intersection of…
The abacus counting device dates back thousands of years but has, in the past century, been replaced by calculators and computers. But studies show that abacus
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
For today’s post, I’ve drawn material not just from one paper, but from five! The subject matter is ‘word2vec’ – the work of Mikolov et al. at Google on efficient vect…
by Erin Baldinger, University of Minnesota; Shawn Broderick, Keene State College; Eileen Murray, Montclair State University; Nick Wasserman, Columbia University; and Diana White, Contributing Editor , University of Colorado Denver.
Why graphical representation and visualization are so important to...
Edit 12/19/2017: added a new subsection on analyzing Chutes & Ladders as an Absorbing Markov Chain.
The following tweet has been making the rounds on social media: Notice that since the Democrats won overall, it would be impossible for Republicans to win all seven districts, no matter how the map…
Out there in the wider world—OK, OK, among Luboš Motl, and a few others who comment on this blog—there appears to be a widespread opinion that P≠NP is just “a fashionable dogma of…
In this post I describe the Asynchronous Computability Theorem, which uses tools from Algebraic Topology to show whether a task is solvable…
This document is a work-in-progress. Please contact the author if you see errors or omissions. Most of the secure hash functions ever designed have turned out to be vulnerable to collision attacks.
Printer Friendly: The whole text in one file , all 164,000 words, convenient for printing. (The printed length will vary, depending to your browser settings. For me it’s 401 pages.)
Heap's algorithm for constructing all permutations is efficient and simple but not easy to understand. This article explains Heap's algorithm by example.
The recommended scrypt parameters in the Go docs were recently brought up for discussion given they haven’t changed since 2009.
TLA+ is a formal specification and verification language intended to help engineers specify, design and reason about complex, real-life algorithms and software or hardware systems. We explore its motivation, application and principles of design.
Roger Highfield explores the beauty of mathematics at a recent event at the Science Museum
