1
New
The latest blog posts to take off on Hacker News. 109 posts.
2
3
Play AI Dungeon 2. Become a Dragon. Eat the Moon
I wrote earlier about a neural net-powered dungeon crawling text adventure game called GPT-2-Adventure in which gameplay is incoherent and dreamlike, as you encounter slippery sign text, circular passages, and unexpected lozenge rooms. A PhD student named Nathan trained the neural net on classic dungeon crawling…
4
Information Theory with TensorFlow
Redirecting to https://www.mukeshmithrakumar.com/blog/deep-learning-with-tf2-probability-and-information-theory/ .
5
Using machine learning to choose compression algorithms
30% less disk required compared to using the single best strategy
6
7
8
Introduction to Bert
Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT — it has been the talk of the town for the last one year. At the end of 2018 researchers …
9
Taking ML to production with Rust
Hands-on technical leader, Rust expert.
10
11
How to Begin a Novel
Last year for National Novel Writing Month I trained a neural net called torch-rnn on 10,096 unique ways to begin a novel. It came up with some intriguing possibilities, my personal favorite being “I am forced to write to my neighbors about the beast.” But many of its sentences used made-up words, or had such weird…
12
AI Update, Late 2019
It's been 7 months since my last commentary on the field, and as it became regular appearance in this blog (and in fact many people apparently enjoy this form and keep asking for it),
13
14
15
Deep Learning in the Real World: Dealing with Non-Differentiable Loss Functions
Over the past few years, deep learning has been taking by storm many industries. From voice recognition to image analysis and synthesis, neural networks have turned out to be very efficient at solv…
16
17
ML from Scratch, Part 2: Logistic Regression (2018)
In this second installment of the machine learning from scratch we switch the point of view from regression to classification: instead of estimating a number, we will be trying to guess which of 2 possible classes a given input belongs to. A modern example is looking at a photo and deciding if its a cat or a dog.
18
Quantum supremacy: the gloves are off
Links:Google paper in NatureNew York Times articleIBM paper and blog post responding to Google’s announcementBoaz Barak’s new post: “Boaz’s inferior classical inferiority FA…
19
Weaponizing and Gamifying AI for WiFi Hacking: Presenting Pwnagotchi 1.0.0
This is the story of a summer project that started out of boredom and that evolved into something incredibly fun and unique. It is also the story of how that p…
20
ML From Scratch, Part 1: Linear Regression
To kick off this series, will start with something simple yet foundational: linear regression via ordinary least squares. While not particularly exciting, linear regression finds widespread use both as a standalone learning algorithm and as a building block in more advanced learning algorithms.
21
Google and Ambient Computing
Google presented a vision of ambient computing that goes beyond the smartphone. The company is well-placed, but faces challenges both in the marketplace and in the mirror.
22
23
A dumb reason computer vision apps aren’t working: Exif Orientation
I’ve written about lots of computer vision and machine learning projects like object recognition systems and face recognition projects. I…
24
Successful machine learning models: lessons learned at Booking.com
150 successful machine learning models: 6 lessons learned at Booking.com Bernadi et al., KDD’19 Here’s a paper that will reward careful study for many organisations. We’ve previously looked a…
25
New chips for machine intelligence
This note summarises details of some of the new silicon chips for machine intelligence. Its aim is to distil the most important implementation and architectural details (at least those that are currently available), to highlight the main differences between them. I’m focusing on chips designed for training since they…
26
Quantum computers: amazing progress, but probably false supremacy claims
A 2017 cartoon from this post. After the embargo update (Oct 25): Now that I have some answers from the people involved let me make a quick update: 1) I still find the paper unconvincing, specific…
27
Deep Learning: Our Miraculous Year 1990-1991
Many of the basic ideas behind the Deep Learning Revolution were published three decades ago within fewer than 12 months in our "Annus Mirabilis" 1990-91
28
Principal Component Analysis
In the previous article in this series we distinguished between two kinds of unsupervised learning (cluster analysis and dimensionality reduction) and discussed the former in some detail. In this installment we turn our attention to the later. In dimensionality reduction we seek a function $f : \mathbb{R}^n \mapsto…
29
A Gentle Introduction to Bayes’ Theorem for Machine Learning
Bayes Theorem provides a principled way for calculating a conditional probability. It is a deceptively simple calculation, although it can be used to easily calculate the conditional probability of events where intuition often fails. Although it is a powerful tool in the field of probability, Bayes Theorem is also…
30
Scott’s Supreme Quantum Supremacy FAQ
You’ve seen the stories—in the Financial Times, Technology Review, CNET, Facebook, Reddit, Twitter, or elsewhere—saying that a group at Google has now achieved quantum computation…