Top posts
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 262 posts.
Applying BERT models to Search
How new advances in the science of language understanding will help you find more useful information in Search.
Predicting Stack Overflow Tags with Google’s Cloud AI
Check out a cool project that leverages Stack Overflow Data and Google's Cloud AI to predict what tags would work best on Stack Overflow questions.
How to Begin a Novel
Last year for National Novel Writing Month I trained a neural net called torch-rnn on 10,096 unique ways to begin a novel. It came up with some intriguing possibilities, my personal favorite being “I am forced to write to my neighbors about the beast.” But many of its sentences used made-up words, or had such weird…
Autocompletion with Deep Learning
We've put together an index of testing terms and articles, covering many of the basics of testing and definitions for common searches.
The Essential Tools of Scientific Machine Learning
Scientific machine learning is a burgeoning discipline which blends scientific computing and machine learning. Traditionally, scientific computing focuses on large-scale mechanistic models, usually differential equations, that are derived from scientific laws that simplified and explained phenomena. On the other hand…
GPT-2: 6-Month Follow-Up
We’re releasing the 774 million parameter GPT-2 language model after the release of our small 124M model in February, staged release of our medium 355M model in May, and subsequent research with partners and the AI community into the model’s potential for misuse and societal benefit. We’re also releasing an…
L2 Regularization and Batch Norm
This blog post is about an interesting detail about machine learning that I came across as a researcher at Jane Street - that of the interaction between L2 r...
Incremental Learning – A continuous learning approach (2018)
A few days back I read an article about how Bitcoin’s price can be sufficiently explained by Metcalfe’s law. As you read through the post, resist the temptation to click the links to learn more about Bitcoin, Metcalfe’s law etc. (Maybe you should read about Bitcoin if you have not heard of it). I have provided all the…
An Analysis of WeChat’s Realtime Image Filtering in Chats
In this work, we study how Tencent implements image filtering on WeChat. We found that Tencent implements realtime, automatic censorship of chat images on WeChat based on what text is in an image and based on an image’s visual similarity to those on a blacklist. Tencent facilitates this realtime filtering by…
Automatic categorization of text is a core tool now
Get ready for medium data
Deep Learning: Our Miraculous Year 1990-1991
Many of the basic ideas behind the Deep Learning Revolution were published three decades ago within fewer than 12 months in our "Annus Mirabilis" 1990-91
“The Book of Why” by Pearl and Mackenzie
Judea Pearl and Dana Mackenzie sent me a copy of their new book, “The book of why: The new science of cause and effect.”
Vibration-minimizing motion retargeting for robotic characters
Creating animations for robotic characters is very challenging due to the constraints imposed by their physical nature. In particular, the combination of fast motions and unavoidable structural deformations leads to mechanical oscillations that negatively affect their performances. Our goal is to automatically…
Machine Learning: Full-Text Search in JavaScript – Relevance Scoring (2015)
Full-text search is a powerful machine learning algorithm, especially relevant for web developers. This article teaches you the basics, from scratch.
OpenAI Trains Language Model, Mass Hysteria Ensues
[latexpage] On Thursday, OpenAI announced that they had trained a language model. They used a large training dataset and showed that the resulting model was useful for downstream tasks where training data is scarce. They
Forecasting in Python with Prophet
A guided walkthrough of how to use the Prophet python library to solve a common forecasting problem.
Google’s Cloud TPU Pods are now publicly available in beta
Cloud TPU Pods are now available in beta, helping you train models faster and at lower cost in the cloud.
Machine learning can boost the value of wind energy
Carbon-free technologies like renewable energy help combat climate change, but many of them have not reached their full potential. Consider wind power: over the past decade, wind farms have become an important source of carbon-free electricity as the cost of turbines has plummeted and adoption has surged. However, the…
Introduction to Bert
Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT — it has been the talk of the town for the last one year. At the end of 2018 researchers …
Einsum Is All You Need – Einstein Summation in Deep Learning (2018)
Tim Rocktäschel — Co-Founder and Chief Scientist of Recursive; Professor of AI at UCL. Artificial General Intelligence, Open-Endedness, and Recursive Self-Improvement.
Notes on AI Bias
Machine learning is the new centre of tech, and like all big new things there are issues. ‘AI bias’ is much-discussed right now: machine learning finds patterns but sometimes it finds the wrong one, and it can be hard to tell.
AI Models Predict Breast Cancer with Radiologist-Level Accuracy
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.