121
122
Applying BERT models to Search
How new advances in the science of language understanding will help you find more useful information in Search.
123
124
Predicting Stack Overflow Tags with Google’s Cloud AI
Check out a cool project that leverages Stack Overflow Data and Google's Cloud AI to predict what tags would work best on Stack Overflow questions.
125
How to Begin a Novel
Last year for National Novel Writing Month I trained a neural net called torch-rnn on 10,096 unique ways to begin a novel. It came up with some intriguing possibilities, my personal favorite being “I am forced to write to my neighbors about the beast.” But many of its sentences used made-up words, or had such weird…
126
Autocompletion with Deep Learning
We've put together an index of testing terms and articles, covering many of the basics of testing and definitions for common searches.
127
128
The Essential Tools of Scientific Machine Learning
Scientific machine learning is a burgeoning discipline which blends scientific computing and machine learning. Traditionally, scientific computing focuses on large-scale mechanistic models, usually differential equations, that are derived from scientific laws that simplified and explained phenomena. On the other hand…
129
GPT-2: 6-Month Follow-Up
We’re releasing the 774 million parameter GPT-2 language model after the release of our small 124M model in February, staged release of our medium 355M model in May, and subsequent research with partners and the AI community into the model’s potential for misuse and societal benefit. We’re also releasing an…
130
L2 Regularization and Batch Norm
This blog post is about an interesting detail about machine learning that I came across as a researcher at Jane Street - that of the interaction between L2 r...
131
Incremental Learning – A continuous learning approach (2018)
A few days back I read an article about how Bitcoin’s price can be sufficiently explained by Metcalfe’s law. As you read through the post, resist the temptation to click the links to learn more about Bitcoin, Metcalfe’s law etc. (Maybe you should read about Bitcoin if you have not heard of it). I have provided all the…
132
An Analysis of WeChat’s Realtime Image Filtering in Chats
In this work, we study how Tencent implements image filtering on WeChat. We found that Tencent implements realtime, automatic censorship of chat images on WeChat based on what text is in an image and based on an image’s visual similarity to those on a blacklist. Tencent facilitates this realtime filtering by…
133
Automatic categorization of text is a core tool now
Get ready for medium data
134
135
Deep Learning: Our Miraculous Year 1990-1991
Many of the basic ideas behind the Deep Learning Revolution were published three decades ago within fewer than 12 months in our "Annus Mirabilis" 1990-91
136
“The Book of Why” by Pearl and Mackenzie
Judea Pearl and Dana Mackenzie sent me a copy of their new book, “The book of why: The new science of cause and effect.”
137
Vibration-minimizing motion retargeting for robotic characters
Creating animations for robotic characters is very challenging due to the constraints imposed by their physical nature. In particular, the combination of fast motions and unavoidable structural deformations leads to mechanical oscillations that negatively affect their performances. Our goal is to automatically…
138
Machine Learning: Full-Text Search in JavaScript – Relevance Scoring (2015)
Full-text search is a powerful machine learning algorithm, especially relevant for web developers. This article teaches you the basics, from scratch.
139
140
OpenAI Trains Language Model, Mass Hysteria Ensues
[latexpage] On Thursday, OpenAI announced that they had trained a language model. They used a large training dataset and showed that the resulting model was useful for downstream tasks where training data is scarce. They
141
Forecasting in Python with Prophet
A guided walkthrough of how to use the Prophet python library to solve a common forecasting problem.
142
Google’s Cloud TPU Pods are now publicly available in beta
Cloud TPU Pods are now available in beta, helping you train models faster and at lower cost in the cloud.
143
144
Machine learning can boost the value of wind energy
Carbon-free technologies like renewable energy help combat climate change, but many of them have not reached their full potential. Consider wind power: over the past decade, wind farms have become an important source of carbon-free electricity as the cost of turbines has plummeted and adoption has surged. However, the…
145
Introduction to Bert
Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT — it has been the talk of the town for the last one year. At the end of 2018 researchers …
146
Einsum Is All You Need – Einstein Summation in Deep Learning (2018)
Tim Rocktäschel — Co-Founder and Chief Scientist of Recursive; Professor of AI at UCL. Artificial General Intelligence, Open-Endedness, and Recursive Self-Improvement.
147
148
Notes on AI Bias
Machine learning is the new centre of tech, and like all big new things there are issues. ‘AI bias’ is much-discussed right now: machine learning finds patterns but sometimes it finds the wrong one, and it can be hard to tell.
149
AI Models Predict Breast Cancer with Radiologist-Level Accuracy
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.
150
