New
The latest blog posts to take off on Hacker News. 6,335 posts.
AIs Named by AIs
Neural networks can be good at naming things, I’ve discovered. Recently I’ve been experimenting with a neural network called GPT-2, which OpenAI trained on a huge chunk of the internet. Thanks to a colab notebook implementation by Max Woolf, I’m able to fine-tune it on specific lists of data -
Machine learning systems are stuck in a rut
Machine learning systems are stuck in a rut Barham & Isard, HotOS’19 In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmabil…
AI Models Predict Breast Cancer with Radiologist-Level Accuracy
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.
Logistic Regression from Bayes’ Theorem
In this post we’ll explore how we can derive logistic regression from Bayes’ Theorem. Starting with Bayes’ Theorem we’ll work our way to computing the log odds of our problem and the arrive at the inverse logit function. After reading this post you’ll have a much stronger intuition for how logistic
Towards Reproducible Research with PyTorch Hub
Reproducibility is an essential requirement for many fields of research including those based on machine learning techniques. However, many machine learning publications are either not reproducible or are difficult to...
Google Research Football: A Novel Reinforcement Learning Environment
Posted by Karol Kurach, Research Lead and Olivier Bachem, Research Scientist, Google Research, Zürich The goal of reinforcement learning (RL) is ...
Chip design drastically reduces energy needed to compute with light
MIT researchers have developed a “photonic” artificial intelligence (AI) accelerator that computes using light instead of electricity — and consumes relatively little power in the process — to run massive neural networks millions of times more efficiently than today’s classical computers.
Language, trees, and geometry in neural networks
Language is made of discrete structures, yet neural networks operate on continuous data: vectors in high-dimensional space. A successful language-processing network must translate this symbolic information into some kind of geometric representation—but in what form? Word embeddings provide two well-known examples…
Algorithm allows video editors to modify talking-head videos as if editing text
A new algorithm allows video editors to modify talking head videos as if they were editing text – copying, pasting, or adding and deleting words.
Using machine learning to estimate lost demand in a fulfillment chain
How Instacart uses Machine Learning to spot lost demand in its fulfillment chain
Amazon Unveils New Alexa Dialog Modeling for Natural, Cross-Skill Conversations
Get the latest news and features about smart home, Alexa Built-in, and Alexa Gadgets.
Random Forest vs. Neural Network
Choosing between Random Forest and Neural Network depends on the data type. Random Forest suits tabular data, while Neural Network excels with images, audio, and text data.
Cracking open the black box of automated machine learning
ATMSeer is an interactive visualization tool for users to see and control algorithms and hyperparameters of machine-learning (AutoML) systems. The work was developed by researchers in the MIT Laboratory for Information and Decision Systems (LIDS), Hong Kong University of Science and Technology (HKUST), and Zhejiang…
Implementing a Convolutional Neural Network Using Only NumPy
A simple walkthrough of deriving backpropagation for CNNs and implementing it from scratch in Python.
Moving Camera, Moving People: A Deep Learning Approach to Depth Prediction
Posted by Tali Dekel, Research Scientist and Forrester Cole, Software Engineer, Machine Perception The human visual system has a remarkable abili...
Implementing a Convolutional Neural Network from Scratch in Python
A simple guide to what CNNs are, how they work, and how to build one from scratch in Python.
Notes on Weight Initialization for Deep Neural Networks
Neural networks involve long sequence of multiplications, usually between a matrix and a vector, say \(a*x\). The result of this sequence of multiplications will either have a huge magnitude or be reduced to 0. We can divide \(a\) by a number ( scaling_factor ) to scale down its magnitude to the right level. Proper…
Matrices as Tensor Network Diagrams
In the previous post, I described a simple way to think about matrices, namely as bipartite graphs. Today I'd like to share a different way to picture matrices—one which is used not only in mathematics, but also in physics and machine learning. Here's the basic idea. An $m\times n$ matrix $M$ with real entries…