New
The latest blog posts to take off on Hacker News. 3,092 posts.
VSCode on Google Colab
Learn how to setup and use VSCode as an IDE on Google Colab and Kaggle.
Gradient Boosted Decision Trees
From zero to gradient boosted decision trees
Nvidia announces Jetson Nano 2GB, a single board computer
Using Python 3.6, OpenCV, Dlib and the face_recognition module
Why neural networks struggle with the Game of Life
The Game of Life is based on very simple rules, but artificial neural networks struggle to learn its rules through the classic deep learning training process.
Nvidia’s Integration Dreams
Nvidia’s acquisition of ARM only makes sense from a financial perspective, unless you buy Jensen Huang’s datacenter dreams.
Differentiable Dithering
Problem Let's say we want to reduce the number of colors in an image. For example consider the picture of fruit below:
Why Bayesian Stats Needs Monte-Carlo Methods
Bayesian statistics rely heavily on Monte-Carlo methods. A common question that arises is “isn’t there an easier, analytical solution?” This post explores a bit more why this is by breaking down the analysis of a Bayesian A/B test and showing how tricky the analytical path is and exploring more of t
Understanding Convolution in Deep Learning (2015)
Convolution is probably the most important concept in deep learning right now. It was convolution and convolutional nets that catapulted deep learning to the forefront of almost any machine learning task there is. But what makes convolution so powerful? How does it work? In this blog post I will explain convolution…
Which GPUs to get for deep learning
Here, I provide an in-depth analysis of GPUs for deep learning/machine learning and explain what is the best GPU for your use-case and budget.
Score matching with Langevin Sampling: a new contender to GANs
Last year, Yang Song, a graduate student at Stanford, showed an entirely new way of generating data based on denoising score matching with Annealed Langevin sampling (DSM-ALS). The paper showed tha…
A round-up of topology-based papers at ICML 2020
With this year’s International Conference on Machine Learning (ICML) being over, it is time to have another instalment of this series. Similar to last year’s post , I shall cover several papers that caught my attention because of their use of topological concepts—however, unlike last year, I shall not restrict the…
Sci-fi story coauthored by GPT-3, including in-character human/AI chats
Short stories about the singularity written in collaboration with GPT-3.
Open Problems in Robotics
Robotics is one of those things the business funny papers regularly wonder about; it seems like consumer robotics is a revolutionary trillion dollar market which is perpetually 20-years away -more…
Recent Advances in Natural Language Processing
Deponysum membahas konsep filsafat, kecerdasan buatan, ekonomi, dan kritik sastra secara edukatif untuk memperluas wawasan dan cara berpikir kritis.
Using machine learning to recreate photorealistic portraits of Roman Emperors
Artistic interpretations of the 54 Roman emperors of the Principate, created with AI and historical references.
Formulog: ML + Datalog + SMT
If you read a description of a static analysis in a paper, what might you find? There’ll be some cute model of a language. Maybe some inference rules describing the analysis itself, but those rules probably rely on a variety of helper functions. These days, the analysis likely involves some logical reasoning: about…
Are Humans Intelligent? An AI Op-Ed
After seeing so many people debate whether computers can be intelligent I thought it only fair to ask an AI. As with previous posts, I picked the best responses, but everything after the bolded pro…
Do NLP Beyond English
7000+ languages are spoken around the world but NLP research has mostly focused on English. This post outlines why you should work on languages other than English.
Starting a Business Around GPT-3 Is a Bad Idea
(Update 2023-03: I wrote this in 2020 when GPT-3 was highly hyped, but ultimately made only <1% of the splash that the monstrous ChatGPT made 3 years later. If I had to rewrite this today, I’d 1) think more kindly about defensibility, especially through deep product, user experience, and marketing/distribution (see…
Teaching GPT-3 to Identify Nonsense
In Giving GPT-3 a Turing Test, Kevin Lacker found that GPT-3 does well answering simple factual questions like “Who was president of the United States in 1955?”, but also happily answered absurd qu…
How GPT3 Works – Visualizations and Animations
Discussions: Hacker News (397 points, 97 comments), Reddit r/MachineLearning (247 points, 27 comments) Translations: German, Korean, Chinese (Simplified), Russian, Turkish The tech world is abuzz with GPT3 hype. Massive language models (like GPT3) are starting to surprise us with their abilities. While not yet…
What is GPT-3? written in layman's terms
Daily, snackable writings to spur changes in thinking. Building a blueprint for a better brain by tinkering with the code.
I asked GPT-3 to make a presentation for me
Here's what it came up with, read by yours truly.
Why GPT-3 Matters
The sheer scale of the new GPT-3 model is hard to overstate; it’s an entire order of magnitude larger than Microsoft’s already-massive 17B parameter Turing-NLG.[1] Loading the entire model’s weights
Tempering Expectations for GPT-3 and OpenAI’s API
GPT-3 is indeed a large step forward for AI text-generation, but there are very many caveats with the popular demos and use cases.
Giving GPT-3 a Turing Test
I’ve been playing around with OpenAI’s new GPT-3 language model. When I got beta access, the first thing I wondered was, how human is GPT-3? How close is it ...