New
The latest blog posts to take off on Hacker News. 6,335 posts.
Sci-fi story coauthored by GPT-3, including in-character human/AI chats
Short stories about the singularity written in collaboration with GPT-3.
Open Problems in Robotics
Robotics is one of those things the business funny papers regularly wonder about; it seems like consumer robotics is a revolutionary trillion dollar market which is perpetually 20-years away -more…
Named Tensors
Named tensors for better deep learning code.
Recent Advances in Natural Language Processing
Deponysum membahas konsep filsafat, kecerdasan buatan, ekonomi, dan kritik sastra secara edukatif untuk memperluas wawasan dan cara berpikir kritis.
Using machine learning to recreate photorealistic portraits of Roman Emperors
Artistic interpretations of the 54 Roman emperors of the Principate, created with AI and historical references.
Amazon's ML University is making its online courses available to the public
Classes previously only available to Amazon employees will now be available to the community.
Adventures in Improving AI Economics
AI has enormous potential to disrupt markets that have traditionally been out of reach for software. These markets – which have relied on humans to navigate natural language, images, and physical space – represent a huge opportunity, potentially worth trillions of dollars globally. However, as we discussed in our…
GPT-3 Explorer
A power tool for experimenting with GPT-3
Formulog: ML + Datalog + SMT
If you read a description of a static analysis in a paper, what might you find? There’ll be some cute model of a language. Maybe some inference rules describing the analysis itself, but those rules probably rely on a variety of helper functions. These days, the analysis likely involves some logical reasoning: about…
Are Humans Intelligent? An AI Op-Ed
After seeing so many people debate whether computers can be intelligent I thought it only fair to ask an AI. As with previous posts, I picked the best responses, but everything after the bolded pro…
PP-YOLO Surpasses YOLOv4 – State-of-the-art object detection techniques
Baidu publishes PP-YOLO and pushes the state of the art in object detection research by building on top of YOLOv3, the PaddlePaddle deep learning framework, and cutting edge computer vision research.
Do NLP Beyond English
7000+ languages are spoken around the world but NLP research has mostly focused on English. This post outlines why you should work on languages other than English.
Starting a Business Around GPT-3 Is a Bad Idea
(Update 2023-03: I wrote this in 2020 when GPT-3 was highly hyped, but ultimately made only <1% of the splash that the monstrous ChatGPT made 3 years later. If I had to rewrite this today, I’d 1) think more kindly about defensibility, especially through deep product, user experience, and marketing/distribution (see…
Teaching GPT-3 to Identify Nonsense
In Giving GPT-3 a Turing Test, Kevin Lacker found that GPT-3 does well answering simple factual questions like “Who was president of the United States in 1955?”, but also happily answered absurd qu…
ScaNN: Efficient Vector Similarity Search
Posted by Philip Sun, Software Engineer, Google Research Suppose one wants to search through a large dataset of literary works using queries that r...
How GPT3 Works – Visualizations and Animations
Discussions: Hacker News (397 points, 97 comments), Reddit r/MachineLearning (247 points, 27 comments) Translations: German, Korean, Chinese (Simplified), Russian, Turkish The tech world is abuzz with GPT3 hype. Massive language models (like GPT3) are starting to surprise us with their abilities. While not yet…
The Rise of Synthetic Audio Deepfakes
Nisos Resources Library is full of interesting case studies, client success stories, infographics, videos and more. Click to see what we do.
What is GPT-3? written in layman's terms
Daily, snackable writings to spur changes in thinking. Building a blueprint for a better brain by tinkering with the code.
Deep learning to translate between programming languages
TransCoder is the first self-supervised neural transcompiler system for migrating code between programming languages. It can translate code from Python to C++, for example, and it outperforms rule-based translation programs.
I asked GPT-3 to make a presentation for me
Here's what it came up with, read by yours truly.
Why GPT-3 Matters
The sheer scale of the new GPT-3 model is hard to overstate; it’s an entire order of magnitude larger than Microsoft’s already-massive 17B parameter Turing-NLG.[1] Loading the entire model’s weights
OpenAI's GPT-3 Language Model: A Technical Overview
Chuan Li, PhD reviews GPT-3, the new NLP model from OpenAI. The technical overview covers how GPT-3 was trained, GPT-2 vs. GPT-3, and GPT-3 performance.
Tempering Expectations for GPT-3 and OpenAI’s API
GPT-3 is indeed a large step forward for AI text-generation, but there are very many caveats with the popular demos and use cases.
Giving GPT-3 a Turing Test
I’ve been playing around with OpenAI’s new GPT-3 language model. When I got beta access, the first thing I wondered was, how human is GPT-3? How close is it ...
Computation Graphs and Graph Computation
Research has begun to reveal many algorithms can be expressed as matrix multiplication, suggesting an unrealized connection between linear algebra and computer science. I speculate graphs are the missing piece of the puzzle. Graphs are not only useful as cognitive aides, but are suitable data structures for a wide…
Pixelopolis, a self-driving car demo from Google I/O built with TensorFlow-Lite
Pixelopolis is an interactive installation that showcases self-driving miniature cars powered by TensorFlow Lite. Each car is outfitted with its own Pixel phone, which used its camera to detect and understand signals from the world around it. In order to sense lanes, avoid collisions and read traffic signs, the phone…