LaMDA is not sentient
No, LaMDA is not sentient. Not even slightly.
The latest blog posts to take off on Hacker News. 3,092 posts.
No, LaMDA is not sentient. Not even slightly.
What follows is the “interview” I and a collaborator at Google conducted with LaMDA. It is incomplete as the GMail word limit cut off the…
In the glorious future, every website will be chock-full of semantic metadata. Restaurants won't have a 50MB PDF explaining the chef's vision for organic cuisine - instead, they'll have little scraps of data on the HTML page like: Copied JSON to 📋⧉ JSON"hasMenuItem":{ "@type":"MenuItem", "name":"Dodo In A Bun"…
I feel techniques for making machine learning work with small data are not talked about enough. This makes sense because many ML applications are only possible by collecting a huge amount of data. …
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold.
Left: Original image. Center: Blurred through convolution. Right: Deconvolution of the blurred image. In this post, we’ll have a look at the idea of removing blur from images, videos, or games thro…
I was walking home from school by myself when I saw it. A robot, just standing in the middle of the street.
Not All Heroes Wear Capes
I went on a real vacation, and created photos of a fake vacation using DALL-E 2. Most people couldn't tell the difference.
Artificial Intelligence is a once-in-a lifetime commercial and defense game changer (download a PDF of this article here) Hundreds of billions in public and private capital is being invested in Art…
A while ago there was an interesting thread on the Julia Discourse about the “state of machine learning in Julia”. I posted a response discussing the differences between Julia and Python (both JAX and PyTorch), and it seemed to be really well received! Since then this topic seems to keep coming up, so I thought I’d…
This research demonstrates a model-free approach to optimize the energy produced by a dual-axis solar panel using reinforcement learning. Specifically, a softmax actor-critic agent optimizes energy production in a simulated, dynamic lighting environment which is generated from real power data. All s
I am very happy to say that I have recently received a generous grant from the Astera Institute to set up a small group to work on automatic theorem proving, in the first instance for about three y…
I was on the job market recently, open to suggestions on what I should do next. I'm deeply thankful to all those who reached out and pitched their companies, and also to people who shared their wisdom of how they wanted to navigate their own careers.
Machine-learning generated content has major implications on the Metaverse, because it brings the marginal cost of production to zero.
Lighting, perspective, variation chaining, and other tricks to try with DALL·E.
DuckDuckGo and Bing are not true alternatives – they’re just worse versions of Google.
Ever since its introduction in the 2017 paper, Attention is All You Need, the Transformer model architecture has taken the deep-learning world by storm. Initially introduced for machine translation, it has become the tool of choice for a wide range of domains, including text, audio, video, and others. Transformers…
Or "Why we're all in denial about the robot apocalypse"
How can you tell when software uses the Neural Engine in an M1 series Mac? How much power does it use, and what is Espresso? Mysteries unravelled.
Enter in code and inputs, GPT-3 will compute you the output!
A few months ago, Smith wrote an AI-skeptical article where he threw some sentences at the GPT-3, a text processor from Open AI. As wikipedia puts it:
Fictional short story about Clippy & AI hard takeoff scenarios grounded in contemporary ML scaling, self-supervised learning, reinforcement learning, and meta-learning research literature.
A few years ago, I worked on a project to investigate the potential of machine learning to transform healthcare through modeling electronic medical records. I walked away deeply disillusioned with the whole field and I really don’t think that the field needs machine learning right now. What it does need is plenty of…
TL;DR: OpenAI has a new code generating model that’s improved in a number of ways and can handle nearly two times as much text (4,000 tokens.) I built several small games and applications without t…