1921
Chat Notebooks
Wolfram expands Notebooks, integrating LLM functionality into the new chat cell and Chat Notebook. Stephen Wolfram explains how chat-enabled and chat-driven versions work.
New
The latest blog posts to take off on Hacker News. 3,091 posts.
1922
Why Do ML on the Erlang VM?
Another question might be; why do machine learning at all? I'm not big into ML/AI though I've been poking it more recently as the open models, such as Stable Diffusion and the more practical Whisper, caught my curiosity. I have a very decent GPU (3090 Ti) and I've poked around a bit. I don't consider ML a super…
1923
Understanding GPT tokenizers
Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing …
1924
AI will save the world?
By Marc Andreessen
1925
Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields
Neural Radiance Field training can be accelerated through the use of grid-based representations in NeRF's learned mapping from spatial coordinates to colors and volumetric density. However, these grid-based approaches lack an explicit understanding of scale and therefore often introduce aliasing, usually in the form…
1926
It’s infuriatingly hard to understand how closed models train on their input
One of the most common concerns I see about large language models regards their training data. People are worried that anything they say to ChatGPT could be memorized by it …
1927
The death of self-driving cars is greatly exaggerated
GM’s Cruise aims to turn self-driving into a billion-dollar business.
1928
Notes on training BERT from scratch on an 8GB consumer GPU
I trained a BERT model (Devlin et al, 2019) from scratch on my desktop PC (which has a Nvidia 3060 Ti 8GB GPU). The model architecture, tokenizer, and trainer all came from Hugging Face libraries, and my contribution was mainly setting up the code, setting up the data (~20GB uncompressed text), and leaving my computer…
1929
The greatest risk of AI is from the people who control it, not the tech itself
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
1930
Production AI systems are hard
The relationship between humans and machines. Click to read Methexis, by Kevin Fischer, a Substack publication.
1931
Bayes is guaranteed to overfit
The myth A few years ago I saw a StackOverflow question (but I cannot find it now): allegedly Andrew Gelman blogged that Bayesian models would not overfit and would only underfit (I also cannot find Andrew’s blog post now but I think what he meant by “Bayesian models only underfits” is that you can never fully model…
1932
Lawyer cites fake cases invented by ChatGPT, judge is not amused
Legal Twitter is having tremendous fun right now reviewing the latest documents from the case Mata v. Avianca, Inc. (1:22-cv-01461). Here’s a neat summary: So, wait. They file a brief …
1933
AI Written, AI Read cartoon
One piece of slang that has long embodied the short attention span Internet age is TL;DR, short for “too long; didn’t read.” With the explosion of generative AI tools, we’re rapidly entering the age of TL;DW: “too long, didn’t write.” A January survey from Fishbowl found that 40% of nearly 12,000 workers have used…
1934
Lessons from Creating a VSCode Extension with GPT-4
Lately, I've been playing around with LLMs to write code.
1935
The tiny corp raised $5.1M
Here we go again. I started another company. The money is in the bank.
1936
Why the original transformer figure is wrong, and some other tidbits about LLMs
A few months ago, I shared the article, Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed, and the positive feedback was very motivating!
1937
Let's Talk about ChatGPT with Code Interpreter and Microsoft Copilot
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
1938
Yoshua Bengio: How Rogue AIs May Arise
The rise of powerful AI dialogue systems in recent months has precipitated debates about AI risks of all kinds, which hopefully will yield an acceleration of governance and regulatory frameworks.
1939
1940
Using ChatGPT for home automation
In another thrilling adventure with ChatGPT, I endeavored to integrate it with a Raspberry Pi, effectively turning it into my own personal light switch. My custom ChatGPT plugin, sporting just two ...
1941
1942
PyTorch for WebGPU
TL;DR I’ve been working on a WebGPU optimized inference and autograd library called webgpu-torch with an API that matches PyTorch. The goal is to run neural networks in the browser at speeds comparable to a Linux workstation. Many kernels have been implemented and its design is easily extensible. It’s available on NPM…
1943
CLI tools for working with ChatGPT and other LLMs
I’ve been building out a small suite of command-line tools for working with ChatGPT, GPT-4 and potentially other language models in the future. The three tools I’ve built so far …
1944
1945
Why are there no antitrust claims vs. GitHub Copilot, when there is a precedent?
Microsoft GitHub released CoPilot last year, a tool for generating code and auto-completion, that’s been trained on vast amount of open source code, notably all open source code hosted on Git…
1946
Translating Akkadian clay tablets with ChatGPT?
Alles wat Jan bezighoudt, interesseert en irriteert... en ook een beetje onzin...
1947
Which kinds of GPT startups will thrive?
How to separate the wheat from the chaff when GPT-powered startups are popping up everywhere
1948
Uncensored Models
I am publishing this because many people are asking me how I did it, so I will explain. When I talk about a model, I'm talking about a huggingface…
1949
Google I/O and the Coming AI Battles
Google A/I suggests that AI is a sustaining innovation for all of Big Tech; that means the real battle will be between incumbents and Big Tech on one side, and open source on the other.
1950
Prompt injection explained, with video, slides, and a transcript
I participated in a webinar this morning about prompt injection, organized by LangChain and hosted by Harrison Chase, with Willem Pienaar, Kojin Oshiba (Robust Intelligence), and Jonathan Cohen and Christopher …