331
332
333
ChatLZMA – text generation from data compression
I came across a random tweet, found a Wikipedia page and bumped into some smart people and long story short, apparently compression is equivalent to general intelligence.
334
Giving GPT “Infinite” Knowledge
How to give GPT access to large amounts of data
335
336
Record labels panic as A.I. generated song becomes ‘hit single’
Welcome to the new world.
337
The OpenAI Keynote
OpenAI’s developer keynote was exciting, both because AI was exciting, and because OpenAI has the potential to be a meaningful consumer tech company.
338
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
339
Scaffolded LLMs as natural language computers
Recently, LLM-based agents have been all the rage – with projects like AutoGPT showing how easy it is to wrap an LLM in a simple agentic loop and prompt it to achieve real-world tasks. More generally, we can think about the class of ‘scaffolded’ 1 LLM systems – which wrap...
340
Why is GPT-3 15.77x more expensive for certain languages?
How large language models process multilingual data differently
341
342
Embeddings, vectors, and arithmetic
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
343
344
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
345
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
346
347
Nvidia on the Mountaintop
Nvidia has gone from the valley to the mountain-top in less than a year, thanks to ChatGPT and the frenzy it inspired; whether or not there is a cliff depends on developing new kinds of demand that…
348
A PCIe Coral TPU Finally Works on Raspberry Pi 5
Coral.ai TPUs are AI accelerators used for tasks like machine vision and audio processing. Raspberry Pis are often integrated into small robotics and IoT products—or used to analyze live video feeds with Frigate. Until today, nobody I know of has been able to get a PCI Express Coral TPU working on the Raspberry Pi…
349
The Cambrian Period of AI
I’ve noticed that AI twitter is talking a lot about evolution lately, and for good reason. Comparing AI development to an evolutionary system lets
350
Leaked Google document: “We Have No Moat, And Neither Does OpenAI”
SemiAnalysis published something of a bombshell leaked document this morning: Google “We Have No Moat, And Neither Does OpenAI”. The source of the document is vague: The text below is …
351
Three-eyed forehead in Stable Diffusion
Computers, Machine Learning and non-machine learning
352
Understanding the limits of large language models
Reading level: No programming knowledge required, but trying ChatGPT first is advised.
353
My experience trying to write human-sounding articles using Claude AI
You can use AI tools like Claude to help you write full-length content. By going paragraph-by-paragraph, you can direct the AI while seemingly maintaining your own voice and ideas. However, despite my attempts to use AI with writing, I’ve found that it’s harder to pull off than I thought. I can get close, but due to…
354
Formalising modern research mathematics in real time
(This is a guest post by Bhavik Mehta) On March 16, 2023, a paper by Campos, Griffiths, Morris, and Sahasrabudhe appeared on the arXiv, announcing an exponential improvement to the upper bound on R…
355
Large language models: Scaling laws and emergent properties
More details on the science of training large autoregressive language models.
356
High Court rules that Getty vs. Stability AI case can proceed
While most of the attention regarding artificial intelligence and copyright has been centred in the United States, it’s useful to remember that one of the main pieces of litigation is taking …
357
About That OpenAI "Breakthrough"
Will OpenAI’s Q* change the world?
358
Which kinds of GPT startups will thrive?
How to separate the wheat from the chaff when GPT-powered startups are popping up everywhere
359
360
Abusing vector search for texts, maps, and chess
Vector search isn't just for AI embeddings. Use HNSW for geo-spatial queries, stock covariance, chess positions, text tokens, and multi-modal recommendations with custom metrics.