121
Banning open weight models would be a disaster
My comments on the NTIA AI Open Model Weights RFC
122
What's Going on in Machine Learning? Some Minimal Models
Stephen Wolfram explores minimal models and their visualizations, aiming to explain the underneath functionality of neural nets and ultimately machine learning.
123
A Visual Guide to Vision Transformers
This is a visual guide (scroll story) to Vision Transformers (ViTs), a class of deep learning models that have achieved state-of-the-art performance on image classification tasks.
124
Trying out QvQ – Qwen's new visual reasoning model
I thought we were done for major model releases in 2024, but apparently not: Alibaba’s Qwen team just dropped the Apache 2.0 licensed Qwen licensed (the license changed) QvQ-72B-Preview, “an …
125
I don't want anything your AI generates
AI output is fundamentally derivative and exploitative (of content, labor and the environment).
126
Are we at peak vector database?
Seriously - why do we need all these vector databases? Do we need dozens of them?
127
Alice's adventures in a differentiable wonderland
A free, self-contained introduction to neural networks and differentiable programming, from automatic differentiation to transformers, with additional chapters on advanced topics.
128
Are you better than a language model at predicting the next word?
A quiz to see how you compare to language models.
129
Satellites Spotting Aircraft
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
130
AI is an impediment to learning web development
Some thoughts on AI and LLMs, based on being Head of Engineering for JumboCode , a club of 180 students at Tufts University that builds software for non-profits.
131
Perceptually lossless (talking head) video compression at 22kbit/s
Achieving extreme video compression rates using the LivePortrait model for talking head videos.
132
Money bubble
I think I’m probably going to lose quite a lot of money in the next year or two. It’s partly AI’s fault, but not mostly. Nonetheless I’m mostly going to write about AI, because it intersects the technosphere, where I’ve lived for decades.
133
Tenstorrent and the State of AI Hardware Startups
Semi-custom silicon is a bigger problem than Nvidia.
134
135
Can LLMs accurately recall the Bible?
I've often found myself uneasy when LLMs (Large Language Models) are asked to quote the Bible. While they can provide insightful discussions about faith, their tendency to hallucinate responses raises concerns when dealing with scripture, which we regard as the inspired Word of God. To explore these concerns, I
136
Diffusion Is Spectral Autoregression
A deep dive into spectral analysis of diffusion models of images, revealing how they implicitly perform a form of autoregression in the frequency domain.
137
Hand Tracking for Mouse Input (2023)
The other day I saw the launch of Apple Vision Pro, the whole thing was very interesting, but one thing that caught my attention was the finger input. It seems very intuitive, by using the finger pinching as sort of like a cursor or mouse input. I figured I want to try it out, so I took it upon myself to create it.
138
Bringing K/V context quantisation to Ollama
K/V context cache quantisation has been added to Ollama. This enables significant reductions in VRAM usage, allowing users to realise the potential of expanded context sizes and run larger models at their existing context sizes.
139
General Theory of Neural Networks
From gene regulatory networks to artificial neural networks
140
141
How LLMs Work, Explained Without Math
I'm sure you agree that it has become impossible to ignore Generative AI (GenAI), as we are constantly bombarded with mainstream news about Large Language Models (LLMs). Very likely you have tried…
142
AI doppelgänger experiment – Part 1: The training
👯 On training my own AI to steal illustrators’ styles
143
Diffusion Forcing: Next-Token Prediction Meets Full-Sequence Diffusion
Official Website of Diffusion Forcing
144
OpenAI DevDay 2024 live blog
I’m at OpenAI DevDay in San Francisco, and I’m trying something new: a live blog, where this entry will be updated with new notes during the event. See OpenAI DevDay: …
145
Meaningful Nonsense: How I generate sentences
I’m coding a system in JavaScript that generates sentences of “meaningful nonsense”. Here are some examples.
146
Stuff we figured out about AI in 2023
2023 was the breakthrough year for Large Language Models (LLMs). I think it’s OK to call these AI—they’re the latest and (currently) most interesting development in the academic field of …
147
Demystifying GPU compute architectures
Getting 'low level' with Nvidia and AMD GPUs
148
The future of Deep Learning frameworks
Assumed audience: ML researchers who frequently work with PyTorch , but are interested in trying out JAX or have yet to be convinced.
149
Indexing iCloud Photos with AI Using LLaVA and Pgvector
A straightforward idea, gluing stuff together until it works, but it’s a glimpse of what’s possible with help of local AIs in near future
150
I'm an Old Fart and AI Makes Me Sad
Previous major advancements in Computer Science and its applications always felt empowering to me, AI feels different.