1
New
The latest blog posts to take off on Hacker News. 402 posts.
2
Things are about to get worse for generative AI
A full of spectrum of infringment
3
What I learned using private LLMs to write an undergraduate history essay
I used private and public LLMs to answer an undergraduate essay question I spent a week working on nearly 30 years ago, in an effort to see how the experience would have changed in that time. There were two rules:
4
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
5
Will scaling work?
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
6
"Attention", "Transformers", in Neural Network "Large Language Models"
I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
7
How to make LLMs go fast
Blog about linguistics, programming, and my projects
8
OpenAI Begins Tackling ChatGPT Data Leak Vulnerability
OpenAI seems to have implemented some mitigation steps for a well-known data exfiltration vulnerability in ChatGPT. Attackers can use image markdown rendering …
9
CUDA vs. ROCm: A case study
A simple, whitespace theme for academics. Based on [*folio](https://github.com/bogoli/-folio) design.
10
SVD Image Compression
Singular Value Decomposition (SVD) is a fundamental concept in linear algebra, and it is particularly important in the field of machine learning for tasks such as dimensionality reduction, data compression, and noise reduction.
11
The Illustrated GPT-2: Visualizing Transformer Language Models (2019)
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays…
12
Google's True Moonshot
Google could do more than just win the chatbot war: it is the one company that could make a universal assistant. The question is if the company is willing to risk it all.
13
Many options for running Mistral models in your terminal using LLM
Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a …
14
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
15
Causal Trees
Projects and Ramblings
16
Embeddings, vectors, and arithmetic
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
17
First look at Microsoft 365 Copilot
Microsoft has made tons of noise about their Microsoft 365 Copilot toolset. They’ve made a lot of promises about its capabilities to enhance individual and team productivity, but access to it…
18
The AI Trust Crisis
Dropbox added some new AI features. In the past couple of days these have attracted a firestorm of criticism. Benj Edwards rounds it up in Dropbox spooks users with new …
19
Turing awardees republished key methods and ideas without credit
Whose Creators They Failed to Credit
20
21
Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX
How fast is my Whisper Benchmark with the MLX Framework from Apple? Nvidia 4090 / M1 Pro / M2 Ultra / M3
22
23
AI’s big rift is like a religious schism
The cult-like battles between e/acc and doomers
24
Role-playing with AI will be a powerful tool for writers and educators
Or, how well can GPT-4 simulate an acid trip in 1963?
25
I wrote a meta mode for ChatGPT
I have developed a way to supercharge ChatGPT. It’s called Nova Mode and it’s an awesome custom instruction that you can paste into your ChatGPT Custom instructions (see screenshot below) in ChatGPT Settings. This modifies how ChatGPT works in all your chats, giving you much more control over how you interact with…
26
Gaussian explosion
Over the past month it seems like Gaussian Splatting (see my first post ) is experiencing a Cambrian Gaussian explosion of new research. The seminal paper came out in July 2023, and starting about mid-November, it feels like every day there’s a new paper or two coming out, related to Gaussian Splatting in some way…
27
High Court rules that Getty vs. Stability AI case can proceed
While most of the attention regarding artificial intelligence and copyright has been centred in the United States, it’s useful to remember that one of the main pieces of litigation is taking …
28
Fine-tuning Mistral 7B on Magic the Gathering Draft
Tips, examples, and thoughts from an exploration of the world of fine tuning
29
How does Shazam work? (2022)
Your phone's ability to identify any song it listens to is pure technological magic. In this article, I'll show you how one of the most popular apps, Shazam , does it. The founders of Shazam released a paper in 2003 documenting how it works, and I have been working on an implementation of that paper, abracadabra .
30
Sequential modeling enables scalable learning for large vision models
We introduce a novel sequential modeling approach which enables learning a Large Vision Model ( LVM ) without making use of any linguistic data. To do this, we define a common format, "visual sentences", in which we can represent raw images and videos as well as annotated data sources such as semantic segmentations…