1741
Stuff we figured out about AI in 2023
2023 was the breakthrough year for Large Language Models (LLMs). I think it’s OK to call these AI—they’re the latest and (currently) most interesting development in the academic field of …
New
The latest blog posts to take off on Hacker News. 3,091 posts.
1742
1743
Things are about to get worse for generative AI
A full of spectrum of infringment
1744
What I learned using private LLMs to write an undergraduate history essay
I used private and public LLMs to answer an undergraduate essay question I spent a week working on nearly 30 years ago, in an effort to see how the experience would have changed in that time. There were two rules:
1745
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
1746
Will scaling work?
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
1747
"Attention", "Transformers", in Neural Network "Large Language Models"
I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
1748
How to make LLMs go fast
Blog about linguistics, programming, and my projects
1749
OpenAI Begins Tackling ChatGPT Data Leak Vulnerability
OpenAI seems to have implemented some mitigation steps for a well-known data exfiltration vulnerability in ChatGPT. Attackers can use image markdown rendering …
1750
CUDA vs. ROCm: A case study
A simple, whitespace theme for academics. Based on [*folio](https://github.com/bogoli/-folio) design.
1751
SVD Image Compression
Singular Value Decomposition (SVD) is a fundamental concept in linear algebra, and it is particularly important in the field of machine learning for tasks such as dimensionality reduction, data compression, and noise reduction.
1752
The Illustrated GPT-2: Visualizing Transformer Language Models (2019)
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays…
1753
Google's True Moonshot
Google could do more than just win the chatbot war: it is the one company that could make a universal assistant. The question is if the company is willing to risk it all.
1754
Many options for running Mistral models in your terminal using LLM
Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a …
1755
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
1756
Causal Trees
Projects and Ramblings
1757
Embeddings, vectors, and arithmetic
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
1758
First look at Microsoft 365 Copilot
Microsoft has made tons of noise about their Microsoft 365 Copilot toolset. They’ve made a lot of promises about its capabilities to enhance individual and team productivity, but access to it…
1759
The AI Trust Crisis
Dropbox added some new AI features. In the past couple of days these have attracted a firestorm of criticism. Benj Edwards rounds it up in Dropbox spooks users with new …
1760
Turing awardees republished key methods and ideas without credit
Whose Creators They Failed to Credit
1761
1762
Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX
How fast is my Whisper Benchmark with the MLX Framework from Apple? Nvidia 4090 / M1 Pro / M2 Ultra / M3
1763
1764
AI’s big rift is like a religious schism
The cult-like battles between e/acc and doomers
1765
Role-playing with AI will be a powerful tool for writers and educators
Or, how well can GPT-4 simulate an acid trip in 1963?
1766
I wrote a meta mode for ChatGPT
I have developed a way to supercharge ChatGPT. It’s called Nova Mode and it’s an awesome custom instruction that you can paste into your ChatGPT Custom instructions (see screenshot below) in ChatGPT Settings. This modifies how ChatGPT works in all your chats, giving you much more control over how you interact with…
1767
Gaussian explosion
Over the past month it seems like Gaussian Splatting (see my first post ) is experiencing a Cambrian Gaussian explosion of new research. The seminal paper came out in July 2023, and starting about mid-November, it feels like every day there’s a new paper or two coming out, related to Gaussian Splatting in some way…
1768
High Court rules that Getty vs. Stability AI case can proceed
While most of the attention regarding artificial intelligence and copyright has been centred in the United States, it’s useful to remember that one of the main pieces of litigation is taking …
1769
Fine-tuning Mistral 7B on Magic the Gathering Draft
Tips, examples, and thoughts from an exploration of the world of fine tuning
1770
How does Shazam work? (2022)
Your phone's ability to identify any song it listens to is pure technological magic. In this article, I'll show you how one of the most popular apps, Shazam , does it. The founders of Shazam released a paper in 2003 documenting how it works, and I have been working on an implementation of that paper, abracadabra .