1
New
The latest blog posts to take off on Hacker News. 789 posts.
2
Things are about to get worse for generative AI
A full of spectrum of infringment
3
What I learned using private LLMs to write an undergraduate history essay
I used private and public LLMs to answer an undergraduate essay question I spent a week working on nearly 30 years ago, in an effort to see how the experience would have changed in that time. There were two rules:
4
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
5
Will scaling work?
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
6
2023: The Year of AI
Explore the significant AI advancements, impactful partnerships, and legal debates that defined 2023.
7
"Attention", "Transformers", in Neural Network "Large Language Models"
I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
8
How to make LLMs go fast
Blog about linguistics, programming, and my projects
9
OpenAI Begins Tackling ChatGPT Data Leak Vulnerability
OpenAI seems to have implemented some mitigation steps for a well-known data exfiltration vulnerability in ChatGPT. Attackers can use image markdown rendering …
10
Text-to-CAD
Introducing our machine learning model for generating CAD models from a text prompt.
11
Mistral 7B Fine-Tune Optimized
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
12
Waymo outperforms comparable human benchmarks over 7M+ miles
Safety leads everything we do at Waymo. This year alone, Waymo has served over 700,000 ride-hailing trips with public riders and no human driver. We couldn’t have hit that milestone without putting safety front and center, and we are working hard to improve the measurement, transparency, and performance of our fleet.
13
VideoPoet A large language model for zero-shot video generation
A Large Language Model for Zero-Shot Video Generation. VideoPoet demonstrates simple modeling method that can convert any autoregressive language model into a high quality video generator.
14
CUDA vs. ROCm: A case study
A simple, whitespace theme for academics. Based on [*folio](https://github.com/bogoli/-folio) design.
15
SVD Image Compression
Singular Value Decomposition (SVD) is a fundamental concept in linear algebra, and it is particularly important in the field of machine learning for tasks such as dimensionality reduction, data compression, and noise reduction.
16
The Illustrated GPT-2: Visualizing Transformer Language Models (2019)
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays…
17
Google's True Moonshot
Google could do more than just win the chatbot war: it is the one company that could make a universal assistant. The question is if the company is willing to risk it all.
18
Many options for running Mistral models in your terminal using LLM
Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a …
19
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
20
21
Causal Trees
Projects and Ramblings
22
RAG to Riches
Today I will be regaling you with tales of marvelous cherry-picked new developments in AI, from Sam Altman's recent Uno Reverse incident to bear spraying job-hungry engineers.
23
Advancements in machine learning for machine learning
Posted by Phitchaya Mangpo Phothilimthana, Staff Research Scientist, Google DeepMind, and Bryan Perozzi, Senior Staff Research Scientist, Google Re...
24
Do large language models need all those layers?
Finding that 70% of attention heads and 20% of feed-forward networks can be excised with minimal effect on in-context learning suggests that large language models are undertrained.
25
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
26
27
Embeddings, vectors, and arithmetic
An embedding is the representation of a piece of text like a word, sentence, or paragraph. Traditionally this value is in the form of a mathematical vector - a point in space. You can think of it as analogous to coordinates on a map that just happens to have many, many dimensions.
28
Weak-to-Strong Generalization
We present a new research direction for superalignment, together with promising initial results: can we leverage the generalization properties of deep learning to control strong models with weak supervisors?
29
First look at Microsoft 365 Copilot
Microsoft has made tons of noise about their Microsoft 365 Copilot toolset. They’ve made a lot of promises about its capabilities to enhance individual and team productivity, but access to it…
30
FunSearch: Making new discoveries in mathematical sciences using LLMs
We introduce FunSearch, a method for searching for “functions” written in computer code, and find new solutions in mathematics and computer science. FunSearch works by pairing a pre-trained LLM, whose goal is to provide creative solutions in the form of computer code, with an automated “evaluator”, which guards…