3421
Understand how transformers work by demystifying the math behind them
Understand how transformers work by demystifying all the math behind them
New
The latest blog posts to take off on Hacker News. 6,334 posts.
3422
A simulation of me: fine-tuning an LLM on 240k text messages
Armed with a download of my 240,000 text message and Whatsapp history, I was able to fine-tune an LLM to create convincing conversations.
3423
AI generated security reports about curl
I have held back on writing anything about AI or how we (not) use AI for development in the curl factory. Now I can't hold back anymore. Let me show you the most significant effect of AI on curl as of today - with examples. Bug Bounty Having a bug bounty means that we offer … Continue reading The I in LLM stands for…
3424
Japan Goes All In: Copyright Doesn't Apply to AI Training
Jun 21, 2023 | ! Homepage Slider , ! Recent Country News , Artificial Intelligence , BIG DATA , Breaking News , Compliance , Insights , Japan , Machine Learning , Regulatory , Regulatory Framework , Transparency | 0 |
3425
3426
Stuff we figured out about AI in 2023
2023 was the breakthrough year for Large Language Models (LLMs). I think it’s OK to call these AI—they’re the latest and (currently) most interesting development in the academic field of …
3427
3428
Things are about to get worse for generative AI
A full of spectrum of infringment
3429
What I learned using private LLMs to write an undergraduate history essay
I used private and public LLMs to answer an undergraduate essay question I spent a week working on nearly 30 years ago, in an effort to see how the experience would have changed in that time. There were two rules:
3430
Pushing ChatGPT's Structured Data Support to Its Limits
“Function calling” with ChatGPT is ChatGPT’s best feature since ChatGPT.
3431
Will scaling work?
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
3432
2023: The Year of AI
Explore the significant AI advancements, impactful partnerships, and legal debates that defined 2023.
3433
"Attention", "Transformers", in Neural Network "Large Language Models"
I find this literature irritating and opaque. This is at least somewhat because I do not yet understand it well, and there's too much of it. But clearly I need to wrap my head around it, before I become technically obsolete. My scare quotes in the title of these notes thus derive in part from jealousy and fear. But…
3434
How to make LLMs go fast
Blog about linguistics, programming, and my projects
3435
OpenAI Begins Tackling ChatGPT Data Leak Vulnerability
OpenAI seems to have implemented some mitigation steps for a well-known data exfiltration vulnerability in ChatGPT. Attackers can use image markdown rendering …
3436
Text-to-CAD
Introducing our machine learning model for generating CAD models from a text prompt.
3437
Mistral 7B Fine-Tune Optimized
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
3438
Waymo outperforms comparable human benchmarks over 7M+ miles
Safety leads everything we do at Waymo. This year alone, Waymo has served over 700,000 ride-hailing trips with public riders and no human driver. We couldn’t have hit that milestone without putting safety front and center, and we are working hard to improve the measurement, transparency, and performance of our fleet.
3439
VideoPoet A large language model for zero-shot video generation
A Large Language Model for Zero-Shot Video Generation. VideoPoet demonstrates simple modeling method that can convert any autoregressive language model into a high quality video generator.
3440
CUDA vs. ROCm: A case study
A simple, whitespace theme for academics. Based on [*folio](https://github.com/bogoli/-folio) design.
3441
SVD Image Compression
Singular Value Decomposition (SVD) is a fundamental concept in linear algebra, and it is particularly important in the field of machine learning for tasks such as dimensionality reduction, data compression, and noise reduction.
3442
The Illustrated GPT-2: Visualizing Transformer Language Models (2019)
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays…
3443
Google's True Moonshot
Google could do more than just win the chatbot war: it is the one company that could make a universal assistant. The question is if the company is willing to risk it all.
3444
Many options for running Mistral models in your terminal using LLM
Mistral AI is the most exciting AI research lab at the moment. They’ve now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a …
3445
Small offline large language model – TinyChatEngine from MIT
BLUF : TinyChatEngine provides an off-line open-source large language model (LLM) that has been reduced in size compared to Llama2. This po...
3446
3447
Causal Trees
Projects and Ramblings
3448
RAG to Riches
Today I will be regaling you with tales of marvelous cherry-picked new developments in AI, from Sam Altman's recent Uno Reverse incident to bear spraying job-hungry engineers.
3449
Advancements in machine learning for machine learning
Posted by Phitchaya Mangpo Phothilimthana, Staff Research Scientist, Google DeepMind, and Bryan Perozzi, Senior Staff Research Scientist, Google Re...
3450
Do large language models need all those layers?
Finding that 70% of attention heads and 20% of feed-forward networks can be excised with minimal effect on in-context learning suggests that large language models are undertrained.