1831
LLM Falcon 180B Needs 720GB RAM to Run
Yes, if you have enough CPU RAM
New
The latest blog posts to take off on Hacker News. 3,091 posts.
1832
I made a transformer to predict a simple sequence manually
To better understand how transformers work, I hand-assigned all the weights to predict a simple sequence.
1833
Open source AI will win
You shouldn't bet against the bazaar or the GPU p̶o̶o̶r̶ hungry.
1834
1835
Compiling ML models to C for fun
We make micrograd fly with a little compiler magic. In this post, we’ll write a ML compiler from scratch.
1836
78% MNIST accuracy using GZIP in under 10 lines of code
Using GZIP compression and the k-Nearest Neighbors algorithm, we explore an innovative approach to classifying the MNIST dataset with about 78% accuracy
1837
What will LLM-powered software look like in the medium-term future?
Recently, I started working on a new LLM-oriented project . It’s currently far from feature-complete and probably filled with bugs, but I’m hoping to use it as a platform for exploring a question I’ve been considering a lot lately: what will LLM-powered software look like in the medium-term future? It seems undeniable…
1838
Apple’s new Transformer-powered predictive text model
I found some details about Apple’s new predictive text model, coming soon in iOS 17 and macOS Sonoma.
1839
GPT-4 is not getting worse
GPT-4 may have declined in some areas, but it hasn’t systematically done so. My tests were shit, and never proved much of anything.
1840
Optimizing LLMs from a Dataset Perspective
Practical guide to improving LLM finetuning with better instruction datasets, covering data curation, prompt-output pairs, synthetic data, and experiment ideas.
1841
Lessons from YC AI Startups
The evolution of the AI landscape, and YC's Copilot era.
1842
Simulating History with ChatGPT
The Case for LLMs as Hallucination Engines
1843
A Multi-Level View of LLM Intentionality
Prompted by Keith Frankish's recent streamed discussion of LLM intentionality on YouTube , there's a particular idea I wanted to share which...
1844
Nvidia’s AI supremacy is only temporary
Nvidia is an amazing company that has executed a contrarian vision for decades, and has rightly become one of the most valuable corporations on the planet thanks to its central role in the AI revol…
1845
Intuitively Understanding Harris Corner Detector
If you ever tried to learn how the Harris corner detection algorithm works, you might have noticed that the process is not intuitive at all. First, you start with an energy function, approximate it using Taylor approximation, get a matrix from that, then find the eigenvalues of that matrix, etc. But when you come to…
1846
Training and aligning LLMs with RLHF and RLHF alternatives
I frequently reference a process called Reinforcement Learning with Human Feedback (RLHF) when discussing LLMs, whether in the research news or tutorials.
1847
Gaussian splatting is pretty cool
SIGGRAPH 2023 just had a paper “ 3D Gaussian Splatting for Real-Time Radiance Field Rendering ” by Kerbl, Kopanas, Leimkühler, Drettakis, and it looks pretty cool! Check out their website, source code repository, data sets and so on (I should note that it is really, really good to see full source and full data sets…
1848
Playing with genetic algorithms in Python
Edit: This post made it to the front page of Hacker News! You can find the discussion here.
1849
Remembering Doug Lenat and his quest to capture the world with logic
Stephen Wolfram shares memories of Doug Lenat, early AI pioneer and developer of the CYC system. Their discussions around AI & logic and the potential combined uses of their respective discoveries.
1850
LLM Python/CLI tool adds support for embeddings
LLM is my Python library and command-line tool for working with language models. I just released LLM 0.9 with a new set of features that extend LLM to provide tools …
1851
1852
Doug Lenat has died
AI has lost a giant
1853
AI model weight providers should not police uses, no matter how awful they are
The Electronic Frontier Foundation, a digital civil liberties advocacy group, recently published a good article entitled “ISPs Should Not Police Online Speech—No Matter How Awful It Is.” 1 It argues that providers within the internet “stack” should refrain from censoring traffic according to their own values. That…
1854
Understanding Llama 2 and the New Code Llama LLMs
In this edition of the newsletter, we direct our attention to one of the most prominent highlights of the summer: the release of the Llama 2 base and chat models, as well as CodeLlama, the latest highlights in the open-source AI large language model (LLM) landscape.
1855
ChatLZMA – text generation from data compression
I came across a random tweet, found a Wikipedia page and bumped into some smart people and long story short, apparently compression is equivalent to general intelligence.
1856
1857
Changing my relationship with GitHub Copilot
I've been using GitHub Copilot on personal projects since March. It's been an interesting experience, and one that I realized I have to change. Using Copilot nearly full time has had some positive and negative impacts on me, and it's time to take control of how I interact with it.
1858
Nvidia on the Mountaintop
Nvidia has gone from the valley to the mountain-top in less than a year, thanks to ChatGPT and the frenzy it inspired; whether or not there is a cliff depends on developing new kinds of demand that…
1859
Deep Neural Nets: 33 years ago and 33 years from now (2022)
Musings of a Computer Scientist.
1860
