Fast LLM Inference From Scratch (using CUDA)
This post is about building an LLM inference engine using C++ and CUDA from scratch without libraries.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 49,204 posts.
This post is about building an LLM inference engine using C++ and CUDA from scratch without libraries.
" I think a lot of mathematics is really about how you understand things in your head. […]
Link to: https://www.reddit.com/r/apolloapp/comments/13ws4w3/had_a_call_with_reddit_to_discuss_pricing_bad/
We help you acquire the perfect domain for your site. Affordable payment options. Quick and responsive customer support available.
The goal was equity. The result: Meh.Frustrated by high failure rates in eighth-grade algebra, San Francisco Unified decided in 2015 to delay algebra till ninth grade and place low, average and high achievers in the same classes. The goal was to improve achievement for black and Hispanic students, preparing more for…
Reading, writing, cooking, and maybe some other random explorations.
Silent changes in payment methods on big creator funding platforms raise some unpleasant questions.
Also: another paper that seals the deal
I've gotten a bunch of emails asking for advice on how to learn Common Lisp in the present day. I decided to write down all the advice I've been giving through email and social media posts in the hopes that someone might find it useful.
I've been using zig for ~4 months worth of side projects, including a toy text editor and an interpreter for a relational language . I've written ~10kloc.
Posts and writings by Lennart Poettering
“Nearly every person I worked with, I saw cry at their desk.”
A cheap USB stick and the marketing around it caused disappointment, more at 11.
In my position I probably shouldn’t have a favorite AWS product, just like you shouldn’t have a favorite child. I do have a fave service but fortunately I’m not an (even partial) parent; so let’s hope that’s OK. I’m talking about Amazon Simple Queue Service , which nobody ever calls by its full name.
Blog: https://lauren.vortex.com/the-death-of-google PDF: https://lauren.vortex.com/google-death.pdf Google Docs: https://lauren.vortex.com/google-death.gdoc
This is the second year I brought my Dad (a now-retired radio engineer and co-host of Geerling Engineering) to Open Sauce, a Bay Area maker faire-like event, dreamed up by William Osman and featuring hundreds of exhibits ranging from mad science, to vintage electronics, to games, to world-record-breaking Rubik's Cube…
Since I started working with Snowden’s documents, I have been using a number of tools to try to stay secure from the NSA. The advice I shared included using Tor, preferring certain cryptography over others, and using public-domain encryption wherever possible. I also recommended using an air gap, which physically…
What’s going on in the brains of people who meditate? Anecdotal evidence suggests that meditation does something to people’s minds and bodies…quiets and calms t
Engineer
While dealing with big genetic data sets I often got stuck with limitation of programming languages in terms of reading big files. Also so...
An in-depth description of the React programming model.
How fast is my Whisper Benchmark with the MLX Framework from Apple? Nvidia 4090 / M1 Pro / M2 Ultra / M3
Explore the power of proper documentation in this comprehensive guide. Understand how documentation serves as a secret weapon for CTOs, eliminating guesswork, speeding up onboarding, and enhancing productivity in startups. We delve into the importance of documentation in knowledge sharing, reducing the need for…
This is The Entire Computer Science Curriculum in 1000 YouTube Videos. The curriculum is going to be organized in 40 courses in total, further organized in 4 academic years...
If you have a problem with maintainers getting paid then you have a problem with me and I suggest you let that one marinate.
A massive amount of reporting queries, whether really intensive data analysis, or just basic insights into your business involving looking at data over a certain time period. Postgres has really rich support for dealing with time out of the box, something that’s often very underweighted when dealing with a database…