Takeaways from hundreds of LLM finetuning experiments with LoRA
From the PyTorch Lightning creators. Own your AI, don't rent it. Lightning is the AI cloud to build, train, and deploy your own models on 36,000+ NVIDIA GPUs.
The latest blog posts to take off on Hacker News. 1,733 posts.
From the PyTorch Lightning creators. Own your AI, don't rent it. Lightning is the AI cloud to build, train, and deploy your own models on 36,000+ NVIDIA GPUs.
Recently, Valve announced that Counter-Strike 2 would no longer support macOS . As a one-man indie developer who has released a game supporting macOS , I find myself at first surprised at Valve’s decision. But after looking back at my own journey of supporting six platforms, I feel I can understand Valve’s perspective.
Can’t Be Fucked Aussie slang for not wanting to, or not having the energy and motivation to do something. “Man, i really can’t be fucked changing the channel, let’s just watch Springer.” - Urban Dictionary
We talk about programming like it is about writing code, but the code ends up being less important than the architecture, and the architecture ends up being less important than social issues.
A recent poll on the Lazarus/FPC forum highlighted a fact: pascal coders are older than most coders. Usually, at our age, we should be managers, not developers. But we like coding
These words cause problems as table or column name
I was working on a new installation where I didn’t have this in place yet and I kept trying to update a shell function, re-sourcing it but it never changed. Turns out it was loading from a backup~ of the same file.
In association with the release of curl 8.4.0, we publish a security advisory and all the details for CVE-2023-38545. This problem is the worst security problem found in curl in a long time. We set it to severity HIGH. While the advisory contains all the necessary details. I figured I would use a few additional ……
This function doesn't know the value being multiplied until it is called. The compiler (gcc, O2) emits a generic integer multiply instruction in its loop body.
We're launching the next major version of Lit
Hey there, it’s been a while! We’re back to share some more exciting news about Guile Hoot , a WebAssembly toolchain and Scheme→WASM compiler. In our last post we demonstrated that the Guile Hoot toolchain can be used to assemble programs written in WebAssembly Text (WAT) format, which allowed us to develop for the…
CRDTs sound cool, but how are they actually used? Let's learn by building a collaborative pixel art editor.
Island management is a fundamental low level feature of physics engines and can have a big impact on solver design and performance. This was one of the first problems I decided to work on for Box2D version 3 (v3). Since I began working on v3 I’ve been comparing several algorithms for island management. My goal has…
The jury got a taste of code review as they examined a falsified "insurance fund" and the infamous FTX → Alameda Research "backdoor".
A study by Google's DeepMind and the University of Illinois at Urbana-Champaign has found that self-correction in large language models (LLMs) isn't universally effective.
Posted by Andrew Walbran, Android Rust Team Last year we wrote about how moving native code in Android from C++ to Rust has resulted in ...
I couldn’t find a great tool for viewing disassembly, so I wrote it myself over the weekend.
A summary of highlights from the September 2023 release of Chapel 1.32.0
I have been working on a hobby project to reimagine the C core of Emacs in Rust. On this journey, I reached the point where I needed some way to represent the text of a buffer. The simplest approach is to just use a large string or array of lines. However these each suffer from poor performance as either the size or…
Checking my assumptions about syncable data structures
This has been a ground-breaking year for my C skills, and paradigm shifts in my technique has provoked me to reconsider my habits and coding style. It’s been my largest personal style change in years, so I’ve decided to take a snapshot of its current state and my reasoning. These changes have produced significant…
I am about to turn forty-six. This means I have been programming for forty years, half of them professionally. During most of that time, I used a "standard" setup with 104 keyboard, a flat mouse, and a sitting desk.
Many projects are littered with files that just re-export other files. These so called "barrel files" are one of the key reasons why JavaScript tooling is slow in bigger projects.
I recently watched GOTO conferences' talk Calling Functions Across Languages by Richard Feldman. I’m afraid I have to disagree with using the term 'language' in this context. It’s a no-brainer to call Java from Kotlin or Scala or to call Java from Kotlin. Hence, in the rest, I’ll use 'stack'.
A version of Flappy Bird that runs entirely inside MacOS Finder. It runs at 4 frames a second! That's a lot of frames!!
Debian is a large, complex operating system, and a huge open source project. It's thirty years old now. To many people, some of its aspects are weird. Most such things have a good reason, but it can be hard to find out what it is. This is an attempt to answer some such questions, without being a detailed history of…
To be precise, IEEE-754 floating point subtraction is functionally complete . That means you can construct any binary circuit using nothing but floating point subtraction.
This is lobste.rs comment as an article, so expect even more abysmal editing than usual.