Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 3,824 posts.
Things I Learned From Hundreds of Experiments
My daughter found my Psion 3a the other day, tucked at the back of a cupboard she was clearing out for me. It looked fine and is still in excellent aesthetic condition, and fortunately I had left n…
4 Years In, OpenTelemetry Delivers on its Promise for Open Observability
(If you just want some recommendations for what to do, skip down to the Recommendations section below .)
This is a write-up of the wInd3x bootrom exploit affecting iPod Nanos from 3rd gen to 5th gen. A ready-made tool to use this exploit is available at github.com/freemyipod/wInd3x .
In late 2021, I had solar panels installed onto the roof of my house. After some bureaucratic delays, the solar panels began producing electricity for me at the beginning of January 2022. I have been tracking the performance of the panels for the last year in order to assess what the financial impact of the panels is…
When a user moves their mouse from the middle of the page toward the navigation bar — presumably to abandon the page — there are technologies which can track this behavior and trigger a “mouse-out” alert. While this UX element (from companies such as Crazy Egg and Rooster) has great potential, I’ve found it far too…
Bear Blog has a few design constraints for speed, efficiency, and stability. There are many great open-source, privacy-focussed analytics platforms out there...
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
Organic Maps impressed me with its elegant UI, effective routing, and good ethics.
An alternative to pprint for generically visualizing heterogeneous, hierarchical data
There are at least two kinds of catastrophe scenarios, and both are getting more plausible
Why does 0.1 + 0.2 = 0.30000000000000004?
Ever since I tried ChatGPT and GPT-3, everything else feels painfully dumb and useless: Siri, Alexa, Google Home and all other “smart”…
How the value of π depends on the definition of distance.
(More general advice on going to talks is here . As with all my webpages, feedback is more than welcome!)
Using Stable Diffusion techniques to create 2D game environments
An article on why IRC is still the only chat protocol worth using, and a positive look at the surprisingly autistic-friendly Microsoft Comic Chat IRC client.
Dafny is a programming language which often genuinely amazes me.
How to use the telnet command on the bash command line to debug network problems.
Fastest general and simple binary search C++ implementation
In association with the release of curl 8.4.0, we publish a security advisory and all the details for CVE-2023-38545. This problem is the worst security problem found in curl in a long time. We set it to severity HIGH. While the advisory contains all the necessary details. I figured I would use a few additional ……
Sleep is important. People vastly underestimate the extent to which not sleeping is harmful, viewing it as a valid trade off for productivity and overlooking all of the longterm negative effects.
Taking LSD was a profound experience, one of the most important things in my life. […] – Steve Jobs, co-founder of Apple
Or: A comprehensive ecosystem of open-source software for big data management
I’d read a few times that bringing the temperature of a failing drive down will increase its reliability long enough to salvage important files. When the drive in my trusty Powerbook decided one day last week to stop booting and make horrible clicking sounds, I decided to test the theory.
The bug lies in closed-source Google-proprietary code so it’s a bit hard to inspect, but after some patch-diffing I concluded that the root cause was due to this horrible bit of API ‘design’: https://issuetracker.google.com/issues/180526528 .