Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Things I Learned From Hundreds of Experiments
The latest blog posts to take off on Hacker News. 1,733 posts.
Things I Learned From Hundreds of Experiments
In this essay, Carson Gross explores his preference for separating JSON and hypermedia APIs instead of using content negotiation, a feature in HTTP that allows clients to request different formats (e.g., HTML, JSON). He discusses the limitations of content negotiation in APIs, especially when mixing stable, versioned…
I cancelled my annual Replit Hacker plan and I'll let it lapse at the end of December of 2023. Replit is a popular and growing multi lan...
I was going through the release notes of the new Python 3.12 version the other day, and one item caught my attention in the deprecations section:datetime.datetime’s utcnow() and utcfromtimestamp()…
Here’s everything you need to know to build your first LLM app and problem spaces you can start exploring today.
A Lindemayer system or LSystem for short consists of an alphabet of symbols that can be used to make strings, a collection of production that expand each symbol into some larger string of symbols, an initial “axiom” string from which to begin construction, and a mechanism for translating the generated strings into…
Even though I don't respect podcasts as an information delivery system, I recently listened to a podcast that felt like having an epiphany.
Some of us in the GTK team have spent the last month or so exploring the world of linux kernel graphics apis, in particular, dmabufs. We are coming back from this adventure with some frustrations and some successes. What is a dmabuf? A dmabuf is a memory buffer in kernel space that is identified by...
Magic Mouse hack with USB-C charger
Rocket is a web framework for the Rust programming language that makes it simple to write fast web applications without sacrificing flexibility or type safety.
A look into the implementation details of CPython's Global Interpreter Lock (GIL) and how they changed between Python 3.9 and the current development branch that will become Python 3.13.
ChatGPT is a bullshit generator. To understand AI, we should think harder about bullshit
An in-depth analysis of how World of Warships obfuscates its game scripts and how to mostly deobfuscate them automatically.
Uber has widely adopted Golang (Go for short) as a primary programming language for implementing backend services and libraries due to its high performance. The Go monorepo is the largest codebase at Uber, comprising 90 million lines of code (and growing). This makes tooling for writing reliable Go code a critical…
The pganalyze Indexing Engine simulates hundreds of possible combinations to recommend missing Postgres indexes using its 'What if?' analysis.
I analyzed stackoverflow for secrets and leaks.
In my article on HTML web components , I said: But the unique power of web components (in the browser) is that they can render before JavaScript. React…
You don’t need CRDTs You don’t need CRDTs for collaborative experiences. First lets get the ‘what-about-ery’ out the way… Things you do need CRDTs for …
A short note on two related rules of thumb.
But, I guess he did win the Nobel Prize for Physics in 2020 so I can't really brag. However, it was a great surprise when looking at two pa...
In a recent pull-request for curl, I clarified to the contributor that their change would only be accepted and merged into curl's git code repository if they made sure that the change was done in a way so that it did not break (testing) for and on legacy platforms. In that thread, I could almost … Continue reading…
Introduction Recently, I watched a video by YouTuber ThePrimeTime which details a dev’s frustrations with business culture. Prime is an ex-entrepreneur who currently works in software development at Netflix. His views in this video have been criticised for being jaded by FAANG business cultures he has worked in. I…
Curious what the first ‘unused’ alphabetic acronym is, I have GPT-4 write a script to check English Wikipedia. After three bugs, the first unused one turns out as of 2023-09-29 to be the three-letter acronym ‘CQK’, with another 2.6k TLA unused, and 393k four-letter acronyms unused. Exploratory analysis suggests…
This year, the YJIT team and I have gotten a paper accepted at MPLR 2023 (Managed Programming Languages and Runtimes), which is now freely available through ACM open access. The paper, titled “Evaluating YJIT’s Performance in a Production Context: A Pragmatic Approach”, goes into details of the strategy taken to…
Today Microsoft announced the availability of .NET 8, the latest version of one of the world’s leading programming languages and development platforms.