Skip to content

Sebastian Raschka personal blog

Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)

by Sebastian Raschka, PhD magazine.sebastianraschka.com published 2023-11-19

Things I Learned From Hundreds of Experiments

Read on magazine.sebastianraschka.com → Discuss on HN (27) Archived copy

Points: 342
HN comments: 27
Submissions: 1
Cited by: 0 commenters

AI & Machine Learning Software Engineering 2023

On Hacker News

Submitted	Title on HN	Points	Comments
Nov 19, 2023	Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation) by rasbt	342	27

More from Sebastian Raschka

All 17 posts →

Building LLMs from the Ground Up: A 3-Hour Coding Workshop

2024970 points136 comments AI & Machine Learning details

Sebastian Raschka's from-scratch video course on building reasoning models

2026856 points116 comments AI & Machine Learning details

GPT-6 Astra, looped transformers, and hidden reasoning

2026521 points162 comments AI & Machine Learning details

GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2

2025490 points97 comments AI & Machine Learning details

Understanding Reasoning LLMs

2025473 points183 comments AI & Machine Learning details

LLM architecture comparison

2025418 points24 comments AI & Machine Learning details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

Building a Virtual Machine Inside ChatGPT

Jonas Degrave20222,029 points908 commentscited by 16 details

The man who killed Google Search?

Ed Zitron20241,884 points878 commentscited by 47 details

ChatGPT Plugins

OpenAI Blog20231,875 points1,106 commentscited by 14 details