Skip to content

Lightning AI Blog company blog

LoRA from scratch: implementation for LLM finetuning

lightning.ai

Read on lightning.ai → Discuss on HN (78) Archived copy

Points: 339
HN comments: 78
Submissions: 1
Cited by: 0 commenters

AI & Machine Learning Software Engineering 2024

On Hacker News

Submitted	Title on HN	Points	Comments
Jan 22, 2024	LoRA from scratch: implementation for LLM finetuning by rasbt	339	78

More from Lightning AI Blog

All 5 posts →

How to Finetune GPT-Like Large Language Models on a Custom Dataset

2023498 points122 comments AI & Machine Learning details

Takeaways from hundreds of LLM finetuning experiments with LoRA

2023258 points39 comments AI & Machine Learning details

Understanding, using, and finetuning Gemma

2024118 points48 comments AI & Machine Learning details

Finetuning LLMs on a Single GPU Using Gradient Accumulation

2023104 points3 comments AI & Machine Learning details

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

My AI skeptic friends are all nuts

Fly.io Blog20252,356 points2,826 commentscited by 13 details

Claude 3.7 Sonnet and Claude Code

Anthropic20252,127 points963 commentscited by 6 details

Claude 4

Anthropic20252,013 points1,170 comments details