Abishek Muthian personal blog

How I run LLMs locally

abishekmuthian.com published 2024-12-295 min read

I document how I run Large Language Models locally.

Points

400

HN comments

231

Submissions

1

Cited by

0 commenters

AI & Machine LearningTools & Productivity2024

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

My AI skeptic friends are all nuts

Fly.io Blog20252,356 points2,826 commentscited by 13 details

Claude 3.7 Sonnet and Claude Code

Anthropic20252,127 points963 commentscited by 6 details

Claude 4

Anthropic20252,013 points1,170 comments details