John's Personal Website

My personal blog where I talk way too much about computers

Popular posts: 2
Total points: 821
HN comments: 202
Rank: #2,785 personal

Visit johnthenerd.com → RSS feedOn Hacker News Jan 2024 – Jun 2024

Tools & Productivity 2 AI & Machine Learning 2

Most points Most discussed Most cited Newest

Building a fully local LLM voice assistant to control my smart home

2024699 points186 comments AI & Machine Learning details

I’ve had my days with Siri and Google Assistant. While they have the ability to control your devices, they cannot be customized and inherently rely on cloud services. In hopes of learning something new and having something cool I could use in my life, I decided I want better. The premises are simple: I want my new…

Making my local LLM voice assistant faster and more scalable with RAG

2024122 points16 comments AI & Machine Learning details

If you read my previous blog post, you probably already know that I like my smart home open-source and very local, and that certainly includes any voice assistant I may have. If you watched the video demo, you have probably also found out that it’s… slow. Trust me, I did too. Prefix caching helps, but it feels like…