Blogs / Personal blogs

Arpit Bhayani

arpitbhayani.me

Principal Engineer II at Razorpay. Creator of DiceDB, Ex-staff Engg at GCP Memorystore & Dataproc, ex-Amazon Fast Data, ex-Director of Engg. SRE and Data Engineering at Unacademy. I spark engineering curiosity through my no-fluff engineering videos on YouTube and my courses.

Popular posts
4
Total points
738
HN comments
392
Rank
#3,196 personal

Visit arpitbhayani.me → RSS feedOn Hacker News Nov 2025 – Apr 2026

Systems & Performance 2Infrastructure & DevOps 2AI & Machine Learning 2Math & Algorithms 1Databases & Data 1

2

The Q, K, V Matrices

At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input. In this write-up, we will go through the construction of these matrices from the ground up.

3

Heartbeats in Distributed Systems

In distributed systems, one of the fundamental challenges is knowing whether a node or service is alive and functioning properly. Unlike monolithic applications, where everything runs in a single process, distributed systems span multiple machines, networks, and data centers. This becomes even glaring when the nodes…