salykova

salykova.github.io

making AI inference run really fast.

Popular posts: 2
Total points: 508
HN comments: 86
Rank: #5,050 personal

Visit salykova.github.io → RSS feedOn Hacker News Jul 2024 – Oct 2025

Systems & Performance 2 Software Engineering 2

Most points Most discussed Most cited Newest

Beating NumPy matrix multiplication in 150 lines of C

2024392 points81 comments Software Engineering details

A detailed blog post on optimizing multi-threaded matrix multiplication for x86 processors to achieve OpenBLAS/MKL-like performance. Tags: High-performance GEMM on CPU, Fast GEMM on CPU, High-performance matrix multiplication on CPU, Fast Matrix Multiplication on CPU, Matrix multiplication in C, GEMM in C, Matrix…

Matrix Core Programming on AMD GPUs

2025116 points5 comments Software Engineering details

In this blog post, we walk through how to use Matrix Cores in HIP kernels, with a focus on low-precision data types such as FP16, FP8, and FP4, as well as the new family of Matrix Core instructions with exponent block scaling introduced in the AMD CDNA™4 architecture. Through code examples and illustrations, we…