Spotify Engineering

engineering.atspotify.com

Our R&D teams tell the stories behind how we build at Spotify. AI, mobile, web, data science, experimentation, developer tools, design, open source, and more.

Popular posts: 5
Total points: 928
HN comments: 546
Rank: #1,411 company

Visit engineering.atspotify.com → On Hacker News Feb 2021 – Sep 2026

Tools & Productivity 2 Software Engineering 2 Infrastructure & DevOps 2 Databases & Data 2 Networking & Internet 1 AI & Machine Learning 1

Most points Most discussed Most cited Newest

Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020

2021196 points125 comments Databases & Data details

In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, , for using a technique called Sort Merge Bucket (SMB) join. We’ll present the design and implementation of SMB and how we incorporated it into our data pipelines.

How to Shuffle Songs? (2014)

202378 points64 commentscited by 11Software Engineering details