AWS Blog company blog

Amazon's exabyte-scale migration from Apache Spark to Ray on EC2

Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially…
Points
291
HN comments
90
Submissions
1
Cited by
0 commenters

Databases & DataOpen Source2024

On Hacker News

SubmittedTitle on HNPointsComments
Jul 29, 2024Amazon's exabyte-scale migration from Apache Spark to Ray on EC2 by nojito29190

More from AWS Blog

All 246 posts →

Related posts from the same era