Insights, analysis, and product updates from Meltwater engineers and data teams.
Visit underthehood.meltwater.com → RSS feedOn Hacker News Jun 2016 – Nov 2022
Systems & Performance 2Databases & Data 2Software Engineering 1Career & Management 1
Back in 2018, now five years ago, we published a blog post describing our 400+ node Elasticsearch cluster. In that post we brought up an important topic: So far, we have elected to not upgrade the cluster. We would like to, but so far there have been more urgent tasks. How we actually perform the upgrade is undecided…
At the heart of Meltwater’s and Fairhair.ai’s information retrieval systems lies a collection of Elasticsearch clusters containing billions of social media posts and editorial articles. The index shards in our clusters vary greatly in their access pattern, workload and size which presents some very interesting…