How Shopify Manages Petabyte Scale MySQL Backup and Restore

1 · Shopify · Oct. 1, 2019, 3:17 p.m.
At Shopify, we run a large fleet of MySQL servers, with numerous replica-sets (internally known as “shards”) spread across three Google Cloud Platform (GCP) regions. Given the petabyte scale size and criticality of data, we need a robust and efficient backup and restore solution. We drastically reduced our Recovery Time Objective (RTO) to under 30 minutes by redesigning our tooling to use disk-based snapshots, and we want to share how it was done. Challenges with Existing Tools For several years...