Comparing BigQuery Processing and Spark Dataproc

1 · PayPal · Sept. 22, 2021, 1:10 p.m.
By Aride Chettali, Vignesh Raj, Sneha Prabhu and Vivek PathanePhoto by Shahadat Rahman on UnsplashIntroductionCurrently, PayPal is in the process of migrating its analytical workloads to Google Cloud Processing (GCP). In this post, I will cover the different approaches we evaluated for migrating our processes from on-prem to GCP.We run a number of Spark jobs for processing analytical data in PayPal. These jobs collect behavioral data from the website and repackage them in a consumable format for...