Unveiling the Core of Instacart’s Griffin 2.0: A Deep Dive Into the Model Serving PlatformAuthors: Zihan Li, Joseph Haraldson, Adway Dhillon, Keith Lazuka, Vaibhav Agarwal, James Matthews, Sahil Khanna, Rajpal ParyaniBackgroundModel serving is a critical step in the machine learning life cycle in which a trained model is deployed to a production environment as a web service to process input data, perform inference, and provide real-time predictions for various applications. Effective model servi...