👩💻 Join our community of thousands of amazing developers!
Yu Yang | Software Engineer, Data EngineeringAt Pinterest, we use data to guide product decisions and ultimately improve the Pinner experience. In an earlier post, we shared the design of Pinterest’s data ingestion framework. The first step of data ingestion and data-driven decision making is data collection.At first glance, data collection seems simple: it’s just about uploading data from hosts to a central repository. However, in order to collect data from tens of thousands of hosts in various...