Optimizing Pinterest’s Data Ingestion Stack: Findings and Learnings

1 · Pinterest · April 28, 2022, 3:50 p.m.
Ping-Min Lin | Software Engineer, Logging PlatformAt Pinterest, the Logging Platform team maintains the backbone of data ingestion infrastructure that ingests terabytes of data per day. When building the services powering these pipelines, it is extremely important that we build efficient systems considering how widespread and deep in the stack the systems are. Along our journey of continuous improvement, we’ve figured out basic but useful patterns and learnings that could be applied in general —...