Shallow Mirror

1 · Pinterest · May 10, 2021, 11:04 p.m.
Enhancement to Kafka MirrorMaker to reduce CPU/memory pressureHenry Cai | Software Engineer, Data EngineeringPinterest uses Kafka as the backbone for data transportation. As a part of our infrastructure, Kafka MirrorMaker v1 is used to replicate traffic among different Kafka clusters spread across multiple regions. Kafka MirrorMaker is a powerful tool to replicate/aggregate data between different Kafka clusters. Figure-1 shows a typical setup to use the MirrorMaker to replicate traffic between t...