API-First Approach to Kafka Topic Creation

1 · DoorDash · Dec. 5, 2023, 2:47 p.m.
Summary
DoorDash’s Engineering teams revamped Kafka Topic creation by replacing a Terraform/Atlantis based approach with an in-house API, Infra Service. This has reduced real-time pipeline onboarding time by 95% and saved countless developer hours. DoorDash’s Real-Time Streaming Platform, or RTSP, team is under the Data Platform organization and manages over 2,500 Kafka Topics across five clusters. ... The post API-First Approach to Kafka Topic Creation appeared first on DoorDash Engineering Blog....