How we reduced our CI YAML files from 1800 lines to 50 lines

This article illustrates how the Cauldron Machine Learning (ML) Platform team uses GitLab parent-child pipelines to dynamically generate GitLab CI files to solve several limitations of GitLab for large repositories, namely: Limitations to the number of includes (100 by default). Simplifying the GitLab CI file from 1800 lines to 50 lines. Reducing the need for nested gitlab-ci yml files. Introduction Cauldron is the Machine Learning (ML) Platform team at Grab. The Cauldron team provides tools f...

Submit