Gang autoscaling on OpenShift with Kueue and ProvisionRequest

132 · Red Hat · June 8, 2026, 7:22 a.m.
Summary
This blog post discusses the implementation of gang autoscaling in OpenShift using Kueue and the ProvisionRequest API, addressing challenges in scheduling distributed workloads such as AI/ML and HPC. It emphasizes the efficiency of resource utilization and how proper configuration can prevent waste and improve performance. Additionally, it hints at future explorations for autoscaling inference workloads.