How to use AMD GPUs for model serving in OpenShift AI

15 · Red Hat · Oct. 8, 2024, 7:37 a.m.
Summary
As artificial intelligence and machine learning (AI/ML) workloads continue to grow, the demand for powerful, efficient hardware accelerators such as GPUs has become paramount. In this article, we will explore how to integrate and utilize AMD GPUs in Red Hat OpenShift AI for model serving. Specifically, we'll dive into how to set up and configure the AMD Instinct MI300X GPU with KServe in OpenShift AI.NoteThis is the third article in our series covering OpenShift AI capabilities on various AI acc...