A GPU cluster is a network of interconnected graphics processing units (GPUs) that work together for high-performance computing tasks. This architecture is essential for applications requiring intensive computation, such as machine learning and simulations.