The article examines the challenges in optimizing CUDA kernels due to the increasing demand for efficient AI computations. It shares insights from the DeepSeek team, who opted to write kernel codes using PTX instead of relying on Nvidia’s CUDA libraries. The piece references attempts by others to optimize kernels with AI, hinting at mixed results.