Soul Player C64 is a transformer model running on a Commodore 64, showcasing a 2-layer decoder-only architecture with real multi-head self-attention, implemented in assembly language. It demonstrates the feasibility of running advanced machine learning models on vintage hardware.