Your SDXL is a slow learner

1 ยท Norm Inui ยท Jan. 20, 2024, 4:44 p.m.
Summary
WIP ๐Ÿšง TL; DR Fine-tuning SDXL UNET with high-quality datasets can enhance the AES score of generated images, but there is a limitation to this improvement. Specifically, you can easily upgrade the AES score of SDXL-base, which is initially aesthetically evaluated as 6.0, to reach a score of 6.7. However, a further enhancement in the AES score becomes significantly limited, even tuning on a high-quality dataset whose average AES score exceed 7.5 with many steps. High-quality fine-tuning can...