Taming Outlier Tokens in Diffusion Transformers

Researchers identified and addressed the issue of outlier tokens in Diffusion Transformers used for image generation, which degrade performance by corrupting local patch semantics. They proposed Dual-Stage Registers (DSR) to mitigate these outliers, improving generation quality across ImageNet and text-to-image tasks.