EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing – Hoffeldt
1 Articles
1 Articles
EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing – Hoffeldt
Apple Machine Learning Research Diffusion transformers have been widely adopted for text-to-image synthesis. While scaling these models up to billions of parameters shows promise, the effectiveness of scaling beyond current sizes remains underexplored and challenging. By explicitly exploiting the computational heterogeneity of image generations, we develop a new family of Mixture-of-Experts (MoE) models (EC-DIT) for diffusion transformers with …
Coverage Details
Bias Distribution
- There is no tracked Bias information for the sources covering this story.
To view factuality data please Upgrade to Premium
Ownership
To view ownership data please Upgrade to Vantage