Adding my two cents on this (awesome) paper. I think the reason I (and many others) would intuitively expect this not to work is that we imagine minibatch OT “shattering” the latent space: some parts of the noise correspond to 3s, others to 4s, etc, etc. 1/n
New preprint: 🚀 Global Transport (GT) couplings for classifier-free guided flows!
Surprisingly, a simple label-free optimal transport coupling beats both class-conditional OT and independent couplings once we push the CFG scale up 🧗 reaching 1.91 FID on ImageNet-256