Discrete Drifting: Generative Modeling via Discrete Wasserstein Flows
Abstract
We introduce Discrete Drifting, a framework for one-step generative modelling on finite state spaces. To extend drifting beyond continuous domains, we use the discrete Wasserstein geometry of Maas [2011] to define a target-relative KL gradient flow over the transitions of a reversible Markov kernel. We realize this probability flow at the particle level through Markov jumps and amortize the resulting transport updates into a latent-conditioned generator, so that the iterative dynamics are required only during training while inference remains one-step. In a controlled setting where the underlying distributions and transport dynamics can be computed exactly, we verify KL dissipation, consistency between the particle dynamics and the probability flow, and the predicted numerical scaling. We further show that a finite-capacity neural generator can track these exact transport targets while retaining one-step generation. These results validate the basic construction and provide a foundation for scaling Discrete Drifting to structured discrete data.