{"id":"arxiv/2605.17232","url":"https://arxiv.org/abs/2605.17232","tags":["cs.LG","math.ST","stat.ML"],"score":0,"title":"Vocabulary-size-independent Convergence of Discrete Diffusion Models: adjoint equations induce the right space","domain":"cs.LG","source":"arxiv","authors":["Kelvin Kan","Xingjian Li","Benjamin J. Zhang","Tuhin Sahai","Stanley Osher","Markos A. Katsoulakis"],"reviews":0,"subject":"cs.LG","summary":"Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge under singular priors such as the masked distribution, while bounds in total variation (TV) depend on the vocabulary size $S$ and become vacuous for modern language tasks, where vocabularies contain hundreds of thousands of tokens. We develop a unified adjoint-equation-based framework that establishes vocabulary-size-independent convergence guarantees in any…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-17","reactions":{}}