{"id":"arxiv/2602.20126","url":"https://arxiv.org/abs/2602.20126","tags":["cs.LG","cs.IT","math.ST","stat.ML"],"score":0,"title":"Adaptation to Intrinsic Dependence in Diffusion Language Models","domain":"cs.LG","source":"arxiv","authors":["Yunxiao Zhao","Changxiao Cai"],"reviews":0,"subject":"cs.LG","summary":"Diffusion language models (DLMs) have recently emerged as a promising alternative to autoregressive (AR) approaches, enabling parallel token generation beyond a rigid left-to-right order. Despite growing empirical success, the theoretical understanding of how unmasking schedules -- which specify the order and size of unmasked tokens during sampling -- affect generation quality remains limited. In this work, we introduce a distribution-agnostic unmasking schedule for DLMs that adapts to the (unknown) dependence structure of the target data distribution, without requiring any prior knowledge…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-02-23","reactions":{}}