{"id":"arxiv/2611.01965","url":"https://arxiv.org/abs/2611.01965","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"OC-OPD: Observation-coordinated Supervision for On-Policy Distillation","domain":"cs.LG","source":"arxiv","authors":["Ruoran Xu","Yilun Zhao","Ziyu Chen","Arman Cohan"],"reviews":0,"subject":"cs.LG","summary":"Reverse and forward Kullback--Leibler (KL) divergences provide complementary supervision in on-policy distillation: reverse KL refines the student's active token rankings, and forward KL allocates mass to teacher-supported candidates. At student-generated prefixes, we form a four-observation matrix by treating the student and teacher as both candidate sources and evaluators. The diagonal self-observations measure uncertainty, while source-centered cross-observations recover the two KL objectives. We establish an exact identity equating the Fisher inverse-metric coupling of their logit…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-01","reactions":{}}