Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation

Xingyu Su, Jacob Helwig, Shubham Parashar, Atharv Chagi, Lakshmi Jotsna, Degui Zhi, James Caverlee, Dileep Kalathil, Shuiwang JiarXiv 2026 · DOI

BibTeX
@misc{su2026data,
  author = {Xingyu Su and Jacob Helwig and Shubham Parashar and Atharv Chagi and Lakshmi Jotsna and Degui Zhi and James Caverlee and Dileep Kalathil and Shuiwang Ji},
  title = {{Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation}},
  year = {2026},
  doi = {10.48550/arxiv.2606.06712},
}

Loading related content...

Figure