Fast and Effective On-policy Distillation from Reasoning Prefixes

Dongxu Zhang, Zhichao Yang, Sepehr Janghorbani, Jun Han, Andrew Ressler Ii, Qian Qian, Gregory D. Lyng, Sanjit Singh Batra, Robert E. Tillman

BibTeX
@inproceedings{zhang2026fast,
  author = {Dongxu Zhang and Zhichao Yang and Sepehr Janghorbani and Jun Han and Andrew Ressler II and Qian Qian and Gregory D. Lyng and Sanjit Singh Batra and Robert E. Tillman},
  title = {{Fast and Effective On-policy Distillation from Reasoning Prefixes}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1276},
}
Figure