Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation

Yuxuan Jiang, Runchao Li, Shubhashis Roy Dipta, Dawei Li, Zhao YangarXiv 2026 · DOI

BibTeX
@misc{jiang2026cornerstones,
  author = {Yuxuan Jiang and Runchao Li and Shubhashis Roy Dipta and Dawei Li and Zhao Yang},
  title = {{Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation}},
  year = {2026},
  eprint = {2605.09253},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2605.09253},
}

Loading related content...

Figure