ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples

Kexin Huang, Junkang Wu, Jinda Lu, Shuo Yang, Chiyu Ma, Jiancan Wu, Xiang Wang, Xiangnan He, Guoyin Wang, Jingren ZhouarXiv 2026 · DOI

BibTeX
@misc{huang2026armor,
  author = {Kexin Huang and Junkang Wu and Jinda Lu and Shuo Yang and Chiyu Ma and Jiancan Wu and Xiang Wang and Xiangnan He and Guoyin Wang and Jingren Zhou},
  title = {{ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples}},
  year = {2026},
  eprint = {2607.10481},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2607.10481},
}

Loading related content...

Figure