HTMuon: Improving Muon via Heavy-Tailed Spectral Correction

Tianyu Pang, Yujie Fang, Zihang Liu, Shenyang Deng, Lei Hsiung, Shuhua Yu, Yaoqing Yang

BibTeX
@inproceedings{pang2026htmuon,
  author = {Tianyu Pang and Yujie Fang and Zihang Liu and Shenyang Deng and Lei Hsiung and Shuhua Yu and Yaoqing Yang},
  title = {{HTMuon: Improving Muon via Heavy-Tailed Spectral Correction}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1819},
}
Figure