A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo

Serge Gratton, Philippe L. TointarXiv 2026 · DOI

BibTeX
@misc{gratton2026unified,
  author = {Serge Gratton and Philippe L. Toint},
  title = {{A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo}},
  year = {2026},
  eprint = {2604.17423},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.17423},
}

Loading related content...

Figure