Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-Tailed Noise and Power of Symmetry

Aleksandar Armacki, Shuhua Yu, Dragana Bajovic, Dusan Jakovetic, Soummya Kar

BibTeX
@article{armacki2026large,
  author = {Aleksandar Armacki and Shuhua Yu and Dragana Bajovic and Dusan Jakovetic and Soummya Kar},
  title = {{Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-Tailed Noise and Power of Symmetry}},
  journal = {SIAM J. Optim.},
  year = {2026},
  doi = {10.1137/24m1704154},
}
Figure