No article text was recorded for this version.
momentum-learning rate equivalence
Version 2 of 213 papers21 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Does Momentum Help in Stochastic Optimization? A Sample Complexity Analysis
- Blog: On the Influence of Momentum Acceleration on Online Learning
- Blog: Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks
- Blog: Optimal Stochastic Search and Adaptive Momentum
- Blog: The Two Regimes of Deep Network Training
- Blog: High-dimensional limit theorems for SGD: Momentum and Adaptive Step-sizes
- Blog: Rethinking the Hyperparameters for Fine-tuning
- Blog: The Marginal Value of Momentum for Small Learning Rate SGD
- Blog: Predicting Training Time Without Training
- Blog: When and Why Momentum Accelerates SGD: An Empirical Study
- Blog: Flatter, faster: scaling momentum for optimal speedup of SGD
- Blog: Short Paper - Quadratic minimization: from conjugate gradient to an adaptive Polyak’s momentum method with Polyak step-sizes
- Blog: A Unified Analysis of Stochastic Momentum Methods for Deep Learning
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_momentum_learning_rate_equivalence_019b1fff,
title = {momentum-learning rate equivalence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/momentum-learning-rate-equivalence/rdr_019b1fff9ff54706b4e733d90a12bb5f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 2, frozen text):
@misc{lacuna_momentum_learning_rate_equivalence_019b1fff_v2,
title = {momentum-learning rate equivalence},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/momentum-learning-rate-equivalence/rdr_019b1fff9ff54706b4e733d90a12bb5f/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}