No article text was recorded for this version.
linear learning rate scaling
Version 1 of 111 papers19 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
- Blog: Accelerating the Training of Video Super-resolution Models
- Blog: Rectified linear neural networks with tied-scalar regularization for LVCSR
- Blog: FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters
- Blog: A Bayesian Perspective on Generalization and Stochastic Gradient Descent
- Blog: A Hitchhiker's Guide On Distributed Training Of Deep Neural Networks
- Blog: Efficient GPU-based training of recurrent neural network language models using spliced sentence bunch
- Blog: Stochastic Gradient Descent on Separable Data: Exact Convergence with a Fixed Learning Rate
- Blog: A Multigrid Method for Efficiently Training Video Models
- Blog: Finding Flatter Minima with SGD
- Blog: Convergence of Riemannian stochastic gradient descent on Hadamard manifold
History & citation
Current · Permanent link
- This direction split from Linear Scaling of Learning Rates for Large Batch Training (55% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_linear_learning_rate_scaling_6cc7b184,
title = {linear learning rate scaling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-learning-rate-scaling/rdr_6cc7b184a5bc4a3a839365d2020421eb},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_linear_learning_rate_scaling_6cc7b184_v1,
title = {linear learning rate scaling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-learning-rate-scaling/rdr_6cc7b184a5bc4a3a839365d2020421eb/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}