No article text was recorded for this version.
linear learning rate decay
Version 1 of 131 papers43 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker Conditions
- Blog: Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs
- Blog: Online Learning from Finite Training Sets: An Analytical Case Study
- Blog: Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth Games: Convergence Analysis under Expected Co-coercivity
- Blog: Sharp asymptotic theory for Q-learning with \texttt{LD2Z} learning rate and its generalization
- Blog: When, Why and How Much? Adaptive Learning Rate Scheduling by Refinement
- Blog: The Successful Ingredients of Policy Gradient Algorithms
- Blog: How Important is Importance Sampling for Deep Budgeted Training?
- Blog: SGD with Arbitrary Sampling: General Analysis and Improved Rates
- Blog: Two Approaches to Optimal Annealing
- Blog: Asymptotic theory of SGD with a general learning-rate
- Blog: Budgeted Training: Rethinking Deep Neural Network Training Under Resource Constraints
- Blog: No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
- Blog: SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models
- Blog: Making the Last Iterate of SGD Information Theoretically Optimal
- Blog: OLMo: Accelerating the Science of Language Models
- Blog: Optimal Learning-Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay
- Blog: On Stochastic Gradient and Subgradient Methods with Adaptive Steplength Sequences
- Blog: Unleashing the Potential of Regularization Strategies in Learning with Noisy Labels
- Blog: Distributed stochastic optimization under imperfect information
- Blog: Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities
- Blog: SGD: General Analysis and Improved Rates
- Blog: Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules
- Blog: An optimal scheduled learning rate for a randomized Kaczmarz algorithm
- Blog: Towards Faster Stochastic Gradient Search
- Blog: How I Learned to Stop Worrying and Love Retraining
- Blog: Mini-batch stochastic subgradient for functional constrained optimization
- Blog: Parallel computing subgradient method for nonsmooth convex optimization over the intersection of fixed point sets of nonexpansive mappings
- Blog: On-line Learning of Dichotomies
- Blog: A safe-enhanced fully closed-loop artificial pancreas controller based on deep reinforcement learning
- Blog: REX: Revisiting Budgeted Training with an Improved Schedule
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_linear_learning_rate_decay_36cabde1,
title = {linear learning rate decay},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-learning-rate-decay/rdr_36cabde19ff34a59b5edc72f75980bf2},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_linear_learning_rate_decay_36cabde1_v1,
title = {linear learning rate decay},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-learning-rate-decay/rdr_36cabde19ff34a59b5edc72f75980bf2/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}