No article text was recorded for this version.
stale gradient optimization
Version 1 of 126 papers29 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Asynchronous Doubly Stochastic Group Regularized Learning
- Blog: A Class of Parallel Doubly Stochastic Algorithms for Large-Scale Learning
- Blog: Asynchronous Accelerated Stochastic Gradient Descent
- Blog: Asynchronous stochastic optimization for sequence training of deep neural networks: towards big data
- Blog: Asynchronous Incremental Stochastic Dual Descent Algorithm for Network Resource Allocation
- Blog: New Convergence Aspects of Stochastic Gradient Algorithms
- Blog: Asynchronous Coordinate Descent under More Realistic Assumptions
- Blog: Advances in Asynchronous Parallel and Distributed Optimization
- Blog: Strategies and Principles of Distributed Machine Learning on Big Data
- Blog: On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants
- Blog: SGD and Hogwild! Convergence Without the Bounded Gradients Assumption
- Blog: Taming the Wild: A Unified Analysis of Hogwild-Style Algorithms
- Blog: An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization
- Blog: A Tight Convergence Analysis for Stochastic Gradient Descent with Delayed Updates
- Blog: Slow Learners are Fast
- Blog: Communication-Efficient Asynchronous Stochastic Frank-Wolfe over Nuclear-norm Balls
- Blog: Asynchronous and Parallel Distributed Pose Graph Optimization
- Blog: Differential Equations for Modeling Asynchronous Algorithms
- Blog: Ouroboros: On Accelerating Training of Transformer-Based Language Models
- Blog: Asynchronous Distributed Variational Gaussian Process for Regression
- Blog: Parallel and distributed asynchronous adaptive stochastic gradient methods
- Blog: Empirical Evaluation of Parallel Training Algorithms on Acoustic Modeling
- Blog: Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems
- Blog: No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation
- Blog: Accumulated Decoupled Learning with Gradient Staleness Mitigation for Convolutional Neural Networks
- Blog: Asynchronous Mini-Batch Gradient Descent with Variance Reduction for Non-Convex Optimization
History & citation
Current · Permanent link
- This direction split from Staleness Mitigation in Asynchronous Federated Learning (88% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_stale_gradient_optimization_bc25d3f6,
title = {stale gradient optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/stale-gradient-optimization/rdr_bc25d3f6b21b4188adeeb39483c0f630},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_stale_gradient_optimization_bc25d3f6_v1,
title = {stale gradient optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/stale-gradient-optimization/rdr_bc25d3f6b21b4188adeeb39483c0f630/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}