No article text was recorded for this version.
initial iterate bias
Version 1 of 117 papers17 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Understanding SGD with Exponential Moving Average: A Case Study in Linear Regression
- Blog: On Projected Stochastic Gradient Descent Algorithm with Weighted Averaging for Least Squares Regression
- Blog: From Averaging to Acceleration, There is Only a Step-size
- Blog: Finite time analysis of temporal difference learning with linear function approximation: Tail averaging and regularisation
- Blog: On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averaging
- Blog: Parallelizing Stochastic Gradient Descent for Least Squares Regression: Mini-batching, Averaging, and Model Misspecification
- Blog: Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes
- Blog: Competing with the Empirical Risk Minimizer in a Single Pass
- Blog: Stochastic Bias-Reduced Gradient Methods
- Blog: Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise
- Blog: Statistical Sparse Online Regression: A Diffusion Approximation Perspective
- Blog: Beating SGD Saturation with Tail-Averaging and Minibatching
- Blog: Accelerating Stochastic Gradient Descent for Least Squares Regression
- Blog: Increasing Iterate Averaging for Solving Saddle-Point Problems
- Blog: Averaged Least-Mean-Squares: Bias-Variance Trade-offs and Optimal Sampling Distributions
- Blog: Accelerated SGD for Non-Strongly-Convex Least Squares
- Blog: Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization
History & citation
Current · Permanent link
- This direction split from Tail Averaging for Optimal Stochastic Convergence (76% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_initial_iterate_bias_57136393,
title = {initial iterate bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/initial-iterate-bias/rdr_57136393bc8a453da0ac38f264581b74},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_initial_iterate_bias_57136393_v1,
title = {initial iterate bias},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/initial-iterate-bias/rdr_57136393bc8a453da0ac38f264581b74/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}