No article text was recorded for this version.
gradient noise floor
Version 1 of 139 papers47 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima
- Blog: Exploring the Inefficiency of Heavy Ball as Momentum Parameter Approaches 1
- Blog: New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Results
- Blog: On the Convergence of DP-SGD with Adaptive Clipping
- Blog: Spend Wisely: Maximizing Post-Training Gains in Iterative Synthetic Data Bootstrapping
- Blog: Nonlinear Acceleration of Stochastic Algorithms
- Blog: An Optimal Multistage Stochastic Gradient Method for Minimax Problems
- Blog: Two Time-scale Off-Policy TD Learning: Non-asymptotic Analysis over Markovian Samples
- Blog: Training Structured Neural Networks Through Manifold Identification and Variance Reduction
- Blog: High Probability Complexity Bounds for Line Search Based on Stochastic Oracles
- Blog: Fundamental Convergence Analysis of Sharpness-Aware Minimization
- Blog: Rivalry of Two Families of Algorithms for Memory-Restricted Streaming PCA
- Blog: Analysis of regularized federated learning
- Blog: Improved Robust Algorithms for Learning with Discriminative Feature Feedback
- Blog: Both Asymptotic and Non-Asymptotic Convergence of Quasi-Hyperbolic Momentum using Increasing Batch Size
- Blog: Stochastic Gradient Langevin Dynamics with Variance Reduction
- Blog: Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks
- Blog: Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks
- Blog: Stochastic Composite Least-Squares Regression with Convergence Rate $O(1/n)$
- Blog: Polishing Decision-Based Adversarial Noise With a Customized Sampling
- Blog: Removing Noise in On-Line Search using Adaptive Batch Sizes
- Blog: Robust and Communication-Efficient Collaborative Learning
- Blog: How Free is Parameter-Free Stochastic Optimization?
- Blog: Backward error analysis and the qualitative behaviour of stochastic optimization algorithms: Application to stochastic coordinate descent
- Blog: Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
- Blog: Towards Faster Stochastic Gradient Search
- Blog: Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization
- Blog: The Effect of Network Width on Stochastic Gradient Descent and Generalization: an Empirical Study
- Blog: (Accelerated) Noise-adaptive Stochastic Heavy-Ball Momentum
- Blog: Robust Decentralized Learning Using ADMM With Unreliable Agents
- Blog: SGD with Arbitrary Sampling: General Analysis and Improved Rates
- Blog: Derivatives of Stochastic Gradient Descent in parametric optimization
- Blog: Stochastic Reweighted Gradient Descent
- Blog: Level Set Teleportation: the Good, the Bad, and the Ugly
- Blog: Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution
- Blog: Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
- Blog: Convergence Analysis of a Proximal Stochastic Denoising Regularization Algorithm
- Blog: On Convergence-Diagnostic based Step Sizes for Stochastic Gradient Descent
- Blog: A Tight Convergence Analysis of Inexact Stochastic Proximal Point Algorithm for Stochastic Composite Optimization Problems
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_gradient_noise_floor_66f9ddab,
title = {gradient noise floor},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gradient-noise-floor/rdr_66f9ddab3c6c48b0a938c8810a6f2e80},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_gradient_noise_floor_66f9ddab_v1,
title = {gradient noise floor},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gradient-noise-floor/rdr_66f9ddab3c6c48b0a938c8810a6f2e80/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}