No article text was recorded for this version.
anisotropic gradient noise
Version 1 of 120 papers34 conceptsfrozen 2026-10-04
Papers in this version
- Blog: The Noise Geometry of Stochastic Gradient Descent: A Quantitative and Analytical Characterization
- Blog: A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima
- Blog: The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects
- Blog: The alignment property of SGD noise and how it helps select flat minima: A stability analysis
- Blog: Noisy Truncated SGD: Optimization and Generalization
- Blog: Escaping Saddles with Stochastic Gradients
- Blog: Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning
- Blog: Stochastic Modified Equations and Dynamics of Dropout Algorithm
- Blog: Does SGD really happen in tiny subspaces?
- Blog: Entropic Confinement and Mode Connectivity in Overparameterized Neural Networks
- Blog: Second-Order Guarantees of Stochastic Gradient Descent in Nonconvex Optimization
- Blog: Sample Complexity of Policy Gradient Finding Second-Order Stationary Points
- Blog: Escaping Saddle Points Faster with Stochastic Momentum
- Blog: SDEs for Minimax Optimization
- Blog: A Variational Analysis of Stochastic Gradient Algorithms
- Blog: Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
- Blog: Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum
- Blog: Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations
- Blog: SGD Can Converge to Local Maxima
- Blog: The Heavy-Tail Phenomenon in SGD
History & citation
Current · Permanent link
- This direction split from Curvature Dependent Noise and Flatness Selection (85% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_anisotropic_gradient_noise_2f42cb73,
title = {anisotropic gradient noise},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/anisotropic-gradient-noise/rdr_2f42cb73eb274b35ac1a7d05923eae95},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_anisotropic_gradient_noise_2f42cb73_v1,
title = {anisotropic gradient noise},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/anisotropic-gradient-noise/rdr_2f42cb73eb274b35ac1a7d05923eae95/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}