No article text was recorded for this version.
gradient noise anisotropy
Version 1 of 120 papers33 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Revisiting the noise Model of SGD
- Blog: A Geometric Interpretation of Stochastic Gradient Descent Using Diffusion Metrics
- Blog: Implicit bias of SGD in $L_2$-regularized linear DNNs: One-way jumps from high to low rank
- Blog: From SGD to Spectra: A Theory of Neural Network Weight Dynamics
- Blog: Implicit bias of SGD in L2-regularized linear DNNs: One-way jumps from high to low rank
- Blog: Revisiting the Noise Model of Stochastic Gradient Descent
- Blog: On Large Batch Training and Sharp Minima: A Fokker-Planck Perspective
- Blog: Quasi-potential theory for escape problem: Quantitative sharpness effect on SGD's escape from local minima
- Blog: Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Rényi's Entropy Perspective
- Blog: Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise
- Blog: Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections
- Blog: Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
- Blog: Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks
- Blog: Stochastic Modified Equations and Dynamics of Dropout Algorithm
- Blog: Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
- Blog: Three-stage Evolution and Fast Equilibrium for SGD with Non-degerate Critical Points
- Blog: Isotropic Noise in Stochastic and Quantum Convex Optimization
- Blog: Convergence Analysis of Adaptive Gradient Methods under Refined Smoothness and Noise Assumptions
- Blog: Consensus-based optimisation with truncated noise
- Blog: The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects
History & citation
Current · Permanent link
- Anisotropic Gradient Noise in Neural Network Optimization merged into this direction (50% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_gradient_noise_anisotropy_e08beac9,
title = {gradient noise anisotropy},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gradient-noise-anisotropy/rdr_e08beac9efc84143b2a20877c1c8a37a},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_gradient_noise_anisotropy_e08beac9_v1,
title = {gradient noise anisotropy},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/gradient-noise-anisotropy/rdr_e08beac9efc84143b2a20877c1c8a37a/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}