No article text was recorded for this version.
edge of stability
Version 1 of 188 papers115 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Non-Euclidean Gradient Descent Operates at the Edge of Stability
- Blog: Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability
- Blog: Dynamics of Training
- Blog: Nonmonotone Line Searches Operate at the Edge of Stability
- Blog: Gradient Descent Converges Arbitrarily Fast for Logistic Regression via Large and Adaptive Stepsizes
- Blog: On the Convergence Direction of Gradient Descent
- Blog: On a continuous time model of gradient descent dynamics and instability in deep learning
- Blog: A Loss Curvature Perspective on Training Instabilities of Deep Learning Models
- Blog: Beyond the Edge of Stability via Two-step Gradient Updates
- Blog: A Loss Curvature Perspective on Training Instability in Deep Learning
- Blog: A Minimalist Example of Edge-of-Stability and Progressive Sharpening
- Blog: Quadratic models for understanding catapult dynamics of neural networks
- Blog: A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta
- Blog: Convergence Rates for Gradient Descent on the Edge of Stability for Overparametrised Least Squares
- Blog: Gradient Descent Only Converges to Minimizers: Non-Isolated Critical Points and Invariant Regions
- Blog: Understanding the unstable convergence of gradient descent
- Blog: From Logistic Regression to the Perceptron Algorithm: Exploring Gradient Descent with Large Step Sizes
- Blog: On Gradient Descent Convergence beyond the Edge of Stability
- Blog: Acceleration via Fractal Learning Rate Schedules
- Blog: Gradient Descent Optimizes Infinite-Depth ReLU Implicit Networks with Linear Widths
- Blog: High-dimensional limit of one-pass SGD on least squares
- Blog: Using Curvature Information for Fast Stochastic Search
- Blog: Stable Minima of ReLU Neural Networks Suffer from the Curse of Dimensionality: The Neural Shattering Phenomenon
- Blog: Continuous-Time Analysis of Adaptive Optimization and Normalization
- Blog: Understanding Gradient Descent on the Edge of Stability in Deep Learning
- Blog: Optimal Training Algorithms and their Relation to Backpropagation
- Blog: The alignment property of SGD noise and how it helps select flat minima: A stability analysis
- Blog: Learning Dynamics of Deep Matrix Factorization Beyond the Edge of Stability
- Blog: Sharpness of Minima in Deep Matrix Factorization: Exact Expressions
- Blog: Understanding Edge-of-Stability Training Dynamics with a Minimalist Example
- Blog: The Scaling Limit of High-Dimensional Online Independent Component Analysis
- Blog: Conflicting Biases at the Edge of Stability: Norm versus Sharpness Regularization
- Blog: On the Stability of Nonlinear Dynamics in GD and SGD: Beyond Quadratic Potentials
- Blog: Surprising Instabilities in Training Deep Networks and a Theoretical Analysis
- Blog: Understanding Gradient Descent on Edge of Stability in Deep Learning
- Blog: Understanding Edge-of-Stability Training Dynamics with a Minimalist Example
- Blog: Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach
- Blog: A PDE-based Explanation of Extreme Numerical Sensitivities and Edge of Stability in Training Neural Networks
- Blog: Optimal learning rate scaling depends on data in deep scalar linear networks
- Blog: A new characterization of the edge of stability based on a sharpness measure aware of batch gradient distribution
- Blog: Power-law Dynamic arising from machine learning
- Blog: How SGD Selects the Global Minima in Over-parameterized Learning: A Dynamical Stability Perspective
- Blog: Learning threshold neurons via the "edge of stability"
- Blog: The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
- Blog: Trajectory Alignment: Understanding the Edge of Stability Phenomenon via Bifurcation Theory
- Blog: Surprising Instabilities in Training Deep Networks and a Theoretical Analysis
- Blog: Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult
- Blog: Understanding the unstable convergence of gradient descent
- Blog: Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
- Blog: Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
- Blog: Second-order regression models exhibit progressive sharpening to the edge of stability
- Blog: From Stability to Chaos: Analyzing Gradient Descent Dynamics in Quadratic Regression
- Blog: Learning threshold neurons via edge of stability
- Blog: Local Convergence Analysis of Gradient Descent Ascent with Finite Timescale Separation
- Blog: Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes
- Blog: Understanding Optimization in Deep Learning with Central Flows
- Blog: Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression
- Blog: Any-stepsize Gradient Descent for Separable Data under Fenchel–Young Losses
- Blog: Gradient Descent with Large Step Sizes: Chaos and Fractal Convergence Region
- Blog: Directional Smoothness and Gradient Methods: Convergence and Adaptivity
Showing 60 of 88 papers.
History & citation
Current · Permanent link
- This direction split from Gradient Descent at the Edge of Stability (81% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_edge_of_stability_070fd47b,
title = {edge of stability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/edge-of-stability/rdr_070fd47bbf404a56a638eb012b1e04b7},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_edge_of_stability_070fd47b_v1,
title = {edge of stability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/edge-of-stability/rdr_070fd47bbf404a56a638eb012b1e04b7/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}