No article text was recorded for this version.
unified optimization framework (unified momentum framework)
Version 1 of 158 papers69 conceptsfrozen 2026-10-04
Papers in this version
- Blog: On the Optimal Linear Convergence Rate of a Generalized Proximal Point Algorithm
- Blog: Non asymptotic analysis of Adaptive stochastic gradient algorithms and applications
- Blog: Coordinate Descent with Arbitrary Sampling I: Algorithms and Complexity
- Blog: Quasi-hyperbolic momentum and Adam for deep learning
- Blog: SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients
- Blog: A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse
- Blog: Unified convergence analysis for adaptive optimization with moving average estimator
- Blog: Follow the Moving Leader in Deep Learning
- Blog: Adam-family Methods with Decoupled Weight Decay in Deep Learning
- Blog: Generalisation under gradient descent via deterministic PAC-Bayes
- Blog: General Analysis of LMO-based Optimizers: Beyond Bounded Variance
- Blog: Complex Momentum for Optimization in Games
- Blog: Efficient Accelerated Coordinate Descent Methods and Faster Algorithms for Solving Linear Systems.
- Blog: A Sufficient Condition for Convergences of Adam and RMSProp
- Blog: A Low-Complexity Algorithmic Framework for Large-Scale IRS-Assisted Wireless Systems
- Blog: SGD with Adaptive Preconditioning: Unified Analysis and Momentum Acceleration
- Blog: Analyzing Generalization of Neural Networks through Loss Path Kernels
- Blog: Bregman Proximal Linearized ADMM for Minimizing Separable Sums Coupled by a Difference of Functions
- Blog: Fast Augmented Lagrangian Method in the convex regime with convergence guarantees for the iterates
- Blog: Stochastic Regularized Majorization-Minimization with weakly convex and multi-convex surrogates
- Blog: The Stochastic Auxiliary Problem Principle in Banach Spaces: Measurability and Convergence
- Blog: High Probability Complexity Bounds for Adaptive Step Search Based on Stochastic Oracles
- Blog: Activity Identification and Local Linear Convergence of Forward-Backward-type Methods
- Blog: Non-convergence to global minimizers for Adam and stochastic gradient descent optimization and constructions of local minimizers in the training of artificial neural networks
- Blog: Linearly Constrained Nonsmooth and Nonconvex Minimization
- Blog: A Unified Analysis of AdaGrad with Weighted Aggregation and Momentum Acceleration
- Blog: Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization
- Blog: Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations
- Blog: Entropic risk-averse generalized momentum methods
- Blog: Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration
- Blog: Extra-Gradient and Optimistic Gradient Descent Converge in Iterates Faster than $O(1/\sqrt{T})$ in All Monotone Lipschitz Variational Inequalities
- Blog: A Simple Convergence Proof of Adam and Adagrad
- Blog: Frictionless Hamiltonian Descent with Discretization and Parallel Optimization
- Blog: Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
- Blog: ASVRG: Accelerated Proximal SVRG
- Blog: Generalizing the Optimized Gradient Method for Smooth Convex Minimization
- Blog: A Unifying Approximate Method of Multipliers for Distributed Composite Optimization
- Blog: A new regret analysis for Adam-type algorithms
- Blog: Smoothing DiLoCo with Primal Averaging for Faster Training of LLMs
- Blog: Trust Region Methods for Nonconvex Stochastic Optimization beyond Lipschitz Smoothness
- Blog: Understanding the Role of Momentum in Stochastic Gradient Methods
- Blog: General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization
- Blog: An Algorithmic Framework of Variable Metric Over-Relaxed Hybrid Proximal Extra-Gradient Method
- Blog: Convergence Rates of a Momentum Algorithm with Bounded Adaptive Step Size for Nonconvex Optimization
- Blog: Local methods with adaptivity via scaling
- Blog: Relative Loss Bounds for Multidimensional Regression Problems
- Blog: Proximal-Like Incremental Aggregated Gradient Method with Linear Convergence Under Bregman Distance Growth Conditions
- Blog: Resolvent splitting for sums of monotone operators with minimal lifting
- Blog: An Inertial Parallel and Asynchronous Forward–Backward Iteration for Distributed Convex Optimization
- Blog: Unifying mirror descent and dual averaging
- Blog: Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization
- Blog: Theoretical and numerical comparison of first order algorithms for cocoercive equations and smooth convex optimization
- Blog: Generalized Simultaneous Perturbation-Based Gradient Search With Reduced Estimator Bias
- Blog: Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyond
- Blog: A Unified Analysis of Stochastic Momentum Methods for Deep Learning
- Blog: Nonlinearly Preconditioned Gradient Methods under Generalized Smoothness
- Blog: Last-iterate convergence analysis of stochastic momentum methods for neural networks
- Blog: On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_unified_optimization_framework_unified_m_395af385,
title = {unified optimization framework (unified momentum framework)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/unified-optimization-framework-unified-momentum-framework/rdr_395af385d0d34169bf18dbfa27c90258},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_unified_optimization_framework_unified_m_395af385_v1,
title = {unified optimization framework (unified momentum framework)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/unified-optimization-framework-unified-momentum-framework/rdr_395af385d0d34169bf18dbfa27c90258/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}