No article text was recorded for this version.
hyperparameter sensitivity (parameter-dependent optimization)
Version 2 of 2725 papers813 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence
- Blog: Universal Intermediate Gradient Method for Convex Problems with Inexact\n Oracle
- Blog: Optimal Stochastic Nonconvex Optimization with Bandit Feedback
- Blog: A Frank-Wolfe Algorithm for Strongly Monotone Variational Inequalities
- Blog: Restarting Algorithms: Sometimes There Is Free Lunch
- Blog: A2BCD: Asynchronous Acceleration with Optimal Complexity
- Blog: An Optimal First Order Method Based on Optimal Quadratic Averaging
- Blog: Critical Bach Size Minimizes Stochastic First-Order Oracle Complexity of Deep Learning Optimizer using Hyperparameters Close to One
- Blog: The First Optimal Algorithm for Smooth and Strongly-Convex-Strongly-Concave Minimax Optimization
- Blog: Generalized Mirror Prox for Monotone Variational Inequalities: Universality and Inexact Oracle
- Blog: Generalized Mirror Prox Algorithm for Monotone Variational Inequalities: Universality and Inexact Oracle
- Blog: On the Iteration Complexity of Oblivious First-Order Optimization Algorithms
- Blog: First-Order Methods for Convex Optimization
- Blog: A note on approximate accelerated forward-backward methods with absolute and relative errors, and possibly strongly convex objectives
- Blog: An Optimal Algorithm for Strongly Convex Minimization under Affine Constraints
- Blog: Kernel Conjugate Gradient Methods with Random Projections
- Blog: Online Adaptive Methods, Universality and Acceleration
- Blog: Personalized Federated X-armed Bandit
- Blog: Stochastic gradient methods with inexact oracle
- Blog: Acceleration by stepsize hedging: Silver Stepsize Schedule for smooth convex optimization
- Blog: Gradient and gradient-free methods for stochastic convex optimization with inexact oracle
- Blog: Near-Optimal Convergence of Accelerated Gradient Methods under Generalized and (L0, L1)-Smoothness
- Blog: FISTA and Extensions -- Review and New Insights
- Blog: Optimal rates for first-order stochastic convex optimization under Tsybakov noise condition
- Blog: Parameter-free projected gradient descent
- Blog: Convergence Rate of Incremental Gradient and Incremental Newton Methods
- Blog: Linear Convergence with Condition Number Independent Access of Full Gradients
- Blog: Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems
- Blog: Solving Non-Convex Non-Concave Min-Max Games Under Polyak-Łojasiewicz Condition
- Blog: Extragradient-Type Methods with $\mathcal{O} (1/k)$ Last-Iterate Convergence Rates for Co-Hypomonotone Inclusions
- Blog: Almost sure convergence rates of stochastic gradient methods under gradient domination
- Blog: Bilevel Optimization with Lower-Level Uniform Convexity: Theory and Algorithm
- Blog: A Parallel algorithm for $\mathcal{X}$-Armed bandits
- Blog: Complexity Guarantees for Polyak Steps with Momentum
- Blog: Acceleration Exists! Optimization Problems When Oracle Can Only Compare Objective Function Values
- Blog: Gradient-based Algorithms for Convex Discrete Optimization via Simulation
- Blog: Adaptive Accelerated Gradient Converging Method under H\"{o}lderian Error Bound Condition
- Blog: A simple parameter-free and adaptive approach to optimization under a minimal local smoothness assumption
- Blog: Optimization of Convex Functions with Random Pursuit
- Blog: Generalized-Smooth Nonconvex Optimization is As Efficient As Smooth Nonconvex Optimization
- Blog: Parameter-Agnostic Optimization under Relaxed Smoothness
- Blog: An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning
- Blog: On the Adaptivity of Stochastic Gradient-Based Optimization
- Blog: Stochastic Variance Reduction Methods for Saddle-Point Problems
- Blog: Optimizing $(L_0, L_1)$-Smooth Functions by Gradient Methods
- Blog: Towards closing the gap between the theory and practice of SVRG
- Blog: FISTA is an automatic geometrically optimized algorithm for strongly convex functions
- Blog: Revisiting the Polyak step size
- Blog: Gradient-Variation Online Adaptivity for Accelerated Optimization with Hölder Smoothness
- Blog: Heavy Ball Momentum for Non-Strongly Convex Optimization
- Blog: Accelerated Methods for Non-Convex Optimization
- Blog: A Universally Optimal Multistage Accelerated Stochastic Gradient Method
- Blog: Stochastic Smoothed Primal-Dual Algorithms for Nonconvex Optimization with Linear Inequality Constraints
- Blog: Better Mini-Batch Algorithms via Accelerated Gradient Methods
- Blog: Complexity Guarantees for Polyak Steps with Momentum
- Blog: Stochastic Three Points Method for Unconstrained Smooth Minimization
- Blog: Accelerated methods for composite non-bilinear saddle point problem
- Blog: Exact Optimal Accelerated Complexity for Fixed-Point Iterations
- Blog: An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning
- Blog: Gradient methods for convex minimization: better rates under weaker conditions
Showing 60 of 725 papers.
History & citation
Current · Permanent link
- Adaptive Optimization without Global Lipschitz Constants merged into this direction (59% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_hyperparameter_sensitivity_parameter_dep_d93f8279,
title = {hyperparameter sensitivity (parameter-dependent optimization)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/hyperparameter-sensitivity-parameter-dependent-optimization/rdr_d93f82793c6545cab976e805f2654cc8},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_hyperparameter_sensitivity_parameter_dep_d93f8279_v2,
title = {hyperparameter sensitivity (parameter-dependent optimization)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/hyperparameter-sensitivity-parameter-dependent-optimization/rdr_d93f82793c6545cab976e805f2654cc8/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}