No article text was recorded for this version.
first-order vs second-order trade-off
Version 1 of 152 papers53 conceptsfrozen 2026-10-04
Papers in this version
- Blog: First-Order Algorithms for Nonlinear Generalized Nash Equilibrium Problems
- Blog: A simple linear algebra identity to optimize Large-Scale Neural Network Quantum States
- Blog: A Fast Anderson-Chebyshev Acceleration for Nonlinear Optimization
- Blog: Distributed Second Order Methods with Fast Rates and Compressed Communication
- Blog: IQN: An Incremental Quasi-Newton Method with Local Superlinear Convergence Rate
- Blog: A Distributed and Scalable Machine Learning Approach for Big Data
- Blog: An Enhanced Levenberg-Marquardt Method via Gram Reduction
- Blog: A general second order complete active space self-consistent-field solver for large-scale systems
- Blog: An Efficient Active-Set method With Applications to Sparse Approximations and Risk Minimization
- Blog: Convolutional Neural Network Training with Distributed K-FAC
- Blog: An Inexact Proximal Path-Following Algorithm for Constrained Convex Minimization
- Blog: Unique sparse decomposition of low rank matrices
- Blog: Guaranteed Trust Region Optimization via Two-Phase KL Penalization
- Blog: Polynomial Preconditioning for Gradient Methods
- Blog: Online Learning Guided Curvature Approximation: A Quasi-Newton Method with Global Non-Asymptotic Superlinear Convergence
- Blog: Escaping Saddle Point Efficiently in Minimax and Bilevel Optimizations
- Blog: An Iterative Method for Reconstructing Convex Polyhedra From External Guassian Images
- Blog: Gradient-Normalized Smoothness for Optimization with Approximate Hessians
- Blog: Convergence rates of sub-sampled Newton methods
- Blog: Regularized Off-Policy TD-Learning
- Blog: Structured BFGS Method for Optimal Doubly Stochastic Matrix Approximation
- Blog: Adaptive Quasi-Newton and Anderson Acceleration Framework with Explicit Global (Accelerated) Convergence Rates
- Blog: From Isolation to Cooperation: An Alternative View of a System of Experts
- Blog: Fast Projected Newton-like Method for Precision Matrix Estimation under Total Positivity
- Blog: On Adaptive Stochastic Optimization for Streaming Data: A Newton’s Method with O(dN) Operations
- Blog: Local Curvature Descent: Squeezing More Curvature out of Standard and Polyak Gradient Descent
- Blog: Faster Stochastic Quasi-Newton Methods
- Blog: Manifold Identification of Dual Averaging Methods for Regularized Stochastic Online Learning
- Blog: Second-Order Kernel Online Convex Optimization with Adaptive Sketching
- Blog: Newton-Stein Method: An Optimization Method for GLMs via Stein's Lemma
- Blog: Jorge: Approximate Preconditioning for GPU-efficient Second-order Optimization
- Blog: A second-order-like optimizer with adaptive gradient scaling for deep learning
- Blog: Efficient Second-Order Online Kernel Learning with Adaptive Embedding
- Blog: Accelerated First-order Methods for Geodesically Convex Optimization on Riemannian Manifolds
- Blog: Limited-memory common-directions method for large-scale optimization: convergence, parallelization, and distributed optimization
- Blog: Adaptive Negative Curvature Descent with Applications in Non-convex Optimization
- Blog: Large-scale bounded distortion mappings
- Blog: TRBoost: A Generic Gradient Boosting Machine based on Trust-region Method
- Blog: SAN: Stochastic Average Newton Algorithm for Minimizing Finite Sums
- Blog: Online Training of LSTM Networks in Distributed Systems for Variable Length Data Sequences
- Blog: A flexible coordinate descent method
- Blog: Large-Scale Matrix Factorization with Missing Data under Additional Constraints
- Blog: An adaptive regularized proximal Newton-type methods for composite optimization over the Stiefel manifold
- Blog: Nesterov Acceleration for Equality-Constrained Convex Optimization via Continuously Differentiable Penalty Functions
- Blog: Efficient projections onto the l1-ball for learning in high dimensions
- Blog: Class Prior-Free Positive-Unlabeled Learning with Taylor Variational Loss for Hyperspectral Remote Sensing Imagery
- Blog: A Reduced-Space Algorithm for Minimizing ℓ1-Regularized Convex Functions
- Blog: New Proximal Newton-Type Methods for Convex Optimization
- Blog: Constrained stochastic gradient descent for large-scale least squares problem
- Blog: Efficient Schemes for Total Variation Minimization Under Constraints in Image Processing
- Blog: Continuous Newton-like Methods Featuring Inertia and Variable Mass
- Blog: A New Homotopy Proximal Variable-Metric Framework for Composite Convex Minimization
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_first_order_vs_second_order_trade_off_25aa8e36,
title = {first-order vs second-order trade-off},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/first-order-vs-second-order-trade-off/rdr_25aa8e36162c4cbf88282b23a36bdcee},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_first_order_vs_second_order_trade_off_25aa8e36_v1,
title = {first-order vs second-order trade-off},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/first-order-vs-second-order-trade-off/rdr_25aa8e36162c4cbf88282b23a36bdcee/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}