A Method for Bilevel Optimization with Convex Lower-Level Problem
Lists
Only you see this
Abstract
Gradient-based bilevel optimization methods have been applied to a wide range of applications including hyper-parameter optimization, meta-learning, and model pruning. However, it is known that the bilevel optimization problem is difficult to solve, and the finite-time guarantee has only been established for simpler bilevel problems with a strongly-convex lower-level problem. In this work, we propose an iterative bilevel optimization method that sequentially solves simple approximate problems of the original problem. Despite the lack of strong convexity in the lower level, we show that the proposed method converges to an ϵ-stationary-point with an iteration complexity of $\mathcal{O}\left( {{\varepsilon ^{ - 1}}} \right)$. Experiments have verified the effectiveness of the method.
BibTeX
@inproceedings{shen2024method,
author = {Han Shen and Santiago Paternain and Gaowen Liu and Ramana Kompella and Tianyi Chen},
title = {{A Method for Bilevel Optimization with Convex Lower-Level Problem}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2024},
url = {https://openreview.net/forum?id=jSDfLLLCkP},
}Loading related content...