Adaptive step size selection for optimization via the ski rental problem

Amirali Aghazadeh, Ali Ayremlou, Daniel D. Calderon, Tom Goldstein, Raajen Patel, Divyanshu Vats, Richard G. BaraniukICASSP 2013 · OpenReview

Abstract

Optimization has been used extensively throughout signal processing in applications including sensor networks and sparsity based compressive sensing. One of the key challenges when implementing iterative optimization algorithms is to choose an appropriate step size for fast algorithms. We pose the problem of choosing step sizes as solving a ski rental problem, a popular class of problems from the computer science literature. This results in a novel algorithm for adaptive step size selection that is agnostic to the choice of the optimization algorithm. Our numerical results show the advantages of using adaptivity for step size selection.
BibTeX
@inproceedings{aghazadeh2013adaptive,
  author = {Amirali Aghazadeh and Ali Ayremlou and Daniel D. Calderon and Tom Goldstein and Raajen Patel and Divyanshu Vats and Richard G. Baraniuk},
  title = {{Adaptive step size selection for optimization via the ski rental problem}},
  booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
  year = {2013},
  url = {https://openreview.net/forum?id=JSh6cxmoTKB},
}

Loading related content...

Figure