l1 Regularization in Infinite Dimensional Feature Spaces
Lists
Only you see this
Abstract
In this paper we discuss the problem of fitting ℓ1 regularized prediction models in infinite (possibly non-countable) dimensional feature spaces. Our main contributions are: a. Deriving a generalization of ℓ1 regularization based on measures which can be applied in non-countable feature spaces; b. Proving that the sparsity property of ℓ1 regularization is maintained in infinite dimensions; c. Devising a path-following algorithm that can generate the set of regularized solutions in “nice” feature spaces; and d. Presenting an example of penalized spline models where this path following algorithm is computationally feasible, and gives encouraging empirical results.
BibTeX
@inproceedings{rosset2007l,
author = {Saharon Rosset and Grzegorz Swirszcz and Nathan Srebro and Ji Zhu},
title = {{l1 Regularization in Infinite Dimensional Feature Spaces}},
booktitle = {Conference on Learning Theory},
year = {2007},
doi = {10.1007/978-3-540-72927-3\_39},
}Loading related content...