Feature Selection via Dependence Maximization

Le Song, Alexander J. Smola, Arthur Gretton, Justin Bedo, Karsten M. BorgwardtJMLR 2012 · OpenReview

Abstract

We introduce a framework for feature selection based on dependence maximization between the selected features and the labels of an estimation problem, using the Hilbert-Schmidt Independence Criterion. The key idea is that good features should be highly dependent on the labels. Our approach leads to a greedy procedure for feature selection. We show that a number of existing feature selectors are special cases of this framework. Experiments on both artificial and real-world data show that our feature selector works well in practice.
BibTeX
@article{song2012feature,
  author = {Le Song and Alexander J. Smola and Arthur Gretton and Justin Bedo and Karsten M. Borgwardt},
  title = {{Feature Selection via Dependence Maximization}},
  journal = {J. Mach. Learn. Res.},
  year = {2012},
  url = {https://openreview.net/forum?id=UGbVs7UU0SP},
}

Loading related content...

Figure