Feature selection in MLPs and SVMs based on maximum output information

Vikas Sindhwani, Subrata Rakshit, Dipti Deodhare, Deniz Erdogmus, José Carlos Príncipe, Partha NiyogiIEEE Trans. Neural Networks 2004 · DOI · OpenReview

Abstract

This paper presents feature selection algorithms for multilayer perceptrons (MLPs) and multiclass support vector machines (SVMs), using mutual information between class labels and classifier outputs, as an objective function. This objective function involves inexpensive computation of information measures only on discrete variables; provides immunity to prior class probabilities; and brackets the probability of error of the classifier. The maximum output information (MOI) algorithms employ this function for feature subset selection by greedy elimination and directed search. The output of the MOI algorithms is a feature subset of user-defined size and an associated trained classifier (MLP/SVM). These algorithms compare favorably with a number of other methods in terms of performance on various artificial and real-world data sets.
BibTeX
@article{sindhwani2004feature,
  author = {Vikas Sindhwani and Subrata Rakshit and Dipti Deodhare and Deniz Erdogmus and José Carlos Príncipe and Partha Niyogi},
  title = {{Feature selection in MLPs and SVMs based on maximum output information}},
  journal = {IEEE Trans. Neural Networks},
  year = {2004},
  doi = {10.1109/tnn.2004.828772},
}

Loading related content...

Figure