An information geometric approach to supervised dimensionality reduction.
Lists
Only you see this
Abstract
Due to the curse of dimensionality, high-dimensional data is often pre-processed with some form of dimensionality reduction for the classification task. Many common methods of supervised dimensionality reduction have focused on separating and collapsing the data near the class centroids. These methods often make assumptions on the distributions of the data classes - namely Gaussianity - which can lead to ad-hoc and sub-optimal implementation. In this paper we present a method of supervised dimensionality reduction which takes an information-geometric approach by maximizing the between class information distances. This is shown to have direct relation to the Chernoff and Bhattacharya performance bounds for classification error. We illustrate our methods on real data and compare to several existing methods.
BibTeX
@inproceedings{carter2009information,
author = {Kevin M. Carter and Raviv Raich and Alfred O. Hero III},
title = {{An information geometric approach to supervised dimensionality reduction.}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2009},
doi = {10.1109/icassp.2009.4959962},
}