Unsupervised Class Separation of Multivariate Data through Cumulative Variance-Based Ranking

Andrew Foss, Osmar R. Zaïane, Sandra ZillesICDM 2009 · OpenReview

Abstract

This paper introduces a new extension of outlier detection approaches and a new concept, class separation through variance. We show that accumulating information about the outlierness of points in multiple subspaces leads to a ranking in which classes with differing variance naturally tend to separate. Exploiting this leads to a highly effective and efficient unsupervised class separation approach, especially useful in the difficult case of heavily overlapping distributions. Unlike typical outlier detection algorithms, this method can be applied beyond the `rare classes' case with great success. Two novel algorithms that implement this approach are provided. Additionally, experiments show that the novel methods typically outperform other state-of-the-art outlier detection methods on high dimensional data such as Feature Bagging, SOE1, LOF, ORCA and Robust Mahalanobis Distance and competes even with the leading supervised classification methods.
BibTeX
@inproceedings{foss2009unsupervised,
  author = {Andrew Foss and Osmar R. Zaïane and Sandra Zilles},
  title = {{Unsupervised Class Separation of Multivariate Data through Cumulative Variance-Based Ranking}},
  booktitle = {ICDM},
  year = {2009},
  url = {https://openreview.net/forum?id=lSoLiNQ7F8},
}

Loading related content...

Figure