Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning

Xuelong Li, Han Zhang, Rui Zhang, Feiping NieIEEE TIP 2020 · OpenReview

Abstract

The existing unsupervised feature extraction methods frequently explore low-redundant features by an uncorrelated constraint. However, the constrained models might incur trivial solutions, due to the singularity of scatter matrix triggered by high-dimensional data. In this paper, we propose a regularized regression model with a generalized uncorrelated constraint for feature selection, which leads to three merits: 1) exploring the low-redundant and discriminative features; 2) avoiding the trivial solutions and 3) simplifying the optimization. Besides that, the local cluster structure is achieved via a novel constrained spectral analysis for the unsupervised learning, where MustLinks and Cannot-Links are transformed into a intrinsic graph and a penalty graph respectively, rather than incorporated into a mixed affinity graph. Accordingly, a discriminative and uncorrelated feature selection with constrained spectral analysis (DUCFS) is proposed with adopting σ-norm regularization for interpolating between F-norm and ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1</sub> -norm. Due to the flexible gradient and global differentiability, our model converges fast. Extensive experiments on benchmark datasets among several state-of-the-art approaches verify the effectiveness of the proposed method.
BibTeX
@article{li2020discriminative,
  author = {Xuelong Li and Han Zhang and Rui Zhang and Feiping Nie},
  title = {{Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning}},
  journal = {IEEE Trans. Image Process.},
  year = {2020},
  url = {https://openreview.net/forum?id=cJg1TNmnrxB},
}

Loading related content...

Figure