Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning
Lists
Only you see this
Abstract
The existing unsupervised feature extraction methods frequently explore low-redundant features by an uncorrelated constraint. However, the constrained models might incur trivial solutions, due to the singularity of scatter matrix triggered by high-dimensional data. In this paper, we propose a regularized regression model with a generalized uncorrelated constraint for feature selection, which leads to three merits: 1) exploring the low-redundant and discriminative features; 2) avoiding the trivial solutions and 3) simplifying the optimization. Besides that, the local cluster structure is achieved via a novel constrained spectral analysis for the unsupervised learning, where MustLinks and Cannot-Links are transformed into a intrinsic graph and a penalty graph respectively, rather than incorporated into a mixed affinity graph. Accordingly, a discriminative and uncorrelated feature selection with constrained spectral analysis (DUCFS) is proposed with adopting σ-norm regularization for interpolating between F-norm and ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1</sub> -norm. Due to the flexible gradient and global differentiability, our model converges fast. Extensive experiments on benchmark datasets among several state-of-the-art approaches verify the effectiveness of the proposed method.
BibTeX
@article{li2020discriminative,
author = {Xuelong Li and Han Zhang and Rui Zhang and Feiping Nie},
title = {{Discriminative and Uncorrelated Feature Selection With Constrained Spectral Analysis in Unsupervised Learning}},
journal = {IEEE Trans. Image Process.},
year = {2020},
url = {https://openreview.net/forum?id=cJg1TNmnrxB},
}Loading related content...