Recursive Discriminative Subspace Learning With $\ell_{1}$ -Norm Distance Constraint

Dong Zhang, Yunlian Sun, Qiaolin Ye, Jinhui Tang

Abstract

In feature learning tasks, one of the most enormous challenges is to generate an efficient discriminative subspace. In this paper, we propose a novel subspace learning method, named recursive discriminative subspace learning with an ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -norm distance constraint (RDSL). RDSL can robustly extract features from the contaminated images and learn a discriminative subspace. With the use of an inequation-based ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -norm distance metric constraint, the minimized ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -norm distance metric objective function with slack variables induces samples in the same class to cluster as close as possible, meanwhile samples from different classes can be separated from each other as far as possible. By utilizing ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -norm items in both the objective function and the constraint, RDSL can well handle the noisy data and outliers. In addition, the large margin formulation makes the proposed method insensitive to initializations. We describe two approaches to solve RDSL with a recursive strategy. Experimental results on six benchmark datasets, including the original data and the contaminated data, demonstrate that RDSL outperforms the state-of-the-art methods.
BibTeX
@article{zhang2020recursive,
  author = {Dong Zhang and Yunlian Sun and Qiaolin Ye and Jinhui Tang},
  title = {{Recursive Discriminative Subspace Learning With $\textbackslash\{\}ell\_\{1\}$ -Norm Distance Constraint}},
  journal = {IEEE Trans. Cybernetics},
  year = {2020},
  url = {https://openreview.net/forum?id=yr1bp2mGfFy},
}

Loading related content...

Figure