Twin Tensor Learning for Consistency and Inconsistency: A Unified Affinity Learning Framework for Multi-View Clustering
Lists
Only you see this
Abstract
Due to the efficiency of discovering the high-order correlations of multiple views, tensorized multi-view clustering (TMVC) has been extensively investigated and achieve impressive performance. However, previous TMVC studies merely emphasize on exploring the multi-view consistency, but rarely consider the cross-view inconsistency that may be caused by noise, corruptions or view-specific properties, rendering the abundant information contained in multiple features cannot be comprehensively detected. To this end, this paper proposes a <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</b>win tens<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">O</b>rized affinity learning framew<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">O</b>rk for mul<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</b>i-view clu<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</b>tering (<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">TOOTS</b>), which seamlessly integrates multi-view consistency and cross-view inconsistency into a unified framework. Specifically, the TOOTS model employs the self-representation mechanism to learn two sets of affinity matrices, which are reorganized into twin tensors (i.e., consistent tensor and diverse tensor). Meanwhile, tensor low-rank constraint and exclusive lasso with <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\ell _{21}$</tex-math></inline-formula> regularization are imposed on consistent part and diverse part respectively, leading to the intra-view spatial structure and the inter-view inconsistency be exploited simultaneously. Furthermore, the multiple consistent factors are manipulated by a connectivity constraint and fused into a consensus graph with different weights, making the explicit clusters structural and the salient difference between views effectively leveraged. Substantial experimental results demonstrate that the proposed TOOTS model outperforms state-of-the-arts.
BibTeX
@article{gu2026twin,
author = {Zhibin Gu and Songhe Feng},
title = {{Twin Tensor Learning for Consistency and Inconsistency: A Unified Affinity Learning Framework for Multi-View Clustering}},
journal = {IEEE Transactions on Multimedia},
year = {2026},
doi = {10.1109/tmm.2026.3660113},
}Loading related content...