LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering

Shide Du, Chunming Wu, Zihan Fang, Wendi Zhao, Yilin Wu, Changwei Wang, Shiping WangarXiv 2025 · arXiv

TL;DR

LargeMvC-Net bridges the gap between scalable shallow anchor-based clustering and expressive deep neural networks by unfolding a robust multi-view optimization problem into an interpretable, layer-wise architecture. It achieves state-of-the-art multi-view clustering performance on large-scale datasets while maintaining linear computational complexity and high robustness to noise and missing data.

What Problem Does This Paper Address?

Multi-view clustering (MVC) aims to group data points by integrating information across multiple sources or modalities (such as text, images, and audio). As datasets grow exponentially, scalability becomes a major bottleneck.

To tackle this, researchers typically use one of two approaches:

  1. Shallow anchor-based methods: These use a small set of representative "anchors" to approximate massive sample-to-sample relationships, reducing computational overhead. However, their shallow, linear nature prevents them from capturing complex, non-linear semantic correlations.
  2. Deep multi-view clustering: These leverage deep neural networks to learn highly expressive latent features but typically require expensive global similarity computations, making them computationally prohibitive for large-scale datasets.

While recent hybrid methods attempt to combine deep networks with anchor structures, they do so heuristically (e.g., via post-hoc graph construction or message passing). This detaches the network's architecture from the underlying clustering principles, leading to a lack of interpretability and suboptimal optimization.

Methods

The authors introduce LargeMvC-Net, a Deep Unfolding Network (DUN) designed specifically for large-scale multi-view clustering. Instead of treating the neural network as a black box, they mathematically formulate a robust anchor-based optimization problem and map its iterative, step-by-step solution directly onto a feed-forward network architecture.

To handle real-world corruptions, the optimization problem incorporates an $\ell_1$-norm for representation sparsity and an $\ell_{2,1}$-norm for view-specific noise suppression. Each stage (or layer) of LargeMvC-Net directly mirrors one iteration of this optimization routine, split into three interpretable modules:

  1. RepresentModule: Aggregates multi-view residuals and updates the shared, consistent clustering representation across views using a learnable soft-thresholding operator.
  2. NoiseModule: Isolates sample-level noise and corruptions unique to each view using a learnable row-wise shrinkage operator.
  3. AnchorModule: Aligns each view's anchor structural pattern to the latent space using Singular Value Decomposition (SVD) under strict orthogonality constraints.

The entire network is trained end-to-end using an unsupervised reconstruction loss that aligns each view with the anchor-induced latent space.

Figure 2: An overview of the proposed anchor-based deep unfolding network (LargeMvC-Net).

Datasets

The model was extensively evaluated on 11 benchmark multi-view datasets, spanning both complete and incomplete (missing view) settings:

  • Feature-level datasets: Animals, Caltech102, Cifar10, MNIST, NUSWIDEOBJ, YoutubeFace, YTF-50, and YTF-100 (the largest, containing 195,537 samples).
  • Modality-level (vision and language) datasets: ESP-Game, Flickr, and IAPR.

Key Insights and Ideas

  • Optimization-Driven Architecture: By explicitly translating mathematical optimization steps into network modules, LargeMvC-Net provides structural clarity and optimization traceability that generic autoencoders or Graph Convolutional Networks (GCNs) lack.
  • Linear Scalability ($O(n)$): By routing global similarity through a compact set of anchors ($m \ll n$), the network completely avoids expensive pairwise sample computations. This allows deep multi-view clustering to scale linearly with the number of samples.
  • Principled Denoising: Rather than relying on auxiliary contrastive losses, embedding the noise suppression matrix directly into the unfolded architecture allows the network to naturally tolerate view-specific corruptions and missing data.

Key Results

  • State-of-the-Art Accuracy: LargeMvC-Net consistently outperformed both shallow and deep baselines across all datasets in Clustering Accuracy (ACC), Normalized Mutual Information (NMI), and Adjusted Rand Index (ARI). On the massive YTF-100 dataset, it achieved a top ACC of 76.52%.
  • Robustness to Missing Views: In incomplete multi-view scenarios (where views were randomly dropped at rates ranging from 10% to 90%), LargeMvC-Net maintained highly stable performance, significantly outperforming specialized incomplete clustering methods.
Figure 3: ACC of large-scale incomplete clustering methods on multi-view datasets with different missing rates.

Limitations and Future Work

The current iteration of LargeMvC-Net relies on a fixed number of anchors initialized via k-means. The authors note that incorporating dynamic anchor structures that can adaptively update and evolve during the network's training process could further enhance model flexibility. Additionally, they plan to explore multi-task learning frameworks to extend the model's utility.

Summary updated

Abstract

Deep anchor-based multi-view clustering methods enhance the scalability of neural networks by utilizing representative anchors to reduce the computational complexity of large-scale clustering. Despite their scalability advantages, existing approaches often incorporate anchor structures in a heuristic or task-agnostic manner, either through post-hoc graph construction or as auxiliary components for message passing. Such designs overlook the core structural demands of anchor-based clustering, neglecting key optimization principles. To bridge this gap, we revisit the underlying optimization problem of large-scale anchor-based multi-view clustering and unfold its iterative solution into a novel deep network architecture, termed LargeMvC-Net. The proposed model decomposes the anchor-based clustering process into three modules: RepresentModule, NoiseModule, and AnchorModule, corresponding to representation learning, noise suppression, and anchor indicator estimation. Each module is derived by unfolding a step of the original optimization procedure into a dedicated network component, providing structural clarity and optimization traceability. In addition, an unsupervised reconstruction loss aligns each view with the anchor-induced latent space, encouraging consistent clustering structures across views. Extensive experiments on several large-scale multi-view benchmarks show that LargeMvC-Net consistently outperforms state-of-the-art methods in terms of both effectiveness and scalability.
BibTeX
@misc{du2025largemvc,
  author = {Shide Du and Chunming Wu and Zihan Fang and Wendi Zhao and Yilin Wu and Changwei Wang and Shiping Wang},
  title = {{LargeMvC-Net: Anchor-based Deep Unfolding Network for Large-scale Multi-view Clustering}},
  year = {2025},
  eprint = {2507.20980},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.20980},
}
Figure