Comment-based multi-view clustering of web 2.0 items

Xiangnan He, Min-Yen Kan, Peichu Xie, Xiao Chen

Abstract

This paper introduces CoNMF (Co-regularized Non-negative Matrix Factorization), a framework designed to enhance the clustering of Web 2.0 items, such as music and videos, by utilizing user comments as a rich, multi-dimensional data source. By jointly factorizing item metadata, comment text, and commenter identities, CoNMF achieves significant performance improvements—up to 14% in F1 score—over traditional single-view clustering methods.

Introduction

In the Web 2.0 era, platforms are inundated with user-generated content, making effective organization through semantic clustering vital for search and recommendation systems. Traditionally, clustering has relied on intrinsic features, such as an item's title or description. However, these features are often sparse, noisy, or insufficient to capture the full semantic context of an item.

The authors propose that user comments offer a valuable "extrinsic" information source. Comments provide not only textual content but also reveal the identities of interested users. The primary challenge lies in integrating these heterogeneous data sources (text vs. user IDs), which vary significantly in scale and quality. Simple concatenation often fails as low-quality views can obscure high-quality signals.

The CoNMF Framework

The proposed CoNMF framework extends standard Non-negative Matrix Factorization (NMF) into a multi-view setting. It considers three distinct views for each item:

  1. Description View: Intrinsic metadata (e.g., artist biographies).
  2. Comment Words View: The textual content of user comments.
  3. Users View: The identities of the users who have commented on the item.
Feature counts across the three data views.

Co-regularization and Normalization

CoNMF employs a co-regularization term to encourage similarity between the cluster assignment matrices of different views without forcing a rigid consensus. Two paradigms are explored: Pair-wise CoNMF (CoNMF-P), which minimizes distances between pairs of views, and Cluster-wise CoNMF (CoNMF-C), which aligns cluster-to-cluster similarity matrices.

A key technical insight is the necessity of $L_2$ normalization during iterative updates. Because feature vector lengths vary drastically across views (e.g., a short bio vs. thousands of comments), normalization prevents the model from becoming biased toward views with higher feature density.

Experimental Evaluation

The researchers evaluated CoNMF on two real-world datasets: Last.fm (9,694 music artists across 21 genres) and Yelp (2,624 businesses across 7 categories).

Key Results

The experiments demonstrated that CoNMF consistently outperforms both single-view baselines and state-of-the-art multi-view methods. On the Last.fm dataset, CoNMF improved the F1 score by 14% over standard $k$-means.

Performance metrics for individual views vs. the combined CoNMF approach.

One of the most striking findings is that user identity is often a more predictive signal than the text of the comments themselves. Users typically exhibit niche interests, making their "commenting footprint" a highly effective feature for identifying item categories.

Conclusion

CoNMF provides a robust solution for multi-view clustering by effectively balancing information from diverse sources. The use of soft constraints via pair-wise regularization allows high-quality views to guide the clustering process without being compromised by noisier data. Future work may involve addressing fixed cluster counts through Matrix Tri-factorization and incorporating temporal dynamics to account for changing user interests over time.

Summary updated

Abstract

Clustering Web 2.0 items (i.e., web resources like videos, images) into semantic groups benefits many applications, such as organizing items, generating meaningful tags and improving web search. In this paper, we systematically investigate how user-generated comments can be used to improve the clustering of Web 2.0 items. In our preliminary study of Last.fm, we find that the two data sources extracted from user comments -- the textual comments and the commenting users -- provide complementary evidence to the items' intrinsic features. These sources have varying levels of quality, but we importantly we find that incorporating all three sources improves clustering. To accommodate such quality imbalance, we invoke multi-view clustering, in which each data source represents a view, aiming to best leverage the utility of different views. To combine multiple views under a principled framework, we propose CoNMF (Co-regularized Non-negative Matrix Factorization), which extends NMF for multi-view clustering by jointly factorizing the multiple matrices through co-regularization. Under our CoNMF framework, we devise two paradigms -- pair-wise CoNMF and cluster-wise CoNMF -- and propose iterative algorithms for their joint factorization. Experimental results on Last.fm and Yelp datasets demonstrate the effectiveness of our solution. In Last.fm, CoNMF betters k-means with a statistically significant F1 increase of 14%, while achieving comparable performance with the state-of-the-art multi-view clustering method CoSC (Co-regularized Spectral Clustering). On a Yelp dataset, CoNMF outperforms the best baseline CoSC with a statistically significant performance gain of 7%.
BibTeX
@inproceedings{he2014comment,
  author = {Xiangnan He and Min-Yen Kan and Peichu Xie and Xiao Chen},
  title = {{Comment-based multi-view clustering of web 2.0 items}},
  booktitle = {The Web Conference},
  year = {2014},
  doi = {10.1145/2566486.2567975},
}
Figure