Abstract
Modern video recommendation systems rely heavily on text metadata, which is frequently absent in user-generated content. This paper introduces Multi-View Active Learning (MVAL), a framework designed to mitigate the impact of missing features. MVAL utilizes a Visual-to-Text (V2T) mapping to synthesize missing text features from visual content and employs an active learning strategy to prioritize the most informative videos for human annotation. Experimental results on real-world datasets like YouTube and Youku demonstrate that MVAL significantly outperforms traditional methods, achieving higher accuracy with fewer labeled samples.
Introduction
Video platforms face a significant challenge: while raw visual data is always available, the high-level text metadata (titles, tags, descriptions) necessary for effective recommendation is often missing or sparse. Bridging this "semantic gap" manually is prohibitively expensive. Traditional active learning focuses on querying labels for unlabeled data. However, in recommendation systems, user actions (labels) are often abundant, while the descriptive features of the items are the scarce resource. MVAL addresses this by querying missing features rather than labels.
The MVAL Framework
The MVAL framework consists of two primary components: a Visual-to-Text (V2T) mapping module and an active selection strategy.
Visual-to-Text (V2T) Mapping
To handle missing text features, MVAL learns a mapping from the visual view to the text view. Unlike simple reconstruction, MVAL uses joint optimization. The model is trained to minimize both the difference between predicted and actual text features and the classification error of the recommendation model itself. This ensures that the synthesized text features are optimized for the end goal: predicting user interest.
Active Selection Strategy
Instead of random sampling, MVAL uses an informativeness score to select videos for annotation. This score is based on:
- Prediction Inconsistency: The discrepancy between the model's prediction (using synthesized features) and the actual user action.
- Watching Frequency: Prioritizing popular videos that act as "hubs" in the interaction graph, providing a stronger training signal.
- Cost-Awareness: Adjusting the selection based on the effort required for annotation, such as video length.
Experimental Evaluation
The researchers evaluated MVAL across diverse tasks, including multi-view classification on YouTube and Wikipedia datasets, and real-world video recommendation using large-scale data from Youku (over 243,000 interactions).
As shown in the results for the YouTube dataset, MVAL-inconsistency (the red solid line) achieves significantly higher accuracy with fewer queries compared to random selection and standard uncertainty-based active learning. On the Youku datasets, MVAL reached performance levels with 1,000 queries that random selection required 5,000 queries to match, representing a 5x improvement in labeling efficiency.
Conclusion
Multi-View Active Learning provides a robust solution for recommendation systems plagued by missing metadata. By treating feature acquisition as an active learning problem and leveraging visual content to bridge the semantic gap, MVAL reduces the cost of building high-performance recommenders. Future work may explore more complex selection strategies and further reduce the reliance on initial seed data.
Summary updated