Abstract
Modern multimedia recommendation systems often struggle to bridge the gap between raw features (visual, acoustic, textual) and actual user motivations. This paper introduces the Hierarchical User Intent Graph Network (HUIGN), a framework designed to explicitly model multi-level user intents. By organizing these intents into a hierarchy—ranging from fine-grained attributes like specific actors to coarse-grained concepts like genre—HUIGN captures the complex structure of personal taste. Experimental results on Movielens, TikTok, and Kwai datasets demonstrate that HUIGN significantly outperforms state-of-the-art baselines, providing more accurate and semantically meaningful recommendations.
Introduction
Most contemporary multimedia recommenders utilize "off-the-shelf" features from pre-trained models like ResNet or BERT. While powerful for general tasks, these features are not optimized for understanding the nuanced "why" behind a user's interaction. User intent is inherently hierarchical; a user might be drawn to a video because of a specific visual quality (fine-grained) or a broader storyline (coarse-grained). Existing models often treat these features as a flat vector, failing to capture the multi-level nature of human preference. HUIGN addresses this by learning disentangled, hierarchical representations of user intent directly from interaction data and item content.
Methodology: The HUIGN Framework
The HUIGN architecture operates through a series of graph-based aggregations to distill intent from multi-modal signals.
The process involves three key stages:
- Co-interacted Item Graph Construction: Items are connected in a graph if they share common users, embedding behavioral patterns into the item representations.
- Recursive Aggregation:
- Intra-level Aggregation: A light Graph Convolutional Network (GCN) variant aggregates signals from neighboring nodes to capture local "vibes" or similar item characteristics.
- Inter-level Aggregation: Higher-level "supernodes" are formed to summarize lower-level intents into broader categories, creating a hierarchical structure.
- Disentangled Learning: To ensure intents are distinct, the model employs a cross-entropy loss to sharpen item-intent associations and an independence loss to minimize redundancy between different learned intents.
Experimental Evaluation
The model was tested on three diverse datasets: Movielens (enriched with multi-modal metadata), TikTok, and Kwai. These platforms represent a mix of traditional movie recommendations and modern micro-video services.
Key Results
HUIGN consistently achieved superior performance compared to competitive baselines such as MMGCN and DisenGCN.
As shown in the results table, HUIGN provides substantial relative improvements in NDCG@10: 9.35% on Movielens, 12.10% on TikTok, and 10.70% on Kwai. These gains highlight the effectiveness of modeling intent as a hierarchy rather than a flat feature set.
Discussion and Insights
- Hierarchical Superiority: Ablation studies confirmed that a multi-layer hierarchy (e.g., three layers consisting of 32, 8, and 4 intents respectively) outperforms single-layer models, mirroring human cognitive categorization.
- Modality Impact: In micro-video contexts, visual features were found to be the most influential modality, though the integration of acoustic and textual data further refined accuracy.
- Robustness through Disentanglement: The independence loss was critical for maintaining performance across varying graph densities, ensuring that the learned intents remained distinct and informative.
Conclusion
The Hierarchical User Intent Graph Network (HUIGN) represents a significant step forward in multimedia recommendation by moving beyond raw feature filtering to intent-based representation. By explicitly modeling the hierarchical nature of user motivation, the system provides more robust and interpretable recommendations. Future work will explore more sophisticated modality fusion techniques and the integration of external knowledge graphs to further bridge the semantic gap.
Summary updated