Abstract
Incorporating knowledge graphs (KGs) into recommendation systems has gained significant traction due to their ability to provide rich, multi-type relational data. However, existing methods often struggle to fully exploit the heterogeneous nature of KGs, treating different relation types with insufficient distinction. This paper introduces HGKR (Iterative Heterogeneous Graph Learning on Knowledge Graphs), a novel framework that models KGs as fine-grained heterogeneous graphs. By employing Graph Neural Networks (GNNs) for iterative message passing at both graph and semantic levels, and incorporating an attention-based knowledge-perceiving filter, HGKR captures nuanced user interests. Experimental results on MovieLens and MOOCCube datasets demonstrate that HGKR consistently outperforms state-of-the-art baselines in recommendation accuracy.
Introduction
Modern recommendation systems face persistent challenges, notably the "cold start" problem and the difficulty of capturing complex, high-order relationships between users and items. Knowledge Graphs (KGs) offer a solution by providing a structured web of auxiliary information. For instance, knowing a movie's director or genre can bridge the gap when user interaction data is sparse. Yet, most current KG-based models fail to adequately handle heterogeneity—the fact that a "directed by" link carries different semantic weight and information than a "genre" link. Treating these relations uniformly leads to suboptimal performance.
The HGKR Framework
To address these limitations, the authors propose the HGKR framework. The core innovation lies in treating the KG not as a monolithic graph, but as a collection of interacting heterogeneous layers.
The framework consists of four primary modules:
- Bipartite Extraction: The complex KG is decomposed into multiple bipartite graphs, each corresponding to a specific relation type (e.g., User-Item, Movie-Director).
- Hierarchical Message Passing: This occurs at two levels. At the graph level, GNNs (specifically GraphSAGE and GAT) aggregate local neighbor information. At the semantic level, information is iteratively propagated across different bipartite graphs, allowing the model to learn cross-relational dependencies.
- Knowledge-Perceiving Item Filter: An attention mechanism evaluates a user's historical interactions against target items, refining the user's preference representation based on KG-derived insights.
- Predicting Module: Refined user and item embeddings are combined to calculate the final interaction probability.
Modeling Heterogeneity
The transition from a standard KG to a layered heterogeneous representation is central to HGKR's success. By isolating relations into distinct layers, the model can apply specialized GNN architectures—such as Graph Attention Networks (GAT) for item-related entities to reduce noise, and GraphSAGE for others.
Experimental Results
HGKR was evaluated on two real-world datasets: MovieLens Latest (enriched with Wikidata) and MOOCCube (a dense online course dataset). The model demonstrated superior performance over state-of-the-art baselines like RippleNet and KGAT.
- CTR Prediction: HGKR achieved a 2.21% improvement in AUC on the MOOCCube dataset, suggesting it excels in semantically dense environments where multiple relational layers overlap.
- Top-K Recommendation: The model showed significant gains in Precision@K and nDCG@K (normalized discounted cumulative gain), particularly as the number of recommendations increased.
Conclusion
HGKR represents a significant step forward in KG-based recommendation by explicitly modeling the semantic heterogeneity of relational data. While the current manual selection of GNN types for specific relations is a limitation, the iterative refinement process proves highly effective at capturing potential user interests. Future work will focus on automating model configuration and integrating KG reasoning to handle data sparsity more robustly.
Summary updated