Presentation of a recommender system with ensemble learning and graph embedding: a case on MovieLens

Saman Forouzandeh, Kamal Berahmand, Mehrdad Rostami

Introduction

In the current era of "information overflow," recommender systems (RS) have become indispensable tools for navigating massive datasets. However, traditional Collaborative Filtering (CF) methods often encounter accuracy bottlenecks. These systems frequently struggle to capture the nuanced, multi-layered relationships between users and items when relying on individual classifications. Furthermore, analyzing user behavior at scale using raw graphs is computationally cumbersome. This paper proposes a hybrid framework that integrates ensemble learning with graph embeddings to enhance recommendation accuracy and efficiency.

Methodology

The authors introduce a two-step framework designed to group similar users and model their behavior effectively.

1. Ensemble Learning and Fuzzy Classification

Rather than analyzing users in isolation, the system employs ensemble learning to categorize users into neighborhoods. The model defines four distinct types of similarity:

  • SF: Similarity in film selection (ratings).
  • SFS: Similarity in film subjects (genres).
  • SMPF: Similarity in selecting popular films.
  • SMPSF: Similarity in selecting films with popular subjects.

These metrics are processed through fuzzy rules and decision trees to identify the "top three" classes of users most similar to a target user based on both demographic profile (age, gender) and behavioral patterns.

Overview of the ensemble learning and fuzzy classification workflow.

2. Graph Embedding with node2vec

The behavior of these identified user groups is modeled as a heterogeneous knowledge graph. To ensure the graph is searchable and computationally efficient, the authors utilize node2vec. This technique transforms graph nodes into low-dimensional vectors (embeddings) while preserving their structural neighborhood relationships, allowing the system to discover subtle, multi-hop relationships invisible to standard matrix-based approaches.

3. User Triple Vector (UTV)

The final recommendations are generated via a "User Triple Vector." This component calculates the cosine similarity between the target user’s embedding and candidate movie embeddings to produce a ranked "top-k" list of recommendations.

Experimental Setup

The study utilizes two industry-standard benchmarks to evaluate performance: MovieLens 1M and MovieLens 10M. To simulate real-world conditions where user-item interaction data is often incomplete, the authors intentionally introduced sparsity into the datasets during testing.

Statistics for the MovieLens datasets used in the study.

Key Results and Discussion

The proposed UTV model consistently outperformed standard Collaborative Filtering (CF), Content-Based Filtering (CBF), and modern graph-based models such as RippleNet across several metrics:

  • Root Mean Square Error (RMSE): On the MovieLens 1M dataset, UTV achieved an average RMSE of 1.676, significantly lower than RippleNet (2.108) and Genetic Algorithm-based models (2.475).
  • Accuracy (ACC): On the 10M dataset, UTV reached an average accuracy of 0.3615, surpassing RippleNet’s 0.3078.
  • Area Under Curve (AUC): In top-N recommendation tasks, UTV demonstrated superior performance, with AUC scores reaching up to 0.8355 on the 10M dataset as the user base scaled.

These results highlight the power of group-based classification. By aggregating users into fuzzy-defined neighborhoods first, the system filters out the noise that typically plagues standard CF methods. Additionally, the use of fuzzy logic better accommodates the ambiguity of human taste, such as the subjective difference between a 3-star and 4-star rating.

Conclusion and Future Work

This research demonstrates that combining ensemble learning with structural graph learning significantly improves recommendation quality. While the UTV model shows high efficiency, future research could address the "cold-start" problem for users with missing metadata and explore the computational costs of real-time model retraining as new data enters live systems. The authors suggest this methodology is highly adaptable for other social networks and IoT-based recommendation environments.

Summary updated

Abstract

Information technology has spread widely, and extraordinarily large amounts of data have been made accessible to users, which has made it challenging to select data that are in accordance with user needs. For the resolution of the above issue, recommender systems have emerged, which much help users go through the process of decision-making and selecting relevant data. A recommender system predicts users’ behavior to be capable of detecting their interests and needs, and it often uses the classification technique for this purpose. It may not be sufficiently accurate to employ single classification, where not all cases can be examined, which makes the method inappropriate to specific problems. In this research, group classification and the ensemble learning technique were used for increasing prediction accuracy in recommender systems. Another issue that is raised here concerns user analysis. Given the large size of the data and a large number of users, the process of user needs analysis and prediction (using a graph in most cases, representing the relations between users and their selected items) is complicated and cumbersome in recommender systems. Graph embedding was also proposed for resolution of this issue, where all or part of user behavior can be simulated through the generation of several vectors, resolving the problem of user behavior analysis to a large extent while maintaining high efficiency. In this research, individuals most similar to the target user were classified using ensemble learning, fuzzy rules, and the decision tree, and relevant recommendations were then made to each user with a heterogeneous knowledge graph and embedding vectors. This study was performed on the MovieLens datasets, and the obtained results indicated the high efficiency of the presented method.
BibTeX
@article{forouzandeh2021presentation,
  author = {Saman Forouzandeh and Kamal Berahmand and Mehrdad Rostami},
  title = {{Presentation of a recommender system with ensemble learning and graph embedding: a case on MovieLens}},
  journal = {Multimedia Tools and Applications},
  year = {2021},
  doi = {10.1007/s11042-020-09949-5},
}
Figure