Graph Convolutional Embeddings for Recommender Systems

Paula Gómez Duran, Alexandros Karatzoglou, Jordi Vitrià, Xin Xin, Ioannis Arapakis

TL;DR

This paper introduces the Graph Convolutional Embedding (GCE) layer, a plug-and-play component that generalizes Graph Convolutional Networks (GCNs) to handle multi-dimensional context in recommender systems. By representing user-item-context interactions as an $N$-partite graph, the GCE layer captures rich relational structures that traditional embedding layers miss, leading to significant performance gains across diverse recommendation tasks.

What Problem Does This Paper Address?

Most modern recommender systems (RS) rely on "context"—meta-data like the time of day, a user's location, or the device being used—to improve accuracy. However, traditional models (like Factorization Machines or Neural Collaborative Filtering) usually treat these context variables as independent features.

While GCNs have been used to capture the "relational" structure between users and items, they are typically limited to bipartite graphs (two types of nodes). Real-world data is more complex; an interaction is often a triplet or quadruplet (User A bought Item B at Location C on Monday). The authors identify a gap: how do we effectively encode the topological structure of these multi-dimensional, $N$-partite interactions into the latent representations (embeddings) used by deep learning models?

Methods

The authors propose the Graph Convolutional Embedding (GCE) layer. Instead of using a standard lookup table for embeddings, they construct an $N$-partite graph where nodes represent users, items, and various context dimensions (e.g., "Monday," "London," "iPhone"). An edge exists between these nodes if they co-occurred in an interaction.

Key technical highlights include:

  • Message Passing: The GCE layer uses a modified graph convolution rule. When updating a user node's representation, it doesn't just look at the items the user liked; it aggregates "messages" from the specific context nodes associated with those interactions.
  • Integration: The GCE layer is fully differentiable. This means it can replace the initial embedding layer in existing architectures like Matrix Factorization (MF), Factorization Machines (FM), or Neural Collaborative Filtering (NCF).
  • Inductive Bias: By using the graph structure, the model starts with a "relational inductive bias"—the assumption that entities connected in the graph should have similar representations.

Datasets

The researchers evaluated their approach on four distinct benchmarks:

  1. MovieLens 100k: A classic movie recommendation dataset where the "previous movie clicked" serves as context.
  2. LastFM-1K: Music listening history where the "previous song" is the context.
  3. User-Book Interactions: A large-scale reading history dataset.
  4. Drug-Disease Interactions: A non-traditional RS task focused on drug re-purposing, where protein intersections serve as the context.

Key Insights and Ideas

  • Relational Bias is a Head Start: One of the most striking findings is that GCE-equipped models perform significantly better than baselines after just one epoch of training. This suggests that the graph structure itself captures a massive amount of interaction statistics before the neural network even begins heavy learning.
  • The "Equalizer" Effect: The GCE layer acts as a performance equalizer. It provides the biggest boost to simpler models (like Matrix Factorization), helping them close the gap with more complex, non-linear models like NCF.
  • Solving the Long Tail: GCE is particularly effective for "long-tail" items and users (those with very few interactions). By propagating information across the $N$-partite graph, the model can "borrow" knowledge from related nodes to create better embeddings for sparse entities.

Key Results

The GCE variants consistently outperformed their standard counterparts across all metrics (Hit Ratio and NDCG):

  • Significant Gains: In the MovieLens 100k dataset, the GCE-enhanced Matrix Factorization (MF-GCE) improved NDCG@10 by nearly 67% compared to standard MF.
  • Context Matters: In the Drug-Disease dataset, incorporating protein information via the GCE layer led to the highest performance, proving that the $N$-partite approach is highly effective when the data has a natural graph-like structure.
  • Robustness: The improvements were statistically significant across all tested architectures (MF, FM, and NCF), proving that GCE is a versatile "building block" for RS.

Limitations and Future Work

The authors note a few areas for further exploration:

  • Dataset Consistency: The GCE layer relies on a consistent graph structure. If a dataset is extremely fragmented or if most items are only clicked once by a single user, the graph convolutions may provide little to no benefit.
  • Computational Overhead: While the complexity is linear relative to the number of edges, pre-computing the normalized adjacency matrix for very large-scale graphs (millions of nodes) can be memory-intensive.
  • Dynamic Contexts: The current model treats context as static nodes. Future work could explore how to handle continuous or rapidly changing contextual signals more fluidly within the graph framework.

Summary updated

Abstract

Modern recommender systems (RS) work by processing a number of signals that can be inferred from large sets of user-item interaction data. The main signal to analyze stems from the raw matrix that represents interactions. However, we can increase the performance of RS by considering other kinds of signals like the context of interactions, which could be, for example, the time or date of the interaction, the user location, or sequential data corresponding to the historical interactions of the user with the system. These complex, context-based interaction signals are characterized by a rich relational structure that can be represented by a multi-partite graph. Graph Convolutional Networks (GCNs) have been used successfully in collaborative filtering with simple user-item interaction data. In this work, we generalize the use of GCNs for N-partite graphs by considering N multiple context dimensions and propose a simple way for their seamless integration in modern deep learning RS architectures. More specifically, we define a graph convolutional embedding layer for N-partite graphs that processes user-item-context interactions and constructs node embeddings by leveraging their relational structure. Experiments on several datasets show the benefits of the introduced GCN embedding layer by measuring the performance of different context-enriched tasks.
BibTeX
@inproceedings{duran2021graph,
  author = {Paula Gómez Duran and Alexandros Karatzoglou and Jordi Vitrià and Xin Xin and Ioannis Arapakis},
  title = {{Graph Convolutional Embeddings for Recommender Systems}},
  booktitle = {IEEE Access},
  year = {2021},
  url = {https://openreview.net/forum?id=U4CzqUzmXI},
}

Loading related content...

Figure