Sequences, Items And Latent Links: Recommendation With Consumed Item Packs

Rachid Guerraoui, Erwan Le Merrer, Rhicheek Patra, Jean-Ronan VigourouxarXiv 2017 · arXiv

TL;DR

This paper introduces Consumed Item Packs (CIPs), a generic framework that treats sequences of user actions as cohesive "packs" to uncover deep latent links between users and items. By leveraging these packs, the authors develop three novel, incremental recommenders (user-based, item-based, and neural-embedding-based) that outperform traditional state-of-the-art methods using only implicit consumption data.

Problem Statement

Most recommendation engines rely on explicit feedback, like star ratings or "likes." However, this data is notoriously sparse—most users consume content without ever rating it. While implicit feedback (e.g., watch history, clickstreams) is abundant, it’s harder to model effectively.

The challenge is twofold:

  1. Capturing Context: Simple item-to-item correlations often miss the underlying intent behind a sequence of actions.
  2. Scalability and Freshness: In production, systems must react to new user actions instantly. Many high-performing models require expensive batch retraining, making them slow to suggest "fresh" items based on a user's most recent activity.

Methodology

The authors propose the Consumed Item Pack (CIP) as a higher-level abstraction. A CIP is defined as a window of items consumed by a user within a specific timeframe or "hop" distance in their history. This framework is instantiated into three distinct algorithms:

  • CIP-U (User-based): Employs a novel "Hammock Distance" (the number of hops between items in a user's profile) to calculate similarity. It identifies "neighbors" who consume items in similar sequential patterns rather than just overlapping sets.
  • CIP-I (Item-based): Measures the co-occurrence frequency of items within the same packs, applying a penalty to items that are temporally distant.
  • DEEPCIP (Embedding-based): Adapts the Word2Vec (Skip-gram) model for recommendation. It treats items in a CIP like words in a sentence, learning vector representations (embeddings) that capture the "semantic taste" of a user's consumption habits.

Crucially, all three are designed for incremental updates on Apache Spark. Instead of retraining the entire model, they process small batches of new events to update similarities on the fly, ensuring recommendations remain current.

Datasets

The researchers evaluated their models using three well-known real-world datasets: MovieLens 100K, MovieLens 1M, and Ciao. The Ciao dataset is significantly sparser (0.36% density) than MovieLens, providing a rigorous test for the model's robustness in data-poor environments.

Table 1: Statistics of the datasets used for evaluation, highlighting varying levels of sparsity.

The datasets were replayed chronologically using timestamps to simulate a real-world production environment, ensuring the evaluation reflects actual system performance.

Key Insights and Ideas

  • Beyond Genres: The authors used community detection on movie graphs to demonstrate that CIPs capture latent features that transcend traditional metadata like "genre" or "release date." A pack might represent a specific "mood" or a niche consumption habit that standard labels miss.
Figure 1: Community detection on movie graphs showing genre distributions within CIP-derived clusters.
  • The "Hammock" Concept: By focusing on the "distance" between items in a sequence, the model distinguishes between a user who happens to like two popular items and a user who consumes them as part of a specific, related session.
  • Asynchronous Scaling: For DEEPCIP, the authors utilized "Downpour-SGD," allowing multiple computing nodes to update the model asynchronously. This approach demonstrated superior scalability compared to Spark’s built-in Alternating Least Squares (ALS) algorithm.

Key Results

  • Accuracy: DEEPCIP consistently outperformed baseline models. In the MovieLens 1M dataset, CIP-based models provided a 1.8x to 2.4x improvement in precision over popular time-based implicit recommenders.
  • Competitive with Explicit Models: Despite using only implicit data (what people watched), the CIP models were competitive with—and sometimes outperformed—SVD-based models that had access to explicit ratings.
  • Linear Scalability: The system demonstrated near-linear speedup as more computing nodes were added, proving its capability to handle the massive volumes of data characteristic of the modern era.

Limitations and Future Work

  • Hyperparameter Sensitivity: The models rely on tuning the "distance" (δ) that defines a pack. The optimal window varies significantly between domains (e.g., minutes for movies vs. days for retail).
  • Re-consumption: The current framework assumes an item appears only once per pack. Future iterations could extend the math to account for users who repeat-buy or re-watch content.
  • Privacy: Incorporating privacy-preserving techniques, such as differential privacy, into these incremental updates is a necessary next step for real-world deployment.

Summary updated

Abstract

Recommenders personalize the web content by typically using collaborative filtering to relate users (or items) based on explicit feedback, e.g., ratings. The difficulty of collecting this feedback has recently motivated to consider implicit feedback (e.g., item consumption along with the corresponding time). In this paper, we introduce the notion of consumed item pack (CIP) which enables to link users (or items) based on their implicit analogous consumption behavior. Our proposal is generic, and we show that it captures three novel implicit recommenders: a user-based (CIP-U), an item-based (CIP-I), and a word embedding-based (DEEPCIP), as well as a state-of-the-art technique using implicit feedback (FISM). We show that our recommenders handle incremental updates incorporating freshly consumed items. We demonstrate that all three recommenders provide a recommendation quality that is competitive with state-of-the-art ones, including one incorporating both explicit and implicit feedback.
BibTeX
@misc{guerraoui2017sequences,
  author = {Rachid Guerraoui and Erwan Le Merrer and Rhicheek Patra and Jean-Ronan Vigouroux},
  title = {{Sequences, Items And Latent Links: Recommendation With Consumed Item Packs}},
  year = {2017},
  eprint = {1711.06100},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1711.06100},
}
Figure