Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation

Shengyu Zhang, Lingxiao Yang, Dong Yao, Yujie Lu, Fuli Feng, Zhou Zhao, Tat-seng Chua, Fei Wu

TL;DR

Re4 introduces a "backward flow" paradigm for multi-interest recommendation systems, ensuring that learned user interest embeddings are distinct, semantically grounded, and consistent with final matching criteria. By re-examining interests through contrastive learning, attention alignment, and item reconstruction, it achieves significant performance gains—up to a 42% improvement in NDCG—on large-scale real-world datasets.

What Problem Does This Paper Address?

Modern recommender systems often struggle to represent the multifaceted nature of human behavior. While a single "user embedding" vector might capture a general profile, it fails when a user has diverse, unrelated interests—like someone who shops for both professional photography gear and toddler toys.

Multi-interest frameworks (like MIND or ComiRec) address this by learning multiple embeddings per user. However, these models typically rely solely on a "forward flow" (mapping a sequence of items to a set of interests). The authors identify three major gaps in this approach:

  1. Redundancy: Without explicit constraints, different interest embeddings often end up nearly identical, failing to capture diverse aspects.
  2. Inconsistency: The attention mechanism used to cluster items during training often doesn't align with the similarity metric (like dot product) used to match items during the final recommendation phase.
  3. Semantic Drift: There is no guarantee that an interest embedding actually reflects the semantic content of the items it represents.

Methods

The authors propose the Re4 framework, which augments the standard forward flow with three novel "backward flow" strategies to regularize the learning process:

  1. Re-contrast: This uses contrastive learning to drive diversity. For a given interest, it "pulls" the embedding closer to its representative items (those with high attention weights) while "pushing" it away from other items in the sequence, randomly sampled items, and—crucially—other interest embeddings for the same user.
  2. Re-attend: This ensures consistency between training and inference. It explicitly minimizes the distance between the forward-flow attention weights and the actual interest-item correlation (e.g., dot product) used for final recommendations.
  3. Re-construct: To ensure semantic reflection, this component uses a self-attention mechanism to attempt to reconstruct the original representative items from the interest embedding. This forces the embedding to retain fine-grained information about the items it represents.
Figure 1: An illustration of leveraging backward flows for multi-interest representation learning. (a) The traditional forward flow that clusters items and extracts multiple inter- ests. (b) The proposed backward flows, i.e., Re-contrast which learns distinct multi-interests; Re-construct which permits interests’ semantic reflection on representative items; and Re-attend which ensures the consistency between attention weights in the forward flow and recommendation correla- tion.

Importantly, these backward flows are only used during training. The inference phase remains as efficient as standard multi-interest models, making it highly practical for industrial applications.

Datasets

The researchers evaluated Re4 on three widely used public benchmarks:

  • Amazon Books: A massive dataset where users typically exhibit highly diverse interests.
  • MovieLens-1M: A standard movie rating dataset.
  • Gowalla: A dataset of location check-ins.

Detailed statistics for these datasets, including user/item counts and interaction density, are summarized in the paper's Table 1.

Table 1: Dataset Statistics.

Key Insights and Ideas

  • The Power of "Looking Back": The core "aha moment" is that interest extraction shouldn't just be a one-way street. By forcing the model to "explain" the items back from the interests, the resulting embeddings become much more robust.
  • Diversity vs. Randomness: Standard multi-head attention often relies on random initialization to find different interests. Re-contrast turns this into an explicit objective, ensuring that if a user has four distinct interests, the model learns four distinct vectors.
  • Fine-Grained Capture: The Re-construct module allows the model to move beyond coarse categories (e.g., "Sports") to fine-grained interests (e.g., "Basketball" vs. "Football"). This is particularly evident in the t-SNE visualizations.
Visualization of multi-interest embeddings and item embeddings.
Figure 4 shows how Re4 (bottom) creates much clearer, more distinct clusters of interests (stars) and their corresponding items (dots) compared to the base model (top).

Key Results

  • Significant Accuracy Gains: Re4 consistently outperformed state-of-the-art baselines like ComiRec and MIND. On the Amazon dataset, it achieved a staggering 40.44% improvement in Recall@20 and a 42.05% improvement in NDCG@20.
  • Faster Convergence: As shown in Figure 3, Re4 not only reaches a higher performance ceiling but also learns much faster in the early stages of training compared to the base model.
Figure 3: Test performance across different epochs of Base without backward flow and Re4.
Figure 3: Re4 (orange) achieves better performance earlier in the training process than the base model (blue).

Limitations and Future Work

While Re4 shows impressive results, the authors acknowledge that the backward flow strategies add some complexity to the training phase. They suggest that future work could involve:

  • Extending the Re4 paradigm to content-based recommenders that utilize rich item metadata (text, images).
  • Exploring additional backward flow strategies that incorporate auxiliary features like timestamps or location data to further refine interest extraction.

Summary updated

Abstract

Effectively representing users lie at the core of modern recommender systems. Since users' interests naturally exhibit multiple aspects, it is of increasing interest to develop multi-interest frameworks for recommendation, rather than represent each user with an overall embedding. Despite their effectiveness, existing methods solely exploit the encoder (the forward flow) to represent multiple aspects of interests. However, without explicit regularization, the interest embeddings may not be distinct from each other nor semantically reflect representative historical items. Towards this end, we propose the Re4 framework, which leverages the backward flow to reexamine each interest embedding. Specifically, Re4 encapsulates three backward flows, i.e., 1) Re-contrast, which drives each interest embedding to be distinct from other interests using contrastive learning; 2) Re-attend, which ensures the interest-item correlation estimation in the forward flow to be consistent with the criterion used in final recommendation; and 3) Re-construct, which ensures that each interest embedding can semantically reflect the information of representative items that relate to the corresponding interest. We demonstrate the novel forward-backward multi-interest paradigm on ComiRec, and perform extensive experiments on three real-world datasets. Empirical studies validate that Re4 helps to learn learning distinct and effective multi-interest representations.
BibTeX
@inproceedings{zhang2022re,
  author = {Shengyu Zhang and Lingxiao Yang and Dong Yao and Yujie Lu and Fuli Feng and Zhou Zhao and Tat-seng Chua and Fei Wu},
  title = {{Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation}},
  booktitle = {The Web Conference},
  year = {2022},
}
Figure