Abstract
Dual Adversarial Variational Embedding (DAVE) is a novel framework designed to enhance the robustness of recommender systems against noisy interaction data. By integrating Variational Auto-encoders (VAEs) with Generative Adversarial Networks (GANs), DAVE learns personalized noise patterns and captures multi-modal user preferences. Experimental results demonstrate that DAVE significantly outperforms existing robust recommendation models across multiple benchmarks, maintaining stability even under high levels of data corruption.
Introduction
In real-world recommendation scenarios, user-item interaction logs are frequently contaminated with noise, such as accidental clicks or interactions driven by temporary trends. Most recommendation models treat these logs as ground truth, resulting in systems that are sensitive to data perturbations. Existing robust methods typically rely on fixed-level noise injection or VAEs with simple Gaussian priors, which fail to capture the personalized nature of noise or the complex, multi-modal characteristics of user preferences.
Methodology
The DAVE framework addresses these limitations through a dual-adversarial structure. It consists of two primary components: UserAVE and ItemAVE, which encode user and item interaction vectors, respectively. By modeling noise as the variance of these inferred distributions, DAVE adaptively learns unique noise levels for each user and item.
To overcome the "single-mode" limitation of standard VAEs, DAVE incorporates adversarial regularization. Auxiliary discriminators ensure that the latent space generated by the inference networks matches a complex prior. This allows the model to represent sophisticated, multi-modal preference distributions—such as a user having distinct interests in disparate genres. The resulting robust embeddings are then processed by a Neural Collaborative Filtering (NCF) network to predict final user-item ratings. The entire system is trained end-to-end, ensuring that recommendation accuracy directly informs embedding learning.
Experimental Evaluation
The model was evaluated on five diverse datasets: Yelp, Digital Music, MovieLens (100K & 1M), and Pinterest. These datasets represent a range of interaction types and sparsity levels. DAVE was compared against several state-of-the-art robust models, including APR, CDAE, and ACAE.
Results and Discussion
DAVE consistently outperformed competing models across various metrics, such as Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG). On the MovieLens 100K dataset, DAVE achieved a notable improvement in NDCG@5 compared to the next best robust method.
Key insights from the results include:
- Personalized Robustness: By allowing per-user variance, DAVE acknowledges varying reliability in user histories, treating noise as a learnable feature.
- Multi-modal Distributions: Adversarial training enables the discovery of distinct interest clusters, which traditional VAEs often merge into a single mode.
- Noise Tolerance: Stress tests involving intentional data corruption showed that DAVE maintains stable performance even as noise levels increase, widening the gap over its competitors.
Conclusion
DAVE provides a robust framework for recommendation by combining the generative power of VAEs with the flexibility of GANs. While it shows exceptional performance, future work will address challenges in extremely imbalanced datasets and explore the integration of side information, such as user demographics, to further refine personalized noise reduction.
Summary updated