Introduction: The "Why" Behind the "What"
Traditional sequential recommendation (SR) systems excel at pattern matching—identifying that a user who buys a camera is likely to buy a lens. However, these models often overlook the underlying causal factors, or unobserved confounders, that drive both item availability and user preference. For instance, a seasonal trend or a shift in mood might be the true driver behind a sequence of purchases.
The authors of FCSRec argue that while time is often used as a feature, it is not the cause of behavior but rather a mirror of changing confounders. Simply merging time embeddings with item data can introduce noise, obscuring the core sequential dependencies.
Methodology: The FCSRec Framework
To address these challenges, the authors propose FCSRec (Flow-based Time-aware Causal Structure for Sequential Recommendation). The framework integrates three core components to explicitly model hidden causal influences.
1. Causal Normalizing Flows
Since confounders are unobservable, FCSRec employs Autoregressive Normalizing Flows (ANFs). These flows transform simple random noise into complex representations of hidden factors. By assuming a topological causal order, the model learns the strength of causal paths between these factors dynamically.
2. Time-Conditioned Guidance
To ensure confounder representations are context-aware, temporal data (month, day, hour) is processed through a Multi-Layer Perceptron (MLP). This output serves as a "prior" for the Normalizing Flow, making the generated confounders sensitive to the specific timing of user interactions.
3. Classifier-free Training
Inspired by diffusion models, the authors utilize a "classifier-free" training paradigm. By randomly masking confounder influences during training, the model is forced to learn both pure item-to-item patterns and the impact of hidden confounders. A control factor ($\alpha$) allows for balancing these signals during inference.
Experimental Results
FCSRec was evaluated against state-of-the-art baselines like SASRec and TiSASRec across eight diverse datasets, ranging from movie recommendations (ML-100K, ML-1M) to location-based social networks (Gowalla).
Key findings include:
- Significant Accuracy Gains: On the ML-100K dataset, FCSRec achieved a Recall@10 of 0.09752, nearly doubling the performance of SASRec.
- Robustness Across Scales: The model consistently outperformed baselines regardless of dataset size or sparsity.
- Meaningful Representations: T-SNE visualizations revealed that learned item representations naturally clustered by month, confirming the model's ability to capture time-sensitive nuances without explicit labels.
Conclusion and Future Directions
FCSRec demonstrates that modeling the "hidden causes" of user behavior through Normalizing Flows and time-aware guidance significantly improves recommendation quality. While the model currently focuses on the mathematical influence of confounders, future work aims to enhance the interpretability of these learned structures and explore more complex causal discovery techniques.
Summary updated