Introduction
Modern recommender systems (RS) are often criticized for being "accuracy-obsessed," leading to filter bubbles and neglecting ethical dimensions like diversity and fairness. While multi-objective optimization exists, it typically relies on fixed trade-off weights that fail to account for individual user preferences or the non-linear relationship between weights and outcomes. This paper introduces BOOML (Bayesian Optimization boosted via Orthogonal Meta-Learning), a framework designed to achieve "Level 4 Autonomy" in RS by automatically discovering personalized objective balances.
The Challenge: Moving Beyond Fixed Objectives
Traditional RS operate at lower levels of autonomy, relying on human-defined rules or simple profile-based accuracy. The authors argue for a shift toward Level 4 Autonomy, where systems independently identify and optimize uncertain, multi-objective environments.
In these complex environments, the relationship between hyperparameter weights (e.g., for diversity or fairness) and final performance is a "black box." Simply increasing a weight does not guarantee a linear improvement in that metric, necessitating a more sophisticated optimization strategy.
Methodology: BOOML
BOOML addresses these challenges through three core components:
- Bayesian Optimization (BO): BO is employed to search the weight space efficiently. By modeling the performance as a Gaussian process, the system can identify optimal trade-offs without exhaustive grid searches.
- Group-Level Personalization: Recognizing that individual-level BO is computationally prohibitive, the framework clusters users into groups based on historical behavior, finding optimal weights for each cluster.
- Orthogonal Meta-Learning: To make the iterative BO process feasible, the authors use meta-learning to accelerate model convergence. Furthermore, they implement Orthogonal Gradient Descent (PCGrad) to ensure that conflicting objectives—like accuracy and diversity—do not cancel each other out during training.
Experimental Evaluation
The framework was tested on three Amazon datasets (Games, Electronics, and Movies). Key findings include:
- Efficiency: Meta-learning reduced training time from 40-80 epochs to just 5, making the BO approach practical.
- Performance: BOOML outperformed state-of-the-art baselines (SMORL, MMoE) on aggregate metrics like Rescaled Sum and Harmonic Mean.
- Accuracy Retention: Unlike many models that sacrifice accuracy for diversity, BOOML often improved NDCG while simultaneously enhancing ethical metrics.
Conclusion
BOOML represents a significant step toward autonomous, ethical recommender systems. By treating objective balancing as a black-box optimization problem and leveraging meta-learning for efficiency, it provides a scalable way to deliver personalized, diverse, and fair recommendations. Future work will explore temporal dynamics and broader ethical dimensions like privacy and transparency.
Summary updated