Multi-Preview Recommendation via Reinforcement Learning
Lists
Only you see this
Abstract
Preview recommendations serve as a crucial shortcut for attracting users’ attention on various systems, platforms, and webpages, significantly boosting user engagement. However, the variability of preview types and the flexibility of preview duration make it challenging to use an integrated framework for multi-preview recommendations under resource constraints. In this paper, we present an approach that incorporates constrained Q-learning into a notification recommendation system, effectively handling both multi-preview ranking and duration orchestration by targeting long-term user retention. Our method bridges the gap between combinatorial reinforcement learning, which often remains too theoretical for practical use, and segmented modules in production, where model performance is typically compromised due to over-simplification. We demonstrate the superiority of our approach through off-policy evaluation and online A/B testing using Microsoft data.
BibTeX
@misc{xu2025multi,
author = {Yang Xu and Kuan-Ting Lai and Pengcheng Xiong and Zhong Wu},
title = {{Multi-Preview Recommendation via Reinforcement Learning}},
year = {2025},
url = {https://openreview.net/forum?id=0J0TNsWH8W},
howpublished = {OpenReview},
}Loading related content...