Loki: improving long tail performance of learning-based real-time video adaptation by fusing rule-based models

Huanhuan Zhang, Anfu Zhou, Yuhan Hu, Chaoyue Li, Guangping Wang, Xinyu Zhang, Huadong Ma, Leilei Wu, Aiyun Chen, Changhui Wu

Abstract

Maximizing the quality of experience (QoE) for real-time video is a long-standing challenge. Traditional video transport protocols, represented by a few deterministic rules, can hardly adapt to the heterogeneous and highly dynamic modern Internet. Emerging learning-based algorithms have demonstrated potential to meet the challenge. However, our measurement study reveals an alarming long tail performance issue: these algorithms tend to be bottle-necked by occasional catastrophic events due to the built-in exploration mechanisms. In this work, we propose Loki, which improves the robustness of learning-based model by coherently integrating it with a rule-based algorithm. To enable integration at feature level, we first reverse-engineer the rule-based algorithm into an equivalent "black-box" neural network. Then, we design a dual-attention feature fusion mechanism to fuse it with a reinforcement learning model. We train Loki in a commercial real-time video system through online learning, and evaluate it over 101 million video sessions, in comparison to state-of-the-art rule-based and learning-based solutions. The results show that Loki improves not only the average but also the tail performance substantially (26.30% to 44.24% reduction of stall rate and 1.76% to 2.17% increase in video throughput at 95-percentile).
BibTeX
@inproceedings{zhang2021loki,
  author = {Huanhuan Zhang and Anfu Zhou and Yuhan Hu and Chaoyue Li and Guangping Wang and Xinyu Zhang and Huadong Ma and Leilei Wu and Aiyun Chen and Changhui Wu},
  title = {{Loki: improving long tail performance of learning-based real-time video adaptation by fusing rule-based models}},
  booktitle = {MobiCom},
  year = {2021},
  doi = {10.1145/3447993.3483259},
}

Loading related content...

Figure