Selecting A Diverse Set Of Aesthetically-Pleasing and Representative Video Thumbnails Using Reinforcement Learning

Evlampios Apostolidis, Georgios Balaouras, Vasileios Mezaris, Ioannis Patras

Abstract

This paper presents a new reinforcement-based method for video thumbnail selection (called RL-DiVTS), that relies on estimates of the aesthetic quality, representativeness and visual diversity of a small set of selected frames, made with the help of tailored reward functions. The proposed method integrates a novel diversity-aware Frame Picking mechanism that performs a sequential frame selection and applies a reweighting process to demote frames that are visually-similar to the already selected ones. Experiments on two benchmark datasets (OVP and YouTube), using the top-3 matching evaluation protocol, show the competitiveness of RL-DiVTS against other SoA video thumbnail selection and summarization approaches from the literature.
BibTeX
@inproceedings{apostolidis2023selecting,
  author = {Evlampios Apostolidis and Georgios Balaouras and Vasileios Mezaris and Ioannis Patras},
  title = {{Selecting A Diverse Set Of Aesthetically-Pleasing and Representative Video Thumbnails Using Reinforcement Learning}},
  booktitle = {ICIP},
  year = {2023},
  doi = {10.1109/icip49359.2023.10222743},
}

Loading related content...

Figure