Find the Cliffhanger: Multi-Modal Trailerness in Soap Operas

Carlo Bretti, Pascal Mettes, Hendrik Vincent Koops, Daan Odijk, Nanne van Noord

Abstract

Creating a trailer requires carefully picking out and piecing together brief enticing moments out of a longer video, making it a challenging and time-consuming task. This requires selecting moments based on both visual and dialogue information. We introduce a multi-modal method for predicting the trailerness to assist editors in selecting trailer-worthy moments from long-form videos. We present results on a newly introduced soap opera dataset, demonstrating that predicting trailerness is a challenging task that benefits from multi-modal information. Code is available at https://github.com/carlobretti/cliffhanger
BibTeX
@misc{bretti2024find,
  author = {Carlo Bretti and Pascal Mettes and Hendrik Vincent Koops and Daan Odijk and Nanne van Noord},
  title = {{Find the Cliffhanger: Multi-Modal Trailerness in Soap Operas}},
  year = {2024},
  eprint = {2401.16076},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2401.16076},
}

Loading related content...

Figure