Movie2Comics: a feast of multimedia artwork

Richang Hong, Xiaotong Yuan, Mengdi Xu, Meng Wang, Shuicheng Yan, Tat-Seng Chua

Abstract

As a type of artwork, comics are prevalent and popular around the world. However, although there are several assistive software and tools available, the creation of comics is still a tedious and labor intensive process. This paper proposes a scheme that is able to automatically turn a movie to comics with two principles: (1) optimizing the information reservation of movie; and (2) generating outputs following the rules and styles of comics. The scheme mainly contains three components: script-face mapping, key-scene extraction, and cartoonization. Script-face mapping utilizes face recognition and tracking techniques to accomplish the mapping between character's faces and their scripts. Key-scene extraction then combines the frames derived from subshots and the extracted index frames based on subtitle to select a sequence of frames for cartoonization. Finally, the cartoonization is accomplished via four steps: panel scale, stylization, word balloon placement and comics layout. Experiments conducted on a set of movie clips have demonstrates the usefulness and e®ectiveness of the scheme.
BibTeX
@inproceedings{hong2010movie,
  author = {Richang Hong and Xiaotong Yuan and Mengdi Xu and Meng Wang and Shuicheng YAN and Tat-Seng Chua},
  title = {{Movie2Comics: a feast of multimedia artwork}},
  booktitle = {ACM Multimedia},
  year = {2010},
  doi = {10.1145/1873951.1874033},
}

Loading related content...

Figure