An Interactive Video Annotation Frameowrk with Multiple Modalities
Lists
Only you see this
Abstract
Active learning and semi-supervised learning methods are frequently applied in multimedia annotation tasks in order to reduce human labeling effort. However, in most of these methods only single modality is applied. This paper presents an interactive video annotation framework, which is based on semi-supervised learning and active learning with multiple multimodalities. In the proposed framework, unlabeled samples are iteratively selected to be annotated manually according to certain strategy which has taken the potentials of different modalities into account, and then a graph-based semi-supervised learning algorithm is conducted on each modality. This process repeats for several rounds, and the results obtained from multiple modalities are then fused to generate final output. The proposed framework is computationally efficient, and the experimental results on TRECVID 2005 benchmark show that the proposed framework considerably outperforms previous approaches.
BibTeX
@inproceedings{wang2007interactive,
author = {Meng Wang and Xian-Sheng Hua and Yan Song and Li-Rong Dai and Ren-Hua Wang},
title = {{An Interactive Video Annotation Frameowrk with Multiple Modalities}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2007},
doi = {10.1109/icassp.2007.366068},
}Loading related content...