Layered dynamic mixture model for pattern discovery in asynchronous multi-modal streams [video applications]
Lists
Only you see this
Abstract
We propose a layered dynamic mixture model for asynchronous multi-modal fusion for unsupervised pattern discovery in video. The lower layer of the model uses generative temporal structures such as a hierarchical hidden Markov model to convert the audiovisual streams into mid-level labels, it also models the correlations in text with probabilistic latent semantic analysis. The upper layer fuses the statistical evidence across diverse modalities with a flexible meta-mixture model that assumes loose temporal correspondence. Evaluation on a large news database shows that multi-modal clusters have better correspondence to news topics than audio-visual clusters alone; novel analysis techniques suggest that meaningful clusters occur when the prediction of salient features by the model concurs with those shown in the story clusters.
BibTeX
@inproceedings{xie2005layered,
author = {Lexing Xie and Lyndon S. Kennedy and Shih-Fu Chang and Ajay Divakaran and Huifang Sun and Ching-Yung Lin},
title = {{Layered dynamic mixture model for pattern discovery in asynchronous multi-modal streams [video applications]}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2005},
doi = {10.1109/icassp.2005.1415589},
}Loading related content...