Probabilistic Multimodality Fusion for Event based Home Photo Clustering

Tao Mei, Bin Wang, Xian-Sheng Hua, He-Qin Zhou, Shipeng Li

Abstract

This paper presents a novel probabilistic approach to fusing multimodal metadata for event based home photo clustering. Photo events are characterized by the coherence of multimodality including time, content and camera settings. We incorporate these multimodal metadata into a unified probabilistic framework, in which event is taken as a latent semantic concept and discovered by fitting a generative model through an expectation-maximization (EM) algorithm. This approach is general and unsupervised, without any training procedure or predefined threshold. The experimental evaluations on 14 k photos taken by 10 amateur photographers have indicated the effectiveness and efficiency of the proposed framework in browsing and searching personal photo collections
BibTeX
@inproceedings{mei2006probabilistic,
  author = {Tao Mei and Bin Wang and Xian-Sheng Hua and He-Qin Zhou and Shipeng Li},
  title = {{Probabilistic Multimodality Fusion for Event based Home Photo Clustering}},
  booktitle = {ICME},
  year = {2006},
  doi = {10.1109/icme.2006.262891},
}

Loading related content...

Figure