Multimodal metadata fusion using causal strength

Yi Wu, Edward Y. Chang, Belle L. TsengACM Multimedia 2005 · OpenReview

Abstract

We propose a probabilistic framework that uses influence diagrams to fuse metadata of multiple modalities for photo annotation. We fuse contextual information (location, time, and camera parameters), visual content (holistic and local perceptual features), and semantic ontology in a synergistic way. We use causal strengths to encode causalities between variables, and between variables and semantic labels. Through analytical and empirical studies, we demonstrate that our fusion approach can achieve high-quality photo annotation and good interpretability, substantially better than traditional methods.
BibTeX
@inproceedings{wu2005multimodal,
  author = {Yi Wu and Edward Y. Chang and Belle L. Tseng},
  title = {{Multimodal metadata fusion using causal strength}},
  booktitle = {ACM Multimedia},
  year = {2005},
  url = {https://openreview.net/forum?id=QDlK17fXe1k},
}

Loading related content...

Figure