Multimodal metadata fusion using causal strength
Lists
Only you see this
Abstract
We propose a probabilistic framework that uses influence diagrams to fuse metadata of multiple modalities for photo annotation. We fuse contextual information (location, time, and camera parameters), visual content (holistic and local perceptual features), and semantic ontology in a synergistic way. We use causal strengths to encode causalities between variables, and between variables and semantic labels. Through analytical and empirical studies, we demonstrate that our fusion approach can achieve high-quality photo annotation and good interpretability, substantially better than traditional methods.
BibTeX
@inproceedings{wu2005multimodal,
author = {Yi Wu and Edward Y. Chang and Belle L. Tseng},
title = {{Multimodal metadata fusion using causal strength}},
booktitle = {ACM Multimedia},
year = {2005},
url = {https://openreview.net/forum?id=QDlK17fXe1k},
}Loading related content...