Multimodal concept-dependent active learning for image retrieval

Kingshy Goh, Edward Y. Chang, Wei-Cheng LaiACM Multimedia 2004 · OpenReview

Abstract

It has been established that active learning is effective for learning complex, subjective query concepts for image retrieval. However, active learning has been applied in a concept independent way, (i.e., the kernel-parameters and the sampling strategy are identically chosen) for learning query concepts of differing <i>complexity</i>. In this work, we first characterize a concept's complexity using three measures: <i>hit-rate</i>, <i>isolation</i> and <i>diversity</i>. We then propose a multimodal learning approach that uses images' semantic labels to guide a <i>concept-dependent</i>, <i>active-learning</i> process. Based on the complexity of a concept, we make intelligent adjustments to the sampling strategy and the sampling pool from which images are to be selected and labeled, to improve concept learnability. Our empirical study on a $300$K-image dataset shows that concept-dependent learning is highly effective for image-retrieval accuracy.
BibTeX
@inproceedings{goh2004multimodal,
  author = {Kingshy Goh and Edward Y. Chang and Wei-Cheng Lai},
  title = {{Multimodal concept-dependent active learning for image retrieval}},
  booktitle = {ACM Multimedia},
  year = {2004},
  url = {https://openreview.net/forum?id=AR1l3vMrji0},
}

Loading related content...

Figure