Video coding based on audio-visual attention

Jong-Seok Lee, Francesca De Simone, Touradj EbrahimiICME 2009 · OpenReview

Abstract

This paper proposes an efficient video coding method based on audio-visual attention, which is motivated by the fact that cross-modal interaction significantly affects humans' perception of multimedia content. First, we propose an audio-visual source localization method to locate the sound source in a video sequence. Then, its result is used for applying spatial blurring to video frames in order to reduce redundant high-frequency information and achieve coding efficiency. We demonstrate the effectiveness of the proposed method for H.264/AVC coding along with the results of a subjective evaluation.
BibTeX
@inproceedings{lee2009video,
  author = {Jong-Seok Lee and Francesca De Simone and Touradj Ebrahimi},
  title = {{Video coding based on audio-visual attention}},
  booktitle = {ICME},
  year = {2009},
  url = {https://openreview.net/forum?id=-LHjMnn9QM},
}

Loading related content...

Figure