Me-link: link me to the media - fusing audio and visual cues for robust and efficient mobile media interaction

Chun-Yen Yeh, Yu-Ming Hsu, Hsinfu Huang, Hong-Wun Jheng, Yu-Chuan Su, Tzu-Hsuan Chiu, Winston H. Hsu

Abstract

In this demo, we present a scalable mobile video recognition system, named "Me-link," based on progressive fusion of light-weight audio visual features. With our system, users only have to point the mobile camera to the video they are interested in. The system will capture the frames and sounds, then retrieve relevant information immediately. As the users hold the mobile longer, the system progressively aggregates the cues temporally and then returns more accurate results. We also consider the real world noisy environment, where users may not get clear visual or audio signals. In the aggregation step of audio and visual cues, our system automatically detects the available channel for the final rank. On the server side, users can upload the videos with information via website. Besides, we also link the streaming signals so that users can get the real time broadcasting with ``Me-link".
BibTeX
@inproceedings{yeh2014me,
  author = {Chun-Yen Yeh and Yu-Ming Hsu and Hsinfu Huang and Hong-Wun Jheng and Yu-Chuan Su and Tzu-Hsuan Chiu and Winston H. Hsu},
  title = {{Me-link: link me to the media - fusing audio and visual cues for robust and efficient mobile media interaction}},
  booktitle = {The Web Conference},
  year = {2014},
  doi = {10.1145/2567948.2577018},
}

Loading related content...

Figure