Sound-Indicated Visual Object Detection for Robotic Exploration
Lists
Only you see this
Abstract
Robots are usually equipped with microphones and cameras to perceive and understand the physical world. Though visual object detection technology has achieved great success, the detection in other modalities remains unsolved. In this paper, we establish a novel robotic sound-indicated visual object detection framework, and develop a two-stream weakly-supervised deep learning architecture to connect the visual and audio modalities for localizing the sounding object. A dataset is constructed from the AudioSet to validate the proposed method and some promising applications are demonstrated on robotic platforms.
BibTeX
@inproceedings{wang2019sound,
author = {Feng Wang and Di Guo and Huaping Liu and Junfeng Zhou and Fuchun Sun},
title = {{Sound-Indicated Visual Object Detection for Robotic Exploration}},
booktitle = {IEEE International Conference on Robotics and Automation},
year = {2019},
url = {https://openreview.net/forum?id=zUzVxi5rQQI},
}Loading related content...