Co-Attention-Guided Bilinear Model for Echo-Based Depth Estimation
Lists
Only you see this
Abstract
Echoes reflect a geometric structure of a scene surrounding a sound source. In this paper, we address the problem of estimating depth maps of indoor scenes based on echoes. First, we experimentally show that fusing multiple acoustic features, especially spectrogram and angular spectrum, can improve estimation accuracy. We then propose a novel bilinear model that incorporates dense co-attention for effective feature fusion. Our model is able to obtain a compact fused feature while capturing the second-order correlations of intra-and inter-features. Thorough evaluations on two datasets demonstrate the superiority of the proposed method over the state-of-the-art echo-based depth estimation and feature fusion methods.
BibTeX
@inproceedings{irie2022co,
author = {Go Irie and Takashi Shibata and Akisato Kimura},
title = {{Co-Attention-Guided Bilinear Model for Echo-Based Depth Estimation}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2022},
doi = {10.1109/icassp43922.2022.9746476},
}Loading related content...