Joint audio-video processing for biometric speaker identification
Lists
Only you see this
Abstract
We present a bimodal audio-visual speaker identification system. The objective is to improve the recognition performance over conventional unimodal schemes. The proposed system exploits not only the temporal and spatial correlations existing in the speech and video signals of a speaker, but also the cross-correlation between these two modalities. Lip images extracted from each video frame are transformed onto an eigenspace. The obtained eigenlip coefficients are interpolated to match the rate of the speech signal and fused with Mel frequency cepstral coefficients (MFCC) of the corresponding speech signal. The resulting joint feature vectors are used to train and test a hidden Markov model (HMM) based identification system. Experimental results are included to demonstrate the system performance.
BibTeX
@inproceedings{kanak2003joint,
author = {Alper Kanak and Engin Erzin and Yücel Yemez and A. Murat Tekalp},
title = {{Joint audio-video processing for biometric speaker identification}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2003},
url = {https://openreview.net/forum?id=odDgjOs7Ei},
}Loading related content...