A Linguistic Feature Vector for the Visual Interpretation of Sign Language

Richard Bowden, David Windridge, Timor Kadir, Andrew Zisserman, Michael Brady

Abstract

This paper presents a novel approach to sign language recognition that provides extremely high classification rates on minimal training data. Key to this approach is a 2 stage classification procedure where an initial classification stage extracts a high level description of hand shape and motion. This high level description is based upon sign linguistics and describes actions at a conceptual level easily understood by humans. Moreover, such a description broadly generalises temporal activities naturally overcoming variability of people and environments. A second stage of classification is then used to model the temporal transitions of individual signs using a classifier bank of Markov chains combined with Independent Component Analysis. We demonstrate classification rates as high as 97.67% for a lexicon of 43 words using only single instance training outperforming previous approaches where thousands of training examples are required.
BibTeX
@inproceedings{bowden2004linguistic,
  author = {Richard Bowden and David Windridge and Timor Kadir and Andrew Zisserman and Michael Brady},
  title = {{A Linguistic Feature Vector for the Visual Interpretation of Sign Language}},
  booktitle = {European Conference on Computer Vision},
  year = {2004},
  doi = {10.1007/978-3-540-24670-1\_30},
}

Loading related content...

Figure