Viewpoint invariant sign language recognition

Qi Wang, Xilin Chen, Liang-Guo Zhang, Chunli Wang, Wen Gao

Abstract

Sign language is the primary modality of communication among deaf and mute society all over the world. This paper proposes a viewpoint independent method for sign recognition. Considering that two sequences of the same sign can be roughly considered as the input of a stereo vision system after time-warping, and the fundamental matrix associated with two views should be unique, we can convert the temporal-spatial recognition task as a verification task within a stereo vision framework. After time-warping of the input sequences, the proposed framework can reach both temporal and viewpoint invariance. We demonstrate the efficiency of the proposed framework by recognizing a vocabulary of 100 words of Chinese sign language. The recognition rate is up to 97% at rank 3. Furthermore, the proposed framework can be easily extended to other recognition tasks, such as gait recognition and lip-reading recognition.
BibTeX
@article{wang2007viewpoint,
  author = {Qi Wang and Xilin Chen and Liang-Guo Zhang and Chunli Wang and Wen Gao},
  title = {{Viewpoint invariant sign language recognition}},
  journal = {Comput. Vis. Image Underst.},
  year = {2007},
  url = {https://openreview.net/forum?id=9Twct_Po0J},
}

Loading related content...

Figure