Recognizing Sign Language from Brain Imaging

Nishant Ajay Mehta, Thad Starner, Melody Moore Jackson, Karolyn O. Babalola, George Andrew JamesICPR 2010 · OpenReview

Abstract

Classification of complex motor activities from brain imaging is relatively new in the fields of neuroscience and brain-computer interfaces (BCIs). We report sign language classification results for a set of three contrasting pairs of signs. Executed sign accuracy was 93.3%, and imagined sign accuracy was 76.7%. For a full multiclass problem, we used a decision directed acyclic graph of pairwise support vector machines, resulting in 63.3% accuracy for executed sign and 31.4% accuracy for imagined sign. Pairwise comparison of phrases composed of these signs yielded a mean accuracy of 73.4%. These results suggest the possibility of BCIs based on sign language.
BibTeX
@inproceedings{mehta2010recognizing,
  author = {Nishant Ajay Mehta and Thad Starner and Melody Moore Jackson and Karolyn O. Babalola and George Andrew James},
  title = {{Recognizing Sign Language from Brain Imaging}},
  booktitle = {ICPR},
  year = {2010},
  url = {https://openreview.net/forum?id=B_1t3RoG0Rv},
}

Loading related content...

Figure