A Real-Time Human Action Recognition System Using Depth and Inertial Sensor Fusion

Chen Chen, Roozbeh Jafari, Nasser KehtarnavazIEEE Sensors Journal 2015 · DOI

Abstract

This paper presents a human action recognition system that runs in real time and simultaneously uses a depth camera and an inertial sensor based on a previously developed sensor fusion method. Computationally efficient depth image features and inertial signals features are fed into two computationally efficient collaborative representative classifiers. A decision-level fusion is then performed. The developed real-time system is evaluated using a publicly available multimodal human action recognition data set by considering a comprehensive set of human actions. The overall classification rate of the developed real-time system is shown to be >97%, which is at least 9% higher than when each sensing modality is used individually. The results from both offline and real-time experimentations demonstrate the effectiveness of the system and its real-time throughputs.
BibTeX
@article{chen2015real,
  author = {Chen Chen and Roozbeh Jafari and Nasser Kehtarnavaz},
  title = {{A Real-Time Human Action Recognition System Using Depth and Inertial Sensor Fusion}},
  journal = {IEEE Sensors Journal},
  year = {2015},
  doi = {10.1109/jsen.2015.2487358},
}

Loading related content...

Figure