Multi-stream fusion network for continuous gesture recognition based on sEMG

Jun Li, Chunlong Zou, Dalai Tang, Ying Sun, Hanwen Fan, Boao Li, Xinjie TangInternational Journal of Wireless and Mobile Computing 2024 · DOI

Abstract

Dynamic gesture recognition is an essential step in human-computer interaction. However, dynamic gesture recognition based on Surface Electromyography (sEMG) signals faces issues such as incomplete feature extraction and incomplete recognition of temporal information between continuous gestures. Therefore, this paper proposes a multi-stream fusion network (MSK-LCNN) for dynamic gesture recognition to improve accuracy. We combine CNN and LSTM models into a unified framework which extracts spatio-temporal information both globally and in depth, and combines feature fusion to retain essential information. This framework uses an attention mechanism (SKNet) to learn more intricate feature information. The gesture recognition accuracy of this method on our data set is 95.23%, and on the NinaPro DB1 data set, it is 91.45%, which outperforms other similar networks in recent years. Applying this algorithm to prosthetic hand control has achieved flexible and stable control of the prosthetic hand.
BibTeX
@article{li2024multi,
  author = {Jun Li and Chunlong Zou and Dalai Tang and Ying Sun and Hanwen Fan and Boao Li and Xinjie Tang},
  title = {{Multi-stream fusion network for continuous gesture recognition based on sEMG}},
  journal = {International Journal of Wireless and Mobile Computing},
  year = {2024},
  doi = {10.1504/ijwmc.2024.138853},
}

Loading related content...

Figure