Enhanced multimodal emotion recognition in healthcare analytics: A deep learning based model-level fusion approach

Md. Milon Islam, Sheikh Nooruddin, Fakhri Karray, Ghulam MuhammadBiomedical Signal Processing and Control 2024 · OpenReview

Abstract

Highlights•Develop a novel model-level fusion approach for emotion recognition through multimodal signals in connected healthcare.•Exploit the DSCNN and Bi-LSTM networks to retrieve the features from the facial videos and physiological signals.•Fuse the extracted features through soft attention mechanism enabling to find out the most relevant patterns.•Perform extensive experiments using benchmark dataset considering several baseline architectures.
BibTeX
@article{islam2024enhanced,
  author = {Md. Milon Islam and Sheikh Nooruddin and Fakhri Karray and Ghulam Muhammad},
  title = {{Enhanced multimodal emotion recognition in healthcare analytics: A deep learning based model-level fusion approach}},
  journal = {Biomedical Signal Processing and Control},
  year = {2024},
  url = {https://openreview.net/forum?id=ILEGOmOxOs},
}

Loading related content...

Figure