Continuous Vigilance Estimation Using LSTM Neural Networks
Lists
Only you see this
Abstract
In this paper, we propose a novel continuous vigilance estimation approach using LSTM Neural Networks and combining Electroencephalogram (EEG) and forehead Electrooculogram (EOG) signals. We combine these two modalities to leverage their complementary information using a multimodal deep learning method. Moreover, since the change of vigilance level is a time dependent process, temporal dependency information is explored in this paper, which significantly improves the performance of vigilance estimation. We introduce two LSTM Neural Network architectures, the F-LSTM and the S-LSTM, to encode the time sequences of EEG and EOG into a high level combined representation, from which we can predict the vigilance levels. The experimental results demonstrate that both of the two LSTM multimodal structures can improve the performance of vigilance estimation models in comparison with the single modality models and non-temporal dependent models.
BibTeX
@inproceedings{zhang2016continuous,
author = {Nan Zhang and Wei-Long Zheng and Wei Liu and Bao-Liang Lu},
title = {{Continuous Vigilance Estimation Using LSTM Neural Networks}},
booktitle = {ICONIP},
year = {2016},
doi = {10.1007/978-3-319-46672-9\_59},
}Loading related content...