Enhancing BCI-Based Emotion Recognition Using an Improved Particle Swarm Optimization for Feature Selection

Zina Li, Lina Qiu, Ruixin Li, Zhipeng He, Jun Xiao, Yan Liang, Fei Wang, Jiahui PanSensors 2020 · OpenReview

TL;DR

This paper introduces a novel multi-stage linearly-decreasing inertia weight Particle Swarm Optimization (MLDW-PSO) algorithm for feature selection in EEG-based emotion recognition. By effectively selecting the most informative EEG features, their proposed method significantly improves classification accuracy in both offline and real-time BCI systems, achieving up to 76.67% for four-class emotion recognition and 89.5% for two-class online recognition.

What Problem Does This Paper Address?

Recognizing human emotions using Electroencephalogram (EEG) signals holds immense potential for applications in various fields, from healthcare to human-computer interaction. However, current EEG-based emotion recognition systems face two major hurdles: low classification accuracy and limited real-time applicability. A key challenge is the high dimensionality of EEG data, where many extracted features are irrelevant or redundant, making it difficult to pinpoint the most discriminative ones. This "curse of dimensionality" not only complicates pattern detection but also increases the risk of overfitting. Furthermore, most existing research focuses on offline analysis, leaving a gap in robust real-time emotion recognition systems.

Methods

The core of this paper lies in its proposed MLDW-PSO feature selection algorithm. Here's a breakdown of their approach:

  • Feature Extraction: They extract a comprehensive set of 748 features from EEG signals, categorized into three domains:
  • Time-domain: Statistical features like mean, standard deviation, and difference absolute values.
  • Frequency-domain: Power Spectral Density (PSD) features across different frequency bands (theta, alpha, beta, gamma).
  • Time-Frequency domain: Differential Entropy (DE) features and Wavelet features (entropy and energy from decomposed bands).
  • MLDW-PSO Feature Selection: This is the novel contribution. Traditional Particle Swarm Optimization (PSO) is adapted with a "multi-stage linearly-decreasing inertia weight" (MLDW) strategy. The inertia weight controls the balance between global exploration and local exploitation in the PSO search. The MLDW strategy refines this by employing different linear decreasing rates across distinct stages of the optimization process, aiming for more effective feature subset selection. A threshold (set at 0.8) is used to determine feature selection based on particle positions.
  • Classification: A Support Vector Machine (SVM) classifier with a linear kernel is used to classify the emotion states based on the selected features.

Datasets

  • DEAP Dataset: This publicly available dataset was used for offline experiments. It contains EEG and physiological signals from 32 participants who watched 40 music videos. Participants rated their arousal and valence on a 9-point scale. The study used four emotion categories derived from these ratings: HAHV, HALV, LAHV, and LALV.
  • Custom Chinese Video Dataset: For the online BCI experiment, 10 healthy volunteers were recruited. They watched 40 Chinese video clips (20 positive, 20 negative) designed to elicit specific emotions. This dataset was used to validate the real-time performance of their system.

Key Insights and Ideas

  • Subject-Dependent Feature Selection is Crucial: The study strongly suggests that individual differences in EEG signal sensitivity to various features are significant. Subject-dependent feature selection, as implemented by their MLDW-PSO, yields substantially higher accuracy than subject-independent approaches or using all features without selection.
  • MLDW-PSO Outperforms Standard PSO and Relief: The proposed MLDW-PSO algorithm consistently demonstrated superior performance in selecting informative features compared to standard PSO and the Relief feature selection algorithm, leading to higher classification accuracies across the board.
  • Multi-Stage Inertia Weighting Enhances PSO: The novel MLDW strategy for PSO appears to be a key factor in its success. By dynamically adjusting the inertia weight across different phases of the optimization, it likely allows for a more thorough and efficient search for the optimal feature subset.
  • Real-time BCI is Achievable with Effective Feature Selection: The successful implementation of a real-time emotion recognition BCI system with high accuracy demonstrates that the challenges of low accuracy and real-time application can be overcome with advanced feature selection techniques.

Key Results

  • Offline Experiment I (DEAP Dataset):
    • The MLDW-PSO strategy (specifically W6-PSO) achieved the highest average accuracy for four-class emotion recognition, reaching 76.67%.
  • This accuracy was significantly higher than individual feature types and the combination of all features without selection.
  • The MLDW-PSO method also outperformed standard PSO and the Relief algorithm, achieving an average accuracy of 76.67% compared to 72.71% (standard PSO) and 47.60% (Relief).
  • Offline Experiment II (DEAP Dataset):
    • Individual feature types (statistic, PSD, DE, RASM, wavelet) without feature selection yielded low accuracies, averaging around 41-45%.
  • The MLDW-PSO feature selection method achieved the highest average accuracy for all subjects, demonstrating its effectiveness.
  • Online Experiment III (Custom Dataset):
    • The real-time emotion recognition BCI system achieved a high average accuracy of 89.5% ± 5.68% for recognizing two emotional states (positive/negative).
  • Individual accuracies for the 10 subjects ranged from 80% to 100%.

Limitations and Future Work

  • Subject-Dependent Model Requirement: The study highlights that their subject-dependent model, while effective, requires building a specific model for each individual. This can be a limitation for applications where individual calibration is not feasible.
  • Parameter Optimization: While they proposed an improved PSO, further optimization of its parameters (e.g., inertia weight stages, threshold) could potentially yield even better results.
  • Real-time Comparative Analysis: The authors suggest future work to compare their MLDW-PSO method with other real-time feature selection algorithms.
  • Classification of More Emotional States: The current study focused on two and four emotion classes. Expanding to recognize a wider range of emotional states is a natural next step.
  • Clinical Applications and Multi-modal Integration: The authors envision expanding their BCI-based emotion recognition to clinical applications and exploring the integration of EEG with other bio-signals.

Summary updated

Abstract

Electroencephalogram (EEG) signals have been widely used in emotion recognition. However, the current EEG-based emotion recognition has low accuracy of emotion classification, and its real-time application is limited. In order to address these issues, in this paper, we proposed an improved feature selection algorithm to recognize subjects’ emotion states based on EEG signal, and combined this feature selection method to design an online emotion recognition brain-computer interface (BCI) system. Specifically, first, different dimensional features from the time-domain, frequency domain, and time-frequency domain were extracted. Then, a modified particle swarm optimization (PSO) method with multi-stage linearly-decreasing inertia weight (MLDW) was purposed for feature selection. The MLDW algorithm can be used to easily refine the process of decreasing the inertia weight. Finally, the emotion types were classified by the support vector machine classifier. We extracted different features from the EEG data in the DEAP data set collected by 32 subjects to perform two offline experiments. Our results showed that the average accuracy of four-class emotion recognition reached 76.67%. Compared with the latest benchmark, our proposed MLDW-PSO feature selection improves the accuracy of EEG-based emotion recognition. To further validate the efficiency of the MLDW-PSO feature selection method, we developed an online two-class emotion recognition system evoked by Chinese videos, which achieved good performance for 10 healthy subjects with an average accuracy of 89.5%. The effectiveness of our method was thus demonstrated.
BibTeX
@inproceedings{li2020enhancing,
  author = {Zina Li and Lina Qiu and Ruixin Li and Zhipeng He and Jun Xiao and Yan Liang and Fei Wang and Jiahui Pan},
  title = {{Enhancing BCI-Based Emotion Recognition Using an Improved Particle Swarm Optimization for Feature Selection}},
  booktitle = {Sensors},
  year = {2020},
  url = {https://openreview.net/forum?id=LRJMmduik_Z},
}
Figure