EEG Feature Selection via Stacked Deep Embedded Regression With Joint Sparsity

Kui Jiang, Jiaxi Tang, Yulong Wang, Chengyu Qiu, Yuanpeng Zhang, Chuang LinFrontiers in Neuroscience 2020 · DOI

Abstract

In the field of brain-computer interface (BCI), selecting efficient and robust features is critical for artificial intelligence (AI)-assisted clinical diagnosis. This study introduces a stacked deep structure for feature selection, utilizing the stacked generalized principle where random projections are added to original features in a layer-by-layer manner. This process helps "open" the manifold structure existing in the original feature space, making it more linearly separable. Evaluated on the University of Bonn epilepsy EEG dataset, the model demonstrates superior performance in classification tasks compared to benchmarking models, proving that features selected by this new structure are more meaningful and helpful to classifiers.

Introduction

Electroencephalogram (EEG) signals are a gold standard for diagnosing neurological disorders like epilepsy. However, raw EEG data is notoriously high-dimensional and noisy, with relevant patterns often buried within complex, non-linear structures called manifolds. Standard feature selection methods—filters, wrappers, and embedded methods—often struggle when data is not linearly separable. This paper addresses this gap by creating a deep structure that progressively simplifies the feature space through iterative refinement.

Methodology

The authors introduce SDE-JS-Regression (Stacked Deep Embedded Regression with Joint Sparsity). The framework is built upon a base model using $L_{2,1}$-norm regression, which enforces "joint sparsity," ensuring that only a small subset of features consistently useful across all data samples is selected.

Stacked deep structure of SDE-JS-Regression showing the iterative addition of random projections (X) to component outputs (Y).

The core innovation is the Stacked Generalized Principle. Instead of a single pass, the model operates in layers. The output of one layer is multiplied by a random projection matrix and added back to the original features as a "random shift." This iterative process effectively "untangles" the data manifold, making the input for each subsequent layer more linearly separable and easier for AI classifiers to process.

Experimental Setup and Datasets

The study utilizes the University of Bonn epilepsy EEG dataset, composed of five groups (A–E), each containing 100 single-channel EEG segments. These groups represent various states, including healthy subjects (eyes open/closed), epileptic subjects during seizure-free intervals, and subjects during active seizure activity.

Representative EEG amplitudes from the five groups (A–E) in the University of Bonn dataset, illustrating the variance in signal characteristics.

Researchers organized these signals into three specific classification tasks:

  1. Task 1: Healthy (Eye-opening) vs. Healthy (Eye-closing).
  2. Task 2: Seizure vs. Interseizure vs. Non-seizure (3-class problem).
  3. Task 3: Healthy vs. Epileptic (Binary classification).

Key Results and Insights

The SDE-JS-Regression model was compared against four benchmarks: the original E-JS-Regression, mRMR, RFE-SVM, and Relief. Across all tasks, the proposed stacked model consistently outperformed the benchmarks.

  • Strategic Randomness: While randomness is often viewed as noise, here random projections are used to shift the data distribution enough to expose underlying patterns.
  • Optimal Depth: Experimental results showed that 4–6 layers typically provide the best balance for EEG data. Adding too many layers eventually distorts the data distribution, leading to a performance drop.
  • Classifier Agnostic: The features selected improved the performance of both Support Vector Machines (SVM) and Ridge Regression classifiers, indicating the features themselves were inherently more robust.

Conclusion

The stacked deep structure effectively leverages deep learning principles to handle the non-linearity of EEG signals while maintaining the interpretability of feature selection. While the current determination of hyperparameters like the number of layers relies on trial and error or cross-validation, future work will focus on developing adaptive methods to tune these parameters automatically during training.

Summary updated

Abstract

In the field of brain-computer interface (BCI), selecting efficient and robust features is very seductive for artificial intelligence (AI)-assisted clinical diagnosis. In this study, based on an embedded feature selection model, we construct a stacked deep structure for feature selection in a layer-by-layer manner. Its promising performance is guaranteed by the stacked generalized principle that random projections added into the original features can help us to continuously open the manifold structure existing in the original feature space in a stacked way. With such benefits, the original input feature space becomes more linearly separable. We use the epilepsy EEG data provided by the University of Bonn to evaluate our model. Based on the EEG data, we construct three classification tasks. On each task, we use different feature selection models to select features and then use two classifiers to perform classification based on the selected features. Our experimental results show that features selected by our new structure are more meaningful and helpful to the classifier hence generates better performance than benchmarking models.
BibTeX
@inproceedings{jiang2020eeg,
  author = {Kui Jiang and Jiaxi Tang and Yulong Wang and Chengyu Qiu and Yuanpeng Zhang and Chuang Lin},
  title = {{EEG Feature Selection via Stacked Deep Embedded Regression With Joint Sparsity}},
  booktitle = {Frontiers in Neuroscience},
  year = {2020},
  doi = {10.3389/fnins.2020.00829},
}
Figure