Z-Score Linear Discriminant Analysis for EEG Based Brain-Computer Interfaces

Rui Zhang, Peng Xu, Lanjin Guo, Yangsong Zhang, Peiyang Li, Dezhong YaoPLoS 2013 · DOI

Introduction

Linear Discriminant Analysis (LDA) is a cornerstone of classification in Brain-Computer Interfaces (BCI), particularly for EEG signal processing. Its popularity stems from its computational simplicity and efficiency. However, LDA relies on the assumption of homoscedasticity—that all classes share the same covariance matrix. In practical BCI applications, EEG data often exhibits heteroscedasticity, where different mental states produce signals with varying spreads or variances. When this assumption is violated, the standard LDA decision boundary, typically placed at the midpoint between class means, becomes suboptimal.

The Z-LDA Approach

To address the limitations of traditional LDA in heteroscedastic environments, researchers developed Z-Score Linear Discriminant Analysis (Z-LDA). This method introduces an adaptive decision boundary strategy that incorporates both the mean and the standard deviation of the projected data.

Instead of a fixed midpoint, Z-LDA defines the boundary at the point where the z-scores of the two classes are equal. This allows the boundary to shift toward the class with lower variance, effectively minimizing misclassification rates when data clusters have different "shapes."

Comparison of decision boundaries for LDA (dashed green) and Z-LDA (solid green) in a 2D feature space.

Experimental Validation

The efficacy of Z-LDA was tested using simulated datasets and two real-world BCI datasets.

Simulation Results

In simulations where the difference in standard deviations (SDs) between two classes was systematically varied, Z-LDA consistently outperformed LDA. As the heteroscedasticity increased, the performance gap widened significantly, as shown in the table below.

Classification accuracy comparison between LDA and Z-LDA across varying levels of standard deviation differences.

Real-World BCI Performance

The algorithm was further validated on the BCI Competition III (Dataset IVa) and an in-house motor imagery dataset:

  • BCI Competition III: Z-LDA achieved a mean accuracy of 81.1%, surpassing LDA's 79.7%.
  • In-House Dataset: Z-LDA reached 80.3% mean accuracy, compared to 78.9% for LDA.

Statistical analysis confirmed that the improvements were significant across subjects, demonstrating that Z-LDA is a more robust classifier for the inherent variability of EEG signals. Crucially, Z-LDA maintains high computational efficiency, adding negligible overhead compared to standard LDA, making it ideal for real-time applications.

Conclusion

Z-LDA provides a simple yet powerful enhancement to the traditional LDA framework. By accounting for unequal variances through z-score normalization, it offers superior classification accuracy without sacrificing the real-time processing capabilities essential for BCI systems. Future research may explore integrating this z-score boundary strategy with regularized variants of LDA to further improve performance in low-sample-size scenarios.

Summary updated

Abstract

Linear discriminant analysis (LDA) is one of the most popular classification algorithms for brain-computer interfaces (BCI). LDA assumes Gaussian distribution of the data, with equal covariance matrices for the concerned classes, however, the assumption is not usually held in actual BCI applications, where the heteroscedastic class distributions are usually observed. This paper proposes an enhanced version of LDA, namely z-score linear discriminant analysis (Z-LDA), which introduces a new decision boundary definition strategy to handle with the heteroscedastic class distributions. Z-LDA defines decision boundary through z-score utilizing both mean and standard deviation information of the projected data, which can adaptively adjust the decision boundary to fit for heteroscedastic distribution situation. Results derived from both simulation dataset and two actual BCI datasets consistently show that Z-LDA achieves significantly higher average classification accuracies than conventional LDA, indicating the superiority of the new proposed decision boundary definition strategy.
BibTeX
@inproceedings{zhang2013z,
  author = {Rui Zhang and Peng Xu and Lanjin Guo and Yangsong Zhang and Peiyang Li and Dezhong Yao},
  title = {{Z-Score Linear Discriminant Analysis for EEG Based Brain-Computer Interfaces}},
  booktitle = {PLoS},
  year = {2013},
  doi = {10.1371/journal.pone.0074433},
}
Figure