Enhancing Brain–Computer Interface Performance by Incorporating Brain-to-Brain Coupling

Tianyu Jia, Jingyao Sun, Ciarán McGeady, Linhong Ji, Chong LiCyborg 2024 · DOI

TL;DR

This study explores how social interaction, specifically eye contact and touch, can enhance brain-computer interface (BCI) performance during motor imagery tasks. By measuring brain activity and inter-brain coupling in pairs of friends, the researchers found that social interaction significantly improved BCI decoding accuracy and cortical activation, suggesting a promising new avenue for BCI development.

What Problem Does This Paper Address?

Brain-computer interfaces (BCIs) offer a revolutionary way to communicate and control external devices by directly interpreting brain signals. However, a major hurdle for widespread BCI adoption is the significant variability in decoding accuracy among users, with some individuals being "BCI illiterate." This variability is partly attributed to differences in users' ability to modulate their own cortical activity. The paper addresses this by investigating whether incorporating elements of social interaction, which are known to influence human cooperation and cognitive processes, can boost neural activity and, consequently, improve BCI performance. The researchers hypothesize that leveraging brain-to-brain coupling, a phenomenon observed during social interactions, could be a key to unlocking more robust and accurate BCI control.

Methods

The study employed electroencephalography (EEG) hyperscanning to simultaneously record brain activity from pairs of participants. Participants performed motor imagery (MI) tasks under four conditions: no contact, eye contact, hand contact, and eye and hand contact.

  • Cortical Activation Measurement: Event-related desynchronization (ERD) in the alpha band (8-13 Hz) was used to quantify cortical activation. ERD is a decrease in alpha band power, which is associated with increased cortical activity and motor-related behavior.
  • Interbrain Functional Connectivity: The Hilbert transform was used to estimate instantaneous phases of EEG signals. Circular Correlation Coefficient (CCorr) was then calculated to measure interbrain coupling in both theta and alpha bands, reflecting the synchronization between the brains of interacting partners.
  • BCI Performance Evaluation: Common spatial pattern and linear discriminant analysis were used for feature extraction and classification to decode motor intentions. BCI decoding accuracy was compared across the different social interaction conditions.
  • Statistical Analysis: Multilevel statistical analysis was used to account for the nested data structure. Wilcoxon signed-rank tests and paired-sample t-tests were employed for comparisons, with FDR correction applied to control for multiple comparisons.

Datasets

The study utilized EEG data collected from participants during the experimental tasks. No external datasets were used for training or evaluation. The data was collected from 12 pairs of friends (experimental group) and 10 pairs of strangers (control group).

Key Insights and Ideas

  • Social Interaction Enhances Cortical Activation: For familiar partners (friends), social interaction conditions (eye contact, hand contact, and combined) led to greater ERD in the sensorimotor cortex compared to the no-contact condition. This suggests that social cues can amplify neural engagement during MI tasks.
  • Eye Contact is a Key Driver: The most significant improvements in BCI decoding accuracy were observed in the eye contact and eye-and-hand contact conditions, indicating that visual social cues play a crucial role in enhancing performance.
  • Familiarity Matters: The positive effects of social interaction on cortical activation and BCI performance were observed only in the experimental group (friends). The control group (strangers) did not show similar improvements, highlighting the importance of interpersonal familiarity and closeness.
  • Interbrain Coupling Reflects Social Dynamics: Social interaction conditions, particularly eye contact and combined contact, led to increased interbrain coupling, suggesting enhanced neural synchronization between partners. This coupling was observed in both theta and alpha bands, reflecting different aspects of cognitive and social processing.
  • A Novel Approach for BCI Enhancement: The findings propose a novel method for improving BCI performance by integrating social interaction, leveraging the natural human tendency for cooperation and synchronization.

Key Results

  • Cortical Activation: In the experimental group, greater mean ERD was observed in eye contact (-0.38 ± 0.09), hand contact (-0.42 ± 0.12), and eye and hand contact (-0.44 ± 0.10) conditions compared to the no-contact condition. Significant differences were found for hand contact (P < 0.05) and eye and hand contact (P < 0.05).
  • Interbrain Coupling: Significant increases in interbrain coupling were found under social interaction conditions, particularly in the theta band for eye contact and in the alpha band for hand contact. The eye and hand contact condition showed strong interbrain coupling patterns in both bands.
  • BCI Performance: BCI decoding accuracies were significantly improved in the eye contact condition (78.9 ± 13.4%) and the eye and hand contact condition (77.9 ± 13.9%) compared to the no-contact condition (70.7 ± 14.2%) (P < 0.05). The hand contact condition showed a non-significant trend towards improvement (75.2 ± 15.1%).
  • Control Group: No significant positive effects on cortical activation or BCI decoding accuracy were observed in the stranger group.

Limitations and Future Work

  • Sample Size and Population: The study was conducted with a relatively small sample size, and the proposed method was only tested on healthy participants. Future work should involve larger-scale trials and application in clinical settings, such as stroke rehabilitation.
  • Clinical Application: The potential clinical use of this method needs to be verified through further research.
  • Leader-Follower Roles: While the study explored leader-follower roles, further investigation into how these roles influence interbrain coupling and BCI performance could be beneficial.
  • Generalizability: The findings are specific to motor imagery tasks. Future research could explore the impact of social interaction on other types of BCI paradigms.

Summary updated

Abstract

Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.
BibTeX
@inproceedings{jia2024enhancing,
  author = {Tianyu Jia and Jingyao Sun and Ciarán McGeady and Linhong Ji and Chong Li},
  title = {{Enhancing Brain–Computer Interface Performance by Incorporating Brain-to-Brain Coupling}},
  booktitle = {Cyborg},
  year = {2024},
  doi = {10.34133/cbsystems.0116},
}
Figure