Anticipatory brain activity depends on the sensory modality of the expected stimulus: insights from single-trial analyses

Isabelle Hoxha, Sylvain Chevallier, Arnaud Delorme, Michel‐Ange AmorimbioRxiv 2023 · DOI

Abstract

Perceptual anticipation is known to impact the reaction time of decisions. While anticipatory patterns have been identified in human brain activity, the single-trial neural signature of anticipation remains unexplored. Similarly, past studies have underlined an effect of pre-stimulus alpha-band activity on reaction times. Still, it remains unknown whether this activity is stimulus-specific or rather acts as a general indicator of readiness. This study aimed to determine whether human participants expected a visual or an auditory stimulus at the single-trial level in both cued and uncued trials. We show that pre-stimulus brain activity entails information about the expected upcoming stimulus, and that the information content can be extracted from single-trial brain activity. Behavioral analyses helped uncover the link between correct anticipation and shifts in decision strategy, and additionally validated the classification of uncued trials. This understanding of single-trial stimulus-specific neural signatures of anticipation can significantly impact cognitive neuroscience, human-computer interaction, and neuroergonomics research, enabling the development of real-time systems capable of predicting and adapting to an individual’s anticipated stimuli, thereby enhancing task performance and user experience in diverse applications ranging from adaptive interfaces to clinical interventions.

Introduction

In neuroscience, we have long known that anticipation improves performance. If you know a light is about to turn green, you react faster than if it catches you by surprise. Traditionally, researchers have studied this using the Contingent Negative Variation (CNV), a slow-ramping electrical potential in the brain that appears between a warning cue and a target stimulus. However, two major gaps remained: is the CNV just a general "get ready" signal, and can we detect this expectation in a single trial without averaging hundreds of data points?

This paper investigates whether anticipatory brain activity is modality-specific (visual vs. auditory) and if it can be decoded on a trial-by-trial basis to inform real-time systems like Brain-Computer Interfaces (BCIs).

Methods

The researchers recruited 42 participants for a sensory categorization task (identifying a face vs. a sound). The experiment consisted of a Calibration Phase, where cues correctly predicted the stimulus 80% of the time, and a Test Phase, where no cues were provided, forcing internal anticipation.

Data was captured via 32-channel EEG and analyzed using Riemannian geometry to decode Event-Related Potentials (ERPs). The team also utilized the Diffusion Decision Model (DDM) to decompose reaction times into "drift rate" (processing speed) and "starting point" (initial bias).

Key Insights and Ideas

  • The CNV is a Content Carrier: The CNV is not just a clock. The spatial distribution of the signal changes based on the expected modality, suggesting the brain pre-activates specific sensory regions before the stimulus arrives.
  • Single-Trial Feasibility: For a majority of participants, the brain signal is robust enough to decode expectation in a single 400ms window before the stimulus.
EEG amplitude comparison between early baseline and anticipation states, showing the development of the CNV signal.
  • ERPs Beat Alpha Waves: While alpha-band activity is a known marker of readiness, this study found that the slow-wave ERP (the CNV) was a much more reliable feature for decoding specific modality expectations.

Key Results

  • Decoding Accuracy: In cued trials, 62% of participants showed above-chance decoding of their anticipatory state.
  • Behavioral Impact: Cues significantly reduced reaction times (RT). Correct anticipation significantly increased the drift rate ($p < 0.001$) and shifted the starting point closer to the correct decision boundary ($p = 0.018$).
Comparison of anticipatory EEG activity in cued versus uncued trials.
  • Uncued Decoding: Even without cues, researchers used post-stimulus brain activity as a proxy to show that participants were still internally anticipating specific modalities, which directly correlated with their reaction speeds.

Limitations and Future Work

While promising, not all participants showed decodable signals, possibly due to varying cognitive strategies (e.g., general readiness vs. specific mental imagery). Future work will focus on detecting the onset of anticipation in unconstrained, real-world environments. This research paves the way for "proactive" BCIs that adapt to what they know a user is about to expect.

Summary updated

Abstract

Abstract Perceptual anticipation is known to impact the reaction time of decisions. While anticipatory patterns have been identified in human brain activity, the single-trial neural signature of anticipation remains unexplored. Similarly, past studies have underlined an effect of pre-stimulus alpha-band activity on reaction times. Still, it remains unknown whether this activity is stimulus-specific or rather acts as a general indicator of readiness. This study aimed to determine whether human participants expected a visual or an auditory stimulus at the single-trial level in both cued and uncued trials. We show that pre-stimulus brain activity entails information about the expected upcoming stimulus, and that the information content can be extracted from single-trial brain activity. Behavioral analyses helped uncover the link between correct anticipation and shifts in decision strategy, and additionally validated the classification of uncued trials. This understanding of single-trial stimulus-specific neural signatures of anticipation can significantly impact cognitive neuroscience, human-computer interaction, and neuroergonomics research, enabling the development of real-time systems capable of predicting and adapting to an individual’s anticipated stimuli, thereby enhancing task performance and user experience in diverse applications ranging from adaptive interfaces to clinical interventions. Novelty and Significance With a focus on uncovering single-trial neural signatures of anticipation, this study aims to explore the specificity of pre-stimulus brain activity to expected visual or auditory stimuli in both cued and uncued trials, i.e. whether participants are informed about the upcoming stimulus or not. Our research seeks to contribute to the fundamental understanding of human cognition by elucidating the informational content embedded in anticipatory brain patterns. The insights gained hold promise in advancing fields like cognitive neuroscience and human-computer interaction, paving the way for innovative applications in adaptive interface design, real-time systems, and personalized interventions.
BibTeX
@misc{hoxha2023anticipatory,
  author = {Isabelle Hoxha and Sylvain Chevallier and Arnaud Delorme and Michel‐Ange Amorim},
  title = {{Anticipatory brain activity depends on the sensory modality of the expected stimulus: insights from single-trial analyses}},
  year = {2023},
  doi = {10.1101/2023.09.27.559806},
  howpublished = {bioRxiv},
}
Figure