Abstract
Our perceptual reality relies on inferences about the causal structure of the world given by multiple sensory inputs. In ecological settings, multisensory events that cohere in time and space benefit inferential processes: hearing and seeing a speaker enhances speech comprehension, and the acoustic changes of flapping wings naturally pace the motion of a flock of birds. Here, we asked how a few minutes of (multi)sensory training could shape cortical interactions in a subsequent perceptual task, and investigated oscillatory activity and functional connectivity as a function of sensory history in training. Human participants performed a visual motion coherence discrimination task while being recorded with magnetoencephalography (MEG). Three groups of participants performed the same task with visual stimuli only, while listening to acoustic textures temporally comodulated with the strength of visual motion coherence, or with auditory noise uncorrelated with visual motion. The functional connectivity patterns before and after training were contrasted to resting-state networks to assess the variability of common task-relevant networks, and the emergence of new functional interactions following training. One main finding is the emergence of a large-scale synchronization in the high $\gamma$ (gamma: 60–120 Hz) and $\beta$ (beta: 15–30 Hz) bands for individuals who underwent comodulated multisensory training. The post-training network involved prefrontal, parietal, and visual cortices. Our results suggest that the integration of evidence and decision-making strategies become more efficient following congruent multisensory training through plasticity in network routing and oscillatory regimes.
Introduction
How does our sensory history shape the way we perceive the world? While we know that multisensory experiences—like seeing a speaker's lips move while hearing their voice—improve learning and perception, the underlying neural "wiring" changes remain poorly understood. This study investigates whether training with sound actually changes the way the visual cortex communicates with the rest of the brain when the sound is no longer present.
Methods and Experimental Design
The researchers used Magnetoencephalography (MEG) to record the brain activity of 36 participants performing a visual motion coherence task. Participants identified the color of the most "organized" cloud of moving dots (red vs. green). The study followed a PRE-TRAINING -> TRAINING -> POST-TRAINING design:
- PRE: Everyone performed the task with visual stimuli only.
- TRAINING (20 mins): Participants were split into three groups: AV (Audiovisual) with congruent sounds, V (Visual) only, and CTRL (Control) with random auditory noise.
- POST: Everyone returned to the visual-only task.
The team employed weighted Phase Lag Index (wPLI) to measure functional connectivity and dynamic Statistical Parametric Mapping (dSPM) to map activity to 28 cortical regions of interest.
Results
Emergence of $\beta$ and $\gamma$ Networks
The most striking finding was the emergence of new functional networks in the $\beta$ (15–30 Hz) and high $\gamma$ (60–120 Hz) bands specifically for the AV group. These were not merely amplified versions of existing networks but entirely new patterns of interaction between the prefrontal, parietal, and visual cortices. While $\alpha$ (7–14 Hz) power suppression was similar across all groups—acting as a general "gate" for attention—the $\beta$ and $\gamma$ networks were highly sensitive to training history.
Behavioral and Connectivity Correlations
The AV group showed the largest improvement in perceptual discrimination compared to the V and CTRL groups. In the AV group, the increase in post-training $\beta$ band connectivity significantly correlated with participants' confidence ratings ($r = 0.72$). Furthermore, a "node degree" reversal in the $\beta$ network suggested a shift in how the brain prioritizes information flow, with occipito-temporal regions becoming more central after training.
Discussion
These findings suggest that congruent multisensory training induces plasticity in network routing and oscillatory regimes. High $\gamma$ activity appears to track sensory evidence, while $\beta$ oscillations mediate decision-making and confidence. By pairing visual motion with congruent sounds, the brain develops more efficient "shortcuts" for propagating sensory evidence to decision-making centers. This research opens doors for leveraging multisensory training in sensory rehabilitation and accelerated learning.
Summary updated