Learned Motor Patterns Are Replayed in Human Motor Cortex during Sleep

Daniel B. Rubin, Tommy Hosman, Jessica N. Kelemen, Anastasia Kapitonava, Francis R. Willett, Brian Coughlin, Eric Halgren, Eyal Y. Kimchi, Ziv M. Williams, John D. Simeral, Leigh R. Hochberg, Sydney S. CashJournal of Neuroscience 2022 · DOI

TL;DR

This study provides the first direct evidence of motor sequence replay in the human motor cortex during sleep. Using a brain-computer interface (BCI) in a participant with tetraplegia, researchers decoded neural activity during a novel motor task and then during subsequent sleep, finding that the neural patterns associated with the learned task were replayed, often at an accelerated speed. This finding supports the role of sleep in consolidating motor memories.

What Problem Does This Paper Address?

The consolidation of memories, particularly motor skills, is thought to involve the brain "replaying" neural activity patterns learned during wakefulness, especially during sleep. While this phenomenon, known as replay, has been well-documented in rodents, evidence in humans, especially concerning motor learning, has been less compelling. Previous human studies often relied on indirect measures or couldn't record during sleep. This paper aims to bridge this gap by directly investigating whether learned motor sequences are replayed in the human motor cortex during sleep, using advanced intracortical recording techniques.

Methods

The core of this study's methodology lies in the combination of a sophisticated brain-computer interface (BCI) and overnight neural recording.

  • Intracortical Recording: A participant with tetraplegia had two 96-channel microelectrode arrays chronically implanted in their left precentral gyrus (motor cortex). This allowed for high-resolution recording of single- and multi-unit neural activity.
  • BCI Decoding: A real-time steady-state Kalman filter was used to decode intended movements from the recorded neural activity. This decoder was trained during a motor task where the participant controlled a cursor. Crucially, the same decoder parameters were used to analyze neural activity during sleep.
  • Motor Task: The participant learned a novel visuomotor sequence matching game, similar to the game "Simon." They had to imagine moving a neurally controlled cursor to match a sequence of colored targets.
  • Overnight Sleep Recording: Intracortical neural activity and scalp EEG were recorded throughout the night as the participant slept.
  • Replay Detection: The Kalman filter, trained on the awake task, was used to analyze the neural data recorded during sleep. By comparing the neural activity patterns to "template trajectories" derived from successful task trials, the researchers identified instances where the learned motor sequence was replayed. These instances were termed "simultaneous threshold crossing events" (STCEs).
  • Statistical Controls: Rigorous statistical methods, including bootstrapping and phase-randomized controls, were employed to ensure that the observed replay events were significantly greater than what would be expected by chance.
  • Sleep Stage Analysis: Scalp EEG was used to identify sleep stages, allowing the researchers to investigate the relationship between replay events and slow-wave sleep (SWS).
  • Temporal Compression Analysis: The researchers analyzed whether the replayed sequences occurred at different speeds compared to the original task.

Datasets

Not discussed in the paper. The study utilized data collected from a single research participant during experimental sessions.

Key Insights and Ideas

  • Direct Evidence of Motor Replay in Humans: This is the first study to provide direct, intracortical evidence of learned motor sequences being replayed in the human motor cortex during sleep. This moves beyond indirect evidence or findings in animal models.
  • Sleep as a Crucial Time for Motor Memory Consolidation: The findings strongly support the hypothesis that sleep plays a vital role in solidifying newly acquired motor skills by reactivating the neural patterns used to perform them.
  • BCI as a Tool for Neuroscience Research: The study highlights the power of advanced BCI technology not only for restoring function but also as a sophisticated tool for investigating fundamental neuroscience questions about learning and memory.
  • Replay Occurs at Compressed Timescales: A significant finding is that motor sequences are often replayed at speeds faster than the original learning, ranging from 1 to 4 times the original speed. This temporal compression is a known phenomenon in animal studies and suggests an efficient mechanism for memory consolidation.
  • SWS is Key for Replay: Replay events were most frequently observed during slow-wave sleep (SWS), a stage of sleep strongly associated with memory consolidation.

Key Results

  • Significant Replay Events: The number of detected replay events (STCEs) during overnight sleep was significantly higher than expected by chance, as confirmed by multiple statistical controls.
  • Temporal Compression: Replayed motor sequences were observed at speeds ranging from 1 to 4 times faster than the original task execution.
  • Sleep Stage Correlation: Replay events were significantly more likely to occur during slow-wave sleep (SWS) compared to other sleep stages.
  • Spiking Order Preservation: The order of neural firing during replay events closely matched the order of firing during the original task performance, indicating a faithful recapitulation of the learned sequence.
  • Ripple Activity Association: Replay events were found to be temporally correlated with cortical ripple activity, a brief burst of coordinated neural firing known to be associated with memory processes.

Limitations and Future Work

  • Single Participant Study: The most significant limitation acknowledged by the authors is that the study was conducted on a single participant. This is attributed to the technical challenges and ethical considerations of chronic intracortical recordings in humans, especially during overnight sleep. Future work aims to replicate these findings in multiple participants.
  • EEG Limitations: The use of a single-channel EEG limited the ability to precisely stage sleep and explore the relationship with other electrophysiological sleep phenomena like spindles and K-complexes. Future studies will utilize more robust EEG setups.
  • Temporal Compression Interpretation: While temporal compression was observed, the exact behavioral significance and the precise role of the Kalman filter's time constant in this phenomenon require further investigation. Future work will explore varying task durations and replay speeds.
  • Task Difficulty and Replay: The participant's performance and replay patterns varied between recording sessions, potentially influenced by task difficulty and acquired BCI proficiency. Future studies will systematically vary task difficulty to understand its impact on replay.
  • Generalizability: While the findings support broad models of memory consolidation, further research is needed to determine if these replay mechanisms are specific to motor learning or generalize to other types of memory (e.g., semantic, spatial).

Summary updated

Abstract

Consolidation of memory is believed to involve offline replay of neural activity. While amply demonstrated in rodents, evidence for replay in humans, particularly regarding motor memory, is less compelling. To determine whether replay occurs after motor learning, we sought to record from motor cortex during a novel motor task and subsequent overnight sleep. A 36-year-old man with tetraplegia secondary to cervical spinal cord injury enrolled in the ongoing BrainGate brain-computer interface pilot clinical trial had two 96-channel intracortical microelectrode arrays placed chronically into left precentral gyrus. Single- and multi-unit activity was recorded while he played a color/sound sequence matching memory game. Intended movements were decoded from motor cortical neuronal activity by a real-time steady-state Kalman filter that allowed the participant to control a neurally driven cursor on the screen. Intracortical neural activity from precentral gyrus and 2-lead scalp EEG were recorded overnight as he slept. When decoded using the same steady-state Kalman filter parameters, intracortical neural signals recorded overnight replayed the target sequence from the memory game at intervals throughout at a frequency significantly greater than expected by chance. Replay events occurred at speeds ranging from 1 to 4 times as fast as initial task execution and were most frequently observed during slow-wave sleep. These results demonstrate that recent visuomotor skill acquisition in humans may be accompanied by replay of the corresponding motor cortex neural activity during sleep.<b>SIGNIFICANCE STATEMENT</b> Within cortex, the acquisition of information is often followed by the offline recapitulation of specific sequences of neural firing. Replay of recent activity is enriched during sleep and may support the consolidation of learning and memory. Using an intracortical brain-computer interface, we recorded and decoded activity from motor cortex as a human research participant performed a novel motor task. By decoding neural activity throughout subsequent sleep, we find that neural sequences underlying the recently practiced motor task are repeated throughout the night, providing direct evidence of replay in human motor cortex during sleep. This approach, using an optimized brain-computer interface decoder to characterize neural activity during sleep, provides a framework for future studies exploring replay, learning, and memory.
BibTeX
@article{rubin2022learned,
  author = {Daniel B. Rubin and Tommy Hosman and Jessica N. Kelemen and Anastasia Kapitonava and Francis R. Willett and Brian Coughlin and Eric Halgren and Eyal Y. Kimchi and Ziv M. Williams and John D. Simeral and Leigh R. Hochberg and Sydney S. Cash},
  title = {{Learned Motor Patterns Are Replayed in Human Motor Cortex during Sleep}},
  journal = {Journal of Neuroscience},
  year = {2022},
  doi = {10.1523/jneurosci.2074-21.2022},
}
Figure