How do we imagine a speech? A triple network model for situationally simulated inner speech

Xiao‐Wei Gao, Junjie Yang, Chaoqun Li, Xiaolin Guo, Yaling Wang, Zhiheng Qu, Wanchun Li, Jiaxuan Liu, Zhongqi Li, Wanjing Li, Zhe Hu, Junjing Li, Yien Huang, Jiali Chen, Hao Wen, Zehao Zhao, Daniel Kaiser, Wei Tao, Binke YuanbioRxiv 2024 · DOI

Abstract

Inner speech is a silent verbal experience and plays central roles in human consciousness and cognition. Despite impressive studies over the past decades, the neural mechanisms of inner speech remain largely unknown. In this study, we adopted an ecological paradigm called situationally simulated inner speech. Unlike mere imaging speech of words, situationally simulated inner speech involves the dynamic integration of contextual background, episodic and semantic memories, and external events into a coherent structure. We conducted dynamic activation and network analyses on fMRI data, where participants were instructed to engage in inner speech prompted by cue words across 10 different contextual backgrounds. Our seed-based co-activation pattern analyses revealed dynamic involvement of the language network, sensorimotor network, and default mode network in situationally simulated inner speech. Additionally, frame-wise dynamic conditional correlation analysis uncovered four temporal-reoccurring states with distinct functional connectivity patterns among these networks. We proposed a triple network model for deliberate inner speech, including language network for a truncated form of overt speech, sensorimotor network for perceptual simulation and monitoring, and default model network for integration and ‘sense-making’ processing.

Introduction

Most research on inner speech has historically focused on "covert speech"—the simple act of repeating a single word or phoneme in one's head. While these studies have identified core language regions, they fail to capture the richness of our actual internal lives. We do not merely repeat sounds; we plan conversations, rehearse speeches, and narrate our lives within complex situational contexts.

Traditional covert speech often involves simple phoneme repetition, which lacks the complexity of everyday internal monologue.

The authors argue that "situationally simulated inner speech" (SSIS) is a distinct cognitive process. It requires more than just language processing; it involves the dynamic integration of external cues with episodic and semantic memories to create a structured narrative. This study aims to identify the neural mechanisms that allow the brain to perform this high-level integration and "sense-making" during deliberate imagination.

Methods

The researchers employed a multi-stage approach to map the neural architecture of inner speech. First, a term-based meta-analysis using NeuroQuery identified core brain regions associated with 14 inner-speech-related terms. This was followed by Seed-based Co-activation Pattern (CAP) analysis using fMRI data to identify large-scale networks that fire in sync with specific "seed" regions, such as the ventral somatosensory areas.

The Situationally Simulated Inner Speech (SSIS) paradigm requires participants to integrate abstract cue words into a complex narrative context.

To capture the temporal dynamics of these networks, the team used Dynamic Conditional Correlation (DCC) to track connectivity fluctuations frame-by-frame. Finally, K-means clustering grouped these patterns into four distinct "temporal states." The primary dataset involved 19 healthy participants who were given 10 different background stories (e.g., acting as an astronaut) and asked to mentally incorporate 61 abstract cue words into that specific narrative.

The Triple Network Model

The study proposes that deliberate inner speech relies on the orchestration of three distinct networks:

  1. Language Network (LAN): Responsible for the "truncated" form of speech, including syntax and word choice.
  2. Sensorimotor Network (SMN): Provides perceptual simulation and monitoring—the internal "feeling" of speaking and hearing oneself.
  3. Default Mode Network (DMN): Acts as the "sense-making" hub, integrating the narrative with memory and context.

Notably, the DMN—often considered a "task-negative" network—was found to be an active and essential participant in narrative integration during SSIS.

Key Results

The study pinpointed the bilateral ventral precentral/postcentral gyri (vPreCG/vPoCG) and the middle superior temporal gyrus (STG) as the primary engines of inner speech. CAP analysis confirmed that the LAN, SMN, and DMN consistently co-activate during situational imagination. DCC analysis identified four reoccurring states of functional connectivity, with strong and persistent connections maintained between the inferior frontal gyrus (IFG), STG, and vPreCG across all states. Additionally, substantial activation in the cerebellum (Crus I/II) suggests its role in motor planning and cognitive monitoring of internal speech.

Discussion and Limitations

One intriguing finding was the researchers' inability to decode which specific story a participant was imagining based on brain activity. This suggests that the Triple Network represents the machinery of imagination rather than the specific semantic content of the thoughts.

A major limitation remains the "black box" of imagination; because the speech is entirely internal, there is no behavioral output to verify the vividness or exact content of the narratives. Future work should include subjective ratings of "vividness" and explore whether concrete words, which rely more heavily on the perceptual system, alter these network dynamics. This research provides a foundational framework for understanding how the brain weaves abstract thoughts into the coherent internal monologues that define human cognition.

Summary updated

Abstract

Abstract Inner speech is a silent verbal experience and plays central roles in human consciousness and cognition. Despite impressive studies over the past decades, the neural mechanisms of inner speech remain largely unknown. In this study, we adopted an ecological paradigm called situationally simulated inner speech. Unlike mere imaging speech of words, situationally simulated inner speech involves the dynamic integration of contextual background, episodic and semantic memories, and external events into a coherent structure. We conducted dynamic activation and network analyses on fMRI data, where participants were instructed to engage in inner speech prompted by cue words across 10 different contextual backgrounds. Our seed-based co-activation pattern analyses revealed dynamic involvement of the language network, sensorimotor network, and default mode network in situationally simulated inner speech. Additionally, frame-wise dynamic conditional correlation analysis uncovered four temporal-reoccurring states with distinct functional connectivity patterns among these networks. We proposed a triple network model for deliberate inner speech, including language network for a truncated form of overt speech, sensorimotor network for perceptual simulation and monitoring, and default model network for integration and ‘sense-making’ processing. Highlights In ten contextual backgrounds, subjects were instructed to perform situationally simulated inner speech based on cue words. The ventral parts of the bilateral somatosensory areas and middle superior temporal gyrus were as centers for seed-based co-activation pattern analyses. A triple network model of language network, sensorimotor network, and default mode network was proposed for deliberate inner speech.
BibTeX
@misc{gao2024how,
  author = {Xiao‐Wei Gao and Junjie Yang and Chaoqun Li and Xiaolin Guo and Yaling Wang and Zhiheng Qu and Wanchun Li and Jiaxuan Liu and Zhongqi Li and Wanjing Li and Zhe Hu and Junjing Li and Yien Huang and Jiali Chen and Hao Wen and Zehao Zhao and Daniel Kaiser and Wei Tao and Binke Yuan},
  title = {{How do we imagine a speech? A triple network model for situationally simulated inner speech}},
  year = {2024},
  doi = {10.1101/2024.07.18.604038},
  howpublished = {bioRxiv},
}
Figure