A Conceptual framework of Cognitive-Affective Theory of Mind: Towards a Precision Identification of Mental Disorders

Peng Zhou, Huimin Ma, Bochao Zou, Xiaowen Zhang, Shuyan Zhao, Yuxin Lin, Yidong Wang, Lei Feng, Gang Wang

Abstract

Theory of Mind (ToM)—the ability to infer the mental states of others—is a cornerstone of human social interaction. Deficits in ToM are central to various mental disorders, yet traditional diagnostic methods often rely on subjective assessments that treat ToM as an opaque "black box." This paper introduces the Visual Theory of Mind (v-ToM) framework, a novel conceptual model that decomposes social inference into a four-stage computational process. By integrating eye-tracking technology with an audio-visual paradigm, we demonstrate that specific "gaze signatures" can objectively distinguish individuals with Depressive Disorder (DD) and Autism Spectrum Disorder (ASD) from healthy controls. Our findings, based on a sample of over 700 participants, provide a path toward AI-aided digital medicine and precision identification in mental health.

Introduction

The capacity to navigate social environments depends on our ability to attribute beliefs (cognitive ToM) and emotions (affective ToM) to others. When these processes are impaired, individuals face significant challenges in social integration. Historically, clinical assessments of ToM have utilized verbal tasks and questionnaires. However, these methods are limited by their subjectivity and their inability to capture the fine-grained, moment-to-moment processing involved in social cognition. To address these gaps, there is an urgent need for objective, quantifiable biomarkers that can pinpoint specific breakdowns in the ToM process.

The Visual Theory of Mind (v-ToM) Framework

We propose the v-ToM framework to model social inference as a measurable, four-stage computational sequence:

  1. S1: Visual Processing: The initial perceptual detection of basic features such as color, orientation, and borders.
  2. S2: Mental Processing: The conversion of visual information into internal "propositions" (e.g., identifying that a character is looking at a specific object).
  3. S3: Assessment: The comparison of these propositions against "prototypes" or schemas stored in long-term memory (e.g., recognizing that a helpful agent's presence implies a specific outcome).
  4. S4: Transfer & Implementation: The use of these mental representations to guide subsequent behavior and eye movements.

By breaking down ToM into these stages, we can identify exactly where the social-cognitive process deviates in different clinical populations.

Methods and Datasets

The framework was validated through two large-scale studies involving over 700 participants. We employed an audio-visual paradigm where eye movements were recorded (using Tobii and EyeLink trackers) while participants viewed social and emotional scenes.

  • Study 1 (Affective ToM): Compared 212 individuals with Depressive Disorder (DD) against 492 healthy controls using a "competing-priming effect" paradigm (contrasting emotional faces against backgrounds).
  • Study 2 (Cognitive ToM): Compared 332 children with Autism Spectrum Disorder (ASD) against 612 typically developing (TD) children using social inference tasks involving a character interacting with objects and social agents.

Key Results

Attentional Bias in Depressive Disorder

In the affective ToM tasks, individuals with DD exhibited a distinct "disengagement" deficit. Specifically, DD patients showed significantly larger transit times when shifting their gaze from negative backgrounds to positive faces ($p < .01$). This suggests that negative information "traps" their attention, representing a measurable physical manifestation of the cognitive biases associated with depression.

Social Inference Deficits in Autism

In the cognitive ToM tasks, 4- and 5-year-old TD children significantly increased their fixations on a target object when a helpful social agent was present ($p < .01$), indicating they had successfully inferred the agent's intent. In contrast, the ASD group showed no significant change in fixation patterns ($p = .35$), suggesting a failure to integrate social "prototypes" into their mental processing (Stage S3).

Discussion and Future Directions

The v-ToM framework transforms an abstract psychological concept into a computable model. By identifying specific gaze signatures, we move away from subjective assessments toward objective digital biomarkers. These indicators not only allow for the precision identification of DD and ASD but also offer potential for transdiagnostic interventions.

Future work will focus on applying these models to dynamic, real-world social interactions and developing AI-driven personalized therapy programs that "train" the brain to process social information more effectively. The ultimate goal is a fully integrated, AI-aided precision identification system for mental health.

Conclusion

The integration of eye-tracking data with the v-ToM framework provides a robust foundation for the next generation of mental health diagnostics. By quantifying the stages of social inference, we can better understand the underlying mechanisms of mental disorders and pave the way for more effective, data-driven clinical interventions.

Summary updated

Abstract

Abstract To explore the minds of others, which is traditionally referred to as Theory of Mind (ToM), is perhaps the most fundamental ability of humans as social beings. Impairments in ToM could lead to difficulties or even deficits in social interaction. The present study focused on two core components of ToM, the ability to infer others’ beliefs and the ability to infer others’ emotions, which we refer to as cognitive and affective ToM respectively. Charting both typical and atypical trajectories underlying the cognitive-affective ToM promises to shed light on the precision identification of mental disorders, such as depressive disorders (DD) and autism spectrum disorder (ASD). However, most prior studies failed to capture the underlying processes involved in the cognitive-affective ToM in a fine-grained manner. To address this problem, we propose an innovative conceptual framework, referred to as visual theory of mind (v-ToM), by constructing visual scenes with emotional and cognitive meanings and by depicting explicitly a four-stage process of how humans make inferences about the beliefs and emotions of others. Through recording individuals’ eye movements while looking at the visual scenes, our model enables us to accurately measure each stage involved in the computation of cognitive-affective ToM, thereby allowing us to infer about potential difficulties that might occur in each stage. Our model is based on a large sample size (n &gt; 700) and a novel audio-visual paradigm using visual scenes containing cognitive-emotional meanings. The obtained differential features among normal people, DD and ASD individuals overcome the subjectivity of conventional questionnaire-based assessment, and therefore could serve as valuable references for mental health applications based on AI-aided digital medicine.
BibTeX
@inproceedings{zhou2023conceptual,
  author = {Peng Zhou and Huimin Ma and Bochao Zou and Xiaowen Zhang and Shuyan Zhao and Yuxin Lin and Yidong Wang and Lei Feng and Gang Wang},
  title = {{A Conceptual framework of Cognitive-Affective Theory of Mind: Towards a Precision Identification of Mental Disorders}},
  booktitle = {Npj},
  year = {2023},
  doi = {10.1038/s44184-023-00031-0},
}
Figure