InterMind: Doctor-Patient-Family Interactive Depression Assessment Empowered by Large Language Models

Zhiyuan Zhou, Jilong Liu, Sanwang Wang, Shijie Hao, Yanrong Guo, Richang Hong

Here is a concise, engaging summary of the paper introducing InterMind.

TL;DR

InterMind is a novel, LLM-powered depression assessment system that shifts the diagnostic paradigm from a simple doctor-patient dyad to an interactive doctor-patient-family framework. By integrating Retrieval-Augmented Generation (RAG) grounded in DSM-V criteria and Chain-of-Thought (CoT) reasoning, the system generates highly interpretable, structured diagnostic reports that significantly improve classification accuracy and clinical utility.

What Problem Does This Paper Address?

Traditional Automatic Depression Detection (ADD) methods typically treat diagnosis as a black-box classification or regression task. They lack the interpretability required for clinical decision-making and rely almost exclusively on direct patient inputs.

However, depression patients often struggle to accurately express their feelings or may intentionally conceal their symptoms. By ignoring multi-role dynamics—specifically the objective observations of family members—existing systems miss crucial context (e.g., changes in sleep patterns or sudden mood swings). Furthermore, while Large Language Models (LLMs) show promise in mental health applications, they are prone to hallucinations and lack the domain-specific precision needed to align with professional psychiatric standards like the DSM-V.

Methods

The authors developed InterMind, a dual-component framework consisting of an AI Psychological Chatbot and an AI Psychiatrist.

Figure 1: Illustration of proposed LLM-empowered doctor- patient-family interactive depression assessment system.
  1. AI Psychological Chatbot: This component conducts multi-turn conversations with both the patient and their family members. To train it effectively despite scarce clinical dialogue data, the authors used prompt engineering to rewrite rich, unstructured social media depression posts into realistic counseling dialogues for instruction fine-tuning.
  2. AI Psychiatrist: This module aggregates the multi-role dialogues to generate a standardized diagnostic report. It utilizes two key techniques to ensure clinical accuracy:
  3. Retrieval-Augmented Generation (RAG): The system converts dialogue text into embeddings and uses cosine similarity to retrieve the most relevant diagnostic criteria from a digitized DSM-V manual.
  4. Chain-of-Thought (CoT): A four-step prompting strategy guides the LLM to systematically extract symptoms, match them against the retrieved DSM-V criteria, and reason through the severity level before outputting a structured JSON report.

Datasets

The system was trained and evaluated across three distinct datasets to ensure robustness:

  • MMDA Dataset: A large-scale Chinese dataset containing face-to-face clinical interview data from 524 subjects, complete with professional Hamilton Depression Rating Scale (HAMD) scores.
  • DR Dataset: An English corpus consisting of 1,838 Reddit users, separating self-disclosed depression cases from healthy controls.
  • DepSeverity Dataset: A collection of 3,553 Reddit posts annotated into four fine-grained depression severity levels (Minimal, Mild, Moderate, Severe).

Key Insights and Ideas

  • The Power of the Family Perspective: The most striking insight is that combining patient and family perspectives ("Ours (Both)") yields significantly better results than modeling either role in isolation. Family members provide objective, observable data that counterbalances a patient's potential self-reporting bias or omission.
  • Knowledge Grounding Curbs Hallucination: Simply asking an LLM to diagnose depression leads to conservative or erratic predictions. Explicitly feeding relevant DSM-V slices into the context window via RAG, combined with structured CoT steps, forces the model to anchor its final diagnosis in established medical literature.

Key Results

InterMind consistently outperformed general LLMs (like GPT-4 and Baichuan2-7B) as well as specialized supervised models (such as ChineseMentalBERT) across all benchmarks.

Table 1: Depression Binary Classification Results
  • Binary Classification: On the MMDA dataset, InterMind achieved an F1-score of 0.862, vastly outperforming baseline Baichuan2-7B (0.694) and GPT-4 (0.583).
  • Severity Estimation: The system demonstrated superior accuracy in distinguishing moderate and severe depression, a task where traditional supervised models frequently fail.
  • Human Validation: Blind evaluations by 5 clinical psychiatrists confirmed that InterMind's generated reports provided more accurate and richer symptom-standard alignments than vanilla GPT-4. Additionally, 18 psychology-trained volunteers rated the AI Chatbot significantly higher in conversational consistency and user engagement.

Limitations and Future Work

While highly promising, the authors note two main limitations:

  1. Simulated Multi-Role Data: Because real-world datasets containing parallel patient and family interviews do not yet exist, the family dialogues used for training were simulated by splitting extracted symptoms using GPT-4.
  2. Clinical Deployment: The system has yet to be integrated into live clinical workflows. Future work will focus on validating InterMind in real-world hospital settings in direct collaboration with medical professionals.

Summary updated

Abstract

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family involvement in the evaluation and caregiving process. Moreover, current automatic depression detection (ADD) methods usually model depression detection as a classification or regression task, lacking interpretability for the decision-making process. To address these issues, we developed InterMind, a doctor-patient-family interactive depression assessment system empowered by large language models (LLMs). Our system enables patients and families to contribute descriptions, generates assistive diagnostic reports for doctors, and provides actionable insights, improving diagnostic precision and efficiency. To enhance LLMs' performance in psychological counseling and diagnostic interpretability, we integrate retrieval-augmented generation (RAG) and chain-of-thoughts (CoT) techniques for data augmentation, which mitigates the hallucination issue of LLMs in specific scenarios after instruction fine-tuning. Quantitative experiments and professional assessments by clinicians validate the effectiveness of our system.
BibTeX
@inproceedings{zhou2025intermind,
  author = {Zhiyuan Zhou and Jilong Liu and Sanwang Wang and Shijie Hao and Yanrong Guo and Richang Hong},
  title = {{InterMind: Doctor-Patient-Family Interactive Depression Assessment Empowered by Large Language Models}},
  booktitle = {ACM Multimedia},
  year = {2025},
  doi = {10.1145/3746027.3754755},
}
Figure