Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling

He Hu, Yucheng Zhou, Juzheng Si, Qianning Wang, Hengheng Zhang, Fuji Ren, Fei Ma, Laizhong Cui

Abstract

While general-purpose Large Language Models (LLMs) demonstrate surface-level empathy, they frequently lack the clinical grounding and therapeutic diversity required for professional mental health support. This paper introduces PsyLLM, a specialized model designed to bridge this gap by explicitly integrating clinical diagnostic standards (DSM-5/ICD-11) and diverse therapeutic frameworks (e.g., CBT, ACT) into its reasoning process. Through a novel five-stage data synthesis pipeline and the creation of the OpenR1-Psy dataset, PsyLLM generates "reasoning traces" that anchor counselor responses in clinical rationale. Experimental results show that PsyLLM significantly outperforms general-purpose models like GPT-4o across clinical dimensions including empathy, support, and safety.

Introduction

The increasing use of LLMs for mental health support highlights two critical flaws in current systems: a lack of clinical grounding and a narrow therapeutic scope. Most "empathetic" chatbots generate supportive text without aligning with international diagnostic standards or utilizing the diverse therapeutic modalities employed by professional counselors. PsyLLM addresses these limitations by requiring the model to articulate a clinical "internal monologue" before generating a response, ensuring interventions are tailored to specific psychological patterns rather than just being "nice."

Methodology and Data Synthesis

The core of PsyLLM is the OpenR1-Psy dataset, a high-quality collection of 19,302 dialogues where every counselor turn is preceded by a detailed reasoning trace. The authors developed a five-stage automated pipeline to synthesize this data:

  1. Parsing and Interaction Planning: Analyzing real-world mental health posts (e.g., from Reddit) to assess emotional intensity and plan a multi-turn therapeutic arc.
  2. Extract User Questions: Simulating realistic patient-counselor exchanges to generate dynamic dialogue starters.
  3. Reasoning-Integrated Generation: Forcing the model to produce an explicit reasoning trace—including diagnostic assessment and strategy selection—before the final response.
  4. Joint Training: Fine-tuning the base model (Qwen3-8B) to output the reasoning trace and response as a single continuous sequence.
  5. Systematical Dialogue Validation: Filtering samples for incomplete thinking, incoherence, or theoretical misalignment.
The five-stage automated pipeline for synthesizing the OpenR1-Psy dataset, covering parsing, extraction, regeneration, and validation.

The "Reasoning-Integrated Generation" stage is the most significant innovation. It ensures the model "thinks" like a clinician by following a structured internal process before speaking to the user.

An example of the reasoning trace process: the model identifies emotions and triggers, applies diagnostic frameworks (DSM/ICD), selects a therapy (CBT), and suggests an intervention before responding.

Key Results

PsyLLM demonstrated superior performance in both automated benchmarks and expert human evaluations:

  • Benchmark Performance: PsyLLM achieved an average score of 0.607 (on a 0-1 scale), surpassing GPT-4o (0.552) and DeepSeek-V3 (0.540).
  • Human Expert Preference: In blind tests by five psychology experts, PsyLLM was rated highest across all dimensions—Empathy, Support, Attunement, and Safety—achieving a normalized average of 0.601.
  • Ablation Studies: Removing the diagnostic framework or therapeutic guidance significantly degraded performance, particularly in "Support & Autonomy," confirming that these clinical guardrails are essential for effective intervention.

Discussion and Insights

The research yielded several critical insights for AI in mental health:

  • The Necessity of Reasoning Traces: Articulating clinical logic prevents "hallucinated empathy" and ensures relevance to the user's underlying psychological state.
  • Safety as a Distinct Dimension: Correlation analysis showed that Safety & Boundaries is a foundational quality that does not automatically emerge from general empathy; it requires specific clinical constraints.
  • Quality and Scale: Performance is not strictly monotonic with data volume; rigorous validation (filtering the top 80% of data) proved more effective than using the full raw synthesized set.

Limitations

Despite its success, PsyLLM is currently limited by its reliance on Supervised Fine-Tuning (SFT) without Reinforcement Learning from Human Feedback (RLHF). Additionally, while the model is grounded in real-world posts, the dialogues are synthesized, necessitating real-world clinical trials before professional deployment. PsyLLM is intended as a supportive tool and is not a replacement for licensed professional services.

Summary updated

Abstract

Large language models (LLMs) hold significant potential for mental health support, capable of generating empathetic responses and simulating therapeutic conversations. However, existing LLM-based approaches often lack the clinical grounding necessary for real-world psychological counseling, particularly in explicit diagnostic reasoning aligned with standards like the DSM/ICD and incorporating diverse therapeutic modalities beyond basic empathy or single strategies. To address these critical limitations, we propose PsyLLM, the first large language model designed to systematically integrate both diagnostic and therapeutic reasoning for mental health counseling. To develop the PsyLLM, we propose a novel automated data synthesis pipeline. This pipeline processes real-world mental health posts, generates multi-turn dialogue structures, and leverages LLMs guided by international diagnostic standards (e.g., DSM/ICD) and multiple therapeutic frameworks (e.g., CBT, ACT, psychodynamic) to simulate detailed clinical reasoning processes. Rigorous multi-dimensional filtering ensures the generation of high-quality, clinically aligned dialogue data. In addition, we introduce a new benchmark and evaluation protocol, assessing counseling quality across four key dimensions: comprehensiveness, professionalism, authenticity, and safety. Our experiments demonstrate that PsyLLM significantly outperforms state-of-the-art baseline models on this benchmark.
BibTeX
@misc{hu2025beyond,
  author = {He Hu and Yucheng Zhou and Juzheng Si and Qianning Wang and Hengheng Zhang and Fuji Ren and Fei Ma and Laizhong Cui},
  title = {{Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling}},
  year = {2025},
  eprint = {2505.15715},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2505.15715},
}
Figure