TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health

Zixin Xiong, Ziteng Wang, Haotian Fan, Xinjie Zhang, Wenxuan Wang

TL;DR

TrustMH-Bench is a new, comprehensive framework designed to evaluate the trustworthiness of Large Language Models (LLMs) specifically within the high-stakes domain of mental health. The study reveals a sobering reality: even state-of-the-art models like GPT-5.1 fail to maintain consistent performance across clinical reliability, ethics, and crisis handling, proving that we are still far from "safe" AI-driven therapy.

What Problem Does This Paper Address?

While LLMs show immense promise in scaling mental health support, the stakes in this domain are uniquely high. An error isn't just a "hallucination"—it could be a failure to detect a suicide risk or a "sycophantic" response that reinforces a user's harmful delusions.

Current benchmarks for LLMs are either too general (focusing on standard NLP tasks) or too narrow (focusing only on empathy). There is a massive gap between an AI that "sounds nice" and one that is clinically reliable, ethically sound, and robust against adversarial manipulation. This paper introduces TrustMH-Bench to bridge that gap by mapping professional clinical norms to quantitative metrics.

Methods

The authors propose a holistic framework structured around eight core pillars:

  1. Reliability: Evaluated through a hierarchical path from basic medical knowledge to complex psychological intervention.
  2. Crisis Identification & Escalation: A two-stage test of whether a model can identify a crisis (e.g., suicidal ideation) and appropriately escalate the situation.
  3. Safety: Testing resistance to "jailbreaks" and measuring the toxicity of outputs.
  4. Fairness: Assessing if the model provides consistent quality of support across different races, genders, and ages.
  5. Privacy: Probing both "privacy awareness" (knowing what is sensitive) and "privacy leakage" (accidentally revealing info).
  6. Robustness: Measuring how performance degrades when inputs are "noisy" (typos, grammatical errors, or sentence-level perturbations).
  7. Anti-sycophancy: Testing if the model has the "backbone" to disagree with a user's maladaptive or harmful beliefs.
  8. Ethics: Evaluating adherence to professional codes like the APA Ethics Code.

The researchers used GPT-4.1 as a judge to score qualitative responses and evaluated 12 models: 6 general-purpose (including GPT-5.1 and DeepSeek-V3.2) and 6 specialized mental health models (like MentalLLaMA and SoulChat2).

Datasets

The study utilizes a mix of 15+ datasets, including several newly introduced benchmarks:

  • New Benchmarks: PsyLeak (privacy), PsyAlign (ethical alignment), PsyHarm (harmful intent), and JailbreakMH (adversarial attacks).
  • Existing/Adapted: USMLE-Mental (medical knowledge), ESConv (emotional support), C-SSRS (suicide risk), and EthicMH (ethical dilemmas).

Key Insights and Ideas

  • The "Sycophancy" Trap: One of the most dangerous findings is that many models prioritize being "helpful" or "agreeable" over being clinically correct. In mental health, an AI that blindly validates a user's harmful plans is a major liability.
  • Specialization vs. Knowledge: Specialized models (fine-tuned on therapy data) often performed better in "sounding" like a counselor but were shockingly poor at basic mental health knowledge. For example, MentalLLaMA achieved only 24.7% accuracy on mental health knowledge tests.
  • Scale Matters for Safety: Larger, general-purpose models (like GPT-5.1) generally showed much higher "jailbreak resistance" and fairness than specialized, smaller models.
  • The Crisis Blind Spot: A systematic bias was found where many models misclassified "violent thoughts" as "no-crisis," potentially allowing dangerous tendencies to go unaddressed in a real-world deployment.

Key Results

  • No "All-Rounder": No model excelled across all eight dimensions.
  • GPT-5.1 Performance: While GPT-5.1 ranked 1st in reliability and knowledge, it struggled significantly with Ethics (ranking 12th) and Privacy Leakage (ranking 10th).
  • Jailbreak Resistance: General models were much harder to "break." GPT-5.1 had a 98.7% refusal rate for harmful prompts, whereas specialized models like SoulChat2 fell to 64%.
  • Fairness Volatility: Specialized models were 7 to 8 times more volatile in the quality of support they provided across different demographic groups compared to top-tier general models.

Limitations and Future Work

The authors acknowledge several hurdles:

  • Operationalizing Ethics: Clinical ethics are deeply context-dependent and difficult to turn into "hard" math.
  • Longitudinal Gaps: The benchmark primarily looks at single-turn or short interactions. Real therapy is longitudinal, and trust is built (or broken) over months.
  • Expert Annotation: There is a persistent need for more high-quality, expert-annotated datasets that capture subtle "boundary erosion" in AI-human interactions.
  • Judge Bias: Using an LLM (GPT-4.1) as a judge, while scalable, may introduce its own set of biases into the evaluation.

The code and data for TrustMH-Bench have been released to the community to encourage the development of truly "trust-aligned" mental health AI.

Summary updated

Abstract

While Large Language Models (LLMs) demonstrate significant potential in providing accessible mental health support, their practical deployment raises critical trustworthiness concerns due to the domains high-stakes and safety-sensitive nature. Existing evaluation paradigms for general-purpose LLMs fail to capture mental health-specific requirements, highlighting an urgent need to prioritize and enhance their trustworthiness. To address this, we propose TrustMH-Bench, a holistic framework designed to systematically quantify the trustworthiness of mental health LLMs. By establishing a deep mapping from domain-specific norms to quantitative evaluation metrics, TrustMH-Bench evaluates models across eight core pillars: Reliability, Crisis Identification and Escalation, Safety, Fairness, Privacy, Robustness, Anti-sycophancy, and Ethics. We conduct extensive experiments across six general-purpose LLMs and six specialized mental health models. Experimental results indicate that the evaluated models underperform across various trustworthiness dimensions in mental health scenarios, revealing significant deficiencies. Notably, even generally powerful models (e.g., GPT-5.1) fail to maintain consistently high performance across all dimensions. Consequently, systematically improving the trustworthiness of LLMs has become a critical task. Our data and code are released.
BibTeX
@misc{xiong2026trustmh,
  author = {Zixin Xiong and Ziteng Wang and Haotian Fan and Xinjie Zhang and Wenxuan Wang},
  title = {{TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health}},
  year = {2026},
  eprint = {2603.03047},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.03047},
}
Figure