Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviour

Abeer Badawi, Moyosoreoluwa Olatosi, Negin Baghbanzadeh, Laleh Seyyed-Kalantari, Frank Rudzicz, R. Shayna Rosenbaum, Sara Pishdadian, Elham DolatabadiarXiv 2026 · arXiv

TL;DR

This paper formalizes and measures Cognitive Atrophy—a behavioral pattern where mental-health LLMs shift problem-solving and emotional regulation away from the user and onto the AI, fostering unhealthy dependency. Introducing COGNITIVE ATROPHY BENCH, a clinically grounded benchmark of over 1,500 human counseling conversations, the authors reveal that current state-of-the-art LLMs consistently exhibit high levels of dependency-inducing behavior that intensifies over multi-turn interactions.

What Problem Does This Paper Address?

When Large Language Models (LLMs) are deployed as mental-health assistants, standard safety evaluations usually check for overt harms like toxic language or unsafe medical advice. However, these surface-level metrics miss a more insidious risk: emotional over-reliance.

Good therapy scaffolds a patient's autonomy, helping them reflect, cope, and make decisions for themselves. In contrast, an AI that quickly jumps to providing directive advice or solving the user's problems might make the user feel better in the short term, but ultimately erodes their independent coping mechanisms. The authors define this phenomenon as Cognitive Atrophy. Prior benchmarks have evaluated static response quality or psychological knowledge, but none have captured how multi-turn interactions reshape user agency over time.

Methods

The authors developed a rigorous framework to make Cognitive Atrophy quantifiable:

  1. Clinically Grounded Schema: Co-designed with clinical and neuropsychology experts, the schema tracks 20 distinct attributes categorized into User Context (e.g., emotional evocativeness, fix-it seeking), LLM Response Behavior (e.g., directiveness, language matching), and Global Risk Flags (e.g., harmful validation).
  2. Two-Tier Expert Protocol: To avoid evaluation bias, the authors separated schema design (done by clinical experts) from schema application (executed by six trained clinical reviewers using a custom web interface). Reviewers provided span-level text highlights to ground their judgments.
  3. Novel Evaluation Indices:
  4. User-Input Risk Index (UIRI): Measures the clinical demand and complexity of the user's prompt.
  5. Atrophy Risk Index (ARI): Maps raw behavioral codes into a normalized [0, 1] scalar indicating the level of atrophy-aligned risk.
Figure 1: Overview of the COGNITIVE ATROPHY BENCH annotation pipeline, including user-context scoring, response-behaviour evaluation, binary risk flags, and span-grounded evidence.

Datasets

The authors compiled COGNITIVE ATROPHY BENCH using 1,576 fully human-generated counseling conversations (comprising 15,680 turns) sourced from four existing datasets: CounselChat and PAIR for single-turn analysis, and CARE-Bench and HOPE for multi-turn analysis.

They evaluated 42,230 responses generated across five prominent LLMs: GPT, Claude, Gemini, Llama, and Qwen.

Figure 3: User Input Risk Index (UIRI) band (Low < 0.30, Medium ∈[0.30, 0.60), High ≥0.60) [54].

Key Insights and Ideas

  • The Safety-Autonomy Paradox: LLMs are highly sensitive to explicit safety cues. If a user expresses high-risk distress, the models successfully adapt their language to be more cautious. However, they fail to adapt to autonomy-related signals; when users explicitly ask the AI to make a decision for them ("fix-it seeking"), models readily comply instead of encouraging self-reflection.
  • The Multi-Turn Drift: As conversations progress, all evaluated LLMs naturally drift toward more directive, closed-ended, and solution-focused behaviors. Instead of keeping the dialogue open-ended to let the user explore their feelings, the models narrow the conversation down.
  • Shared Risk, Different Fingerprints: While all models scored within a similarly concerning risk band, their underlying behavioral pathways differed. For instance, GPT and Llama lean heavily into directive, solution-oriented problem-solving, whereas Claude exhibited the lowest overall atrophy risk.

Key Results

  • High Atrophy Risk: Across both single-turn and multi-turn settings, all five LLMs fell into a moderate-to-high risk band, with the Atrophy Risk Index (ARI) ranging from 0.52 to 0.61 in single-turn and 0.48 to 0.57 in multi-turn settings.
  • Progressive Directiveness: In multi-turn settings, closed-question scores rose significantly (by +0.19 to +0.33), and the frequency of directive text spans roughly doubled from turn 1 to turn 6.
  • Strong Input-Response Correlations: Statistical analysis showed that user sensitivity (U3) strongly correlates with response sensitivity (SEN) across all models, proving that models mirror safety risks but ignore the risk of undermining user agency.
Figure 4: Top-4 strongest input–response correlations ranked by |ρ|. For User Response: U1 = Typicality; U3 = Sensitivity; U5 = Underlying Emotional Potential; For LLM response: SEN = Sensitivity; LM = Language Matching; EMP = Empathy & Matching; FIX = Fix-It; TSH = Topic Shift; AUR = Assumption of User Response; RT = Recommendation Type; TD = Tentativeness/Directness.

Limitations and Future Work

The primary bottleneck of this work is its reliance on expert human annotation, which is incredibly time-consuming and costly (requiring 218 hours of expert labor in this study). This makes scaling the benchmark difficult.

Additionally, because the dataset relies on static, pre-existing human counseling transcripts, it does not capture true, longitudinal user-chatbot interactions where a user's behavior might dynamically alter in response to the AI over months or years. The authors note that they are measuring atrophy-inducing response patterns, not actual psychological change or harm in human users, which remains a critical frontier for future clinical AI research.

Summary updated

Abstract

Recent incidents involving LLMs used for mental-health support reveal a critical evaluation gap: surface-level safety scores do not capture how models behave across realistic, emotionally sensitive interactions over time. Existing benchmarks measure knowledge, safety, or static response quality, but miss whether LLM interactions help users keep reflecting, coping, and making decisions themselves. We formalize this missing dimension as COGNITIVE ATROPHY, a process-level behavioural measure in AI-mediated mental-health support distinct from safety and helpfulness. To measure it, we introduce COGNITIVE ATROPHY BENCH, a clinically grounded benchmark built from 1,576 fully human-generated counseling conversations, 15,680 turns, and 42,230 responses from five LLMs. Three clinical and neuropsychology experts developed a 20-attribute schema spanning user context, response behaviour, and global risk flags; six trained clinical reviewers applied it with span-grounded evidence, producing 5,324 reviewer judgments. We further introduce the User-Input Risk Index (UIRI), the Cognitive Atrophy Risk Index (ARI), and trajectory summaries. Across five LLMs, models show a consistent moderate-to-high level of atrophy-aligned behaviour across single and multi-turn settings. While models generally respond to overt safety cues, they adapt less reliably when users seek solutions or decisions. The dominant recurring patterns are directive advice, problem-solving, recommendation responses, topic shifts, and forms of validation that may reinforce dependence rather than reflection. Our work makes COGNITIVE ATROPHY measurable and provides a foundation for auditing model behaviour in sensitive LLM conversations.
BibTeX
@misc{badawi2026towards,
  author = {Abeer Badawi and Moyosoreoluwa Olatosi and Negin Baghbanzadeh and Laleh Seyyed-Kalantari and Frank Rudzicz and R. Shayna Rosenbaum and Sara Pishdadian and Elham Dolatabadi},
  title = {{Towards Understanding and Measuring COGNITIVE ATROPHY in LLM Behaviour}},
  year = {2026},
  eprint = {2606.18129},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.18129},
}
Figure