Multi-Agent Causal Reasoning for Suicide Ideation Detection Through Online Conversations

Jun Li, Xiangmeng Wang, Haoyang Li, Yifei Yan, Shijie Zhang, Hong Va Leong, Ling Feng, Nancy Xiaonan Yu, Qing LiarXiv 2026 · arXiv

TL;DR

Detecting suicide ideation from online social media conversations is often hindered by incomplete context and hidden biases like the "copycat effect." This paper introduces Multi-Agent Causal Reasoning (MACR), a framework that combines a structured multi-agent debate system with causal front-door adjustment to simulate counterfactual user reactions and eliminate unobserved confounding bias. The approach significantly outperforms state-of-the-art suicide risk models and standard large language models (LLMs) on real-world datasets.

What Problem Does This Paper Address?

Social media platforms offer a critical window for early suicide risk detection. Researchers typically model these online interactions as "conversation trees"—hierarchical structures mapping a post and its subsequent replies. However, current conversation tree-based approaches face two major limitations:

  1. Incomplete Context: They rely strictly on explicitly logged platform interactions (like direct replies or quotes), completely missing unlogged factors such as a user's offline life events or latent personality traits.
  2. Unobserved Confounding Bias: They assume the absence of hidden influences. In reality, online spaces are heavily affected by unobserved confounders like user conformity and "copycat suicide" behavior (where exposure to suicidal content triggers imitative expressions among vulnerable individuals).

Without accounting for these hidden variables, models mistakenly treat observed text as direct, un-confounded reflections of a user's true psychological state, leading to brittle and inaccurate risk assessments.

Fig. 1: (a) Example conversation tree from "r/SuicideWatch" in Reddit.(2) The limitations of current conversation tree-based methods

Methods

To circumvent the impossibility of directly measuring hidden real-world confounders, the authors turn to causal inference—specifically, a technique called front-door adjustment. They introduce a proxy mediator variable ($M$) between the conversation tree ($X$) and the suicide risk ($Y$).

Fig. 2: (a) The causality of conversation tree variable X and suicide risk variable Y is confounded by unobservable variable U. (b) The psychological inference generated by Reasoning Agent as a mediator variable M between conversation tree variable X and suicide risk variable Y .

The MACR framework implements this mathematical decomposition using two primary agents:

1. The Reasoning Agent (Generating the Mediator $M$)

This agent scales the conversation tree by generating counterfactual user reactions grounded in cognitive appraisal theory. To ensure high-quality, logically sound psychological inferences, it employs four specialized sub-agents inspired by the Paul-Elder critical thinking framework:

  • Psychological Analyst: Evaluates the original poster's potential psychological reactions, emotional patterns, and coping styles.
  • Critical Thinker: Identifies logical flaws and cognitive biases in the analyst's breakdown.
  • Empiricist: Acts as "evidence police," grounding claims in established psychological theories (e.g., Attachment Theory) and text evidence.
  • Synthesizer: Integrates all feedback into a balanced, structured output.

These sub-agents engage in a three-round debate. The resulting counterfactual inferences are embedded using an E5 encoder and clustered via K-means to select the most representative psychological profiles.

2. Bias-aware Decision-Making Agent (Causal Estimation)

This agent takes the augmented conversation tree (now enriched with the counterfactual nodes) and estimates the final suicide risk. Because calculating the exact mathematical expectation over all possible conversation trees is intractable, the agent uses a two-stage approximation strategy leveraging in-context learning with stratified demonstrations. By exposing the LLM to representative examples across all four risk levels, it effectively averages out the confounding bias.

Datasets

The framework was evaluated on two real-world conversational datasets:

  • Suicidal Comment Tree Dataset (SCT): A benchmark containing real-world conversational trees extracted from Reddit.
  • Protective Factor-Aware Dataset with Comment Tree (PFA): A dataset constructed by taking posts from an existing protective factor-aware dataset and augmenting them with their corresponding online comment threads.

Key Insights and Ideas

  • Front-Door vs. Back-Door Adjustment: Traditional debiasing methods use back-door adjustment, which requires exhaustively measuring every single confounder. In mental health contexts, factors like offline trauma or user conformity are fundamentally unmeasurable from text alone. Front-door adjustment elegantly bypasses this by focusing entirely on how the text influences a generated psychological mediator.
  • The Power of Counterfactuals: Instead of just analyzing what users did say, simulating what they could have thought or felt provides a much richer feature space that stabilizes the model against sudden shifts in online behavior.
  • Debate Beats Raw Prompting: Standard LLMs (including GPT-5) are prone to pattern-matching and picking up spurious correlations in sensitive text. Forcing a multi-agent adversarial debate ensures that the generated psychological context is rigorous and theoretically sound.

Key Results

MACR demonstrated substantial improvements over traditional classifiers, graph neural networks (GNNs), and vanilla LLMs:

  • Overall Performance: On the PFA dataset, MACR achieved a Weighted-F1 score of 0.3768, outperforming the best traditional baseline (DAFIL) by 8.9% and DeepSeek-Chat by 9.8%. On the SCT dataset, it achieved a Weighted-F1 of 0.5108, marking a 12.3% gain over the second-best model (PLM-Emotion).
  • Ablation Cruciality: Removing the Reasoning Agent (relying only on the raw conversation tree) caused the most severe performance drop, with the Weighted-F1 crashing by 32.7%. This confirms that counterfactual reasoning nodes are absolutely vital for effective deconfounding.
  • Prompting Superiority: When compared against standard prompting techniques like Chain-of-Thought (CoT) and In-Context Learning (ICL), MACR's structured front-door approach maintained a massive performance gap (up to 15% improvement), proving that explicit causal architecture trumps generic reasoning steps.

Limitations and Future Work

The authors explicitly outline several strict ethical boundaries and limitations:

  • Screening, Not Deciding: The system is strictly designed as an early screening tool to assist human experts and should never be deployed for autonomous decision-making or crisis intervention without human oversight.
  • Risk of False Positives/Negatives: Clinical validation is still required to handle edge cases safely.
  • Future Directions: The authors plan to extend this multi-agent causal paradigm to broader mental health monitoring tasks and refine the cognitive appraisal sub-agents to capture even finer-grained psychological dimensions.

Summary updated

Abstract

Suicide remains a pressing global public health concern. While social media platforms offer opportunities for early risk detection through online conversation trees, existing approaches face two major limitations: (1) They rely on predefined rules (e.g., quotes or relies) to log conversations that capture only a narrow spectrum of user interactions, and (2) They overlook hidden influences such as user conformity and suicide copycat behavior, which can significantly affect suicidal expression and propagation in online communities. To address these limitations, we propose a Multi-Agent Causal Reasoning (MACR) framework that collaboratively employs a Reasoning Agent to scale user interactions and a Bias-aware Decision-Making Agent to mitigate harmful biases arising from hidden influences. The Reasoning Agent integrates cognitive appraisal theory to generate counterfactual user reactions to posts, thereby scaling user interactions. It analyses these reactions through structured dimensions, i.e., cognitive, emotional, and behavioral patterns, with a dedicated sub-agent responsible for each dimension. The Bias-aware Decision-Making Agent mitigates hidden biases through a front-door adjustment strategy, leveraging the counterfactual user reactions produced by the Reasoning Agent. Through the collaboration of reasoning and bias-aware decision making, the proposed MACR framework not only alleviates hidden biases, but also enriches contextual information of user interactions with counterfactual knowledge. Extensive experiments on real-world conversational datasets demonstrate the effectiveness and robustness of MACR in identifying suicide risk.
BibTeX
@misc{li2026multi,
  author = {Jun Li and Xiangmeng Wang and Haoyang Li and Yifei Yan and Shijie Zhang and Hong Va Leong and Ling Feng and Nancy Xiaonan Yu and Qing Li},
  title = {{Multi-Agent Causal Reasoning for Suicide Ideation Detection Through Online Conversations}},
  year = {2026},
  eprint = {2602.23577},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.23577},
}
Figure