A Dual-Prompting for Interpretable Mental Health Language Models

Hyolim Jeon, Dongje Yoo, Daeun Lee, Sejung Son, Seungbae Kim, Jinyoung HanEACL 2024

TL;DR

This paper tackles the critical challenge of making AI models for mental health analysis, specifically suicide risk detection, more interpretable for clinicians. They propose a "dual-prompting" strategy that combines domain-specific knowledge (like a psychiatrist's persona and a suicide dictionary) with LLM capabilities to extract and summarize evidence of suicide risk from social media posts, leading to improved performance and potential clinical utility.

What Problem Does This Paper Address?

The increasing demand for AI tools to monitor mental health, particularly for early intervention in conditions like depression and suicidal ideation, is hampered by a significant lack of interpretability in current models. While Large Language Models (LLMs) show promise in analyzing mental health-related text, their "black box" nature makes it difficult for clinicians to understand why a model makes a certain prediction. This lack of transparency hinders trust and adoption in clinical settings. The CLPsych 2024 Shared Task specifically aims to address this by focusing on detecting suicidality from social media data and demanding interpretable outputs.

Methods

The authors propose a two-pronged approach:

  • Knowledge-aware Evidence Extraction (Task A): This involves crafting a sophisticated prompt for LLMs to identify specific phrases within a social media post that indicate suicide risk. Key elements of this prompt include:
  • Mental health-specific LLM: They utilize MentaLLaMA-chat-13B, a model fine-tuned on a large dataset of mental health-related social media data, to improve its understanding of this domain.
  • Expert Identity Prompting: The LLM is instructed to act as a "psychiatrist," leveraging the idea that assigning roles can guide LLMs to provide more insightful and contextually relevant outputs.
  • Suicide Dictionary Integration: A pre-compiled dictionary of suicide-related words (validated by domain experts) is used to help the LLM identify and focus on relevant terms within the text.
  • Few-shot Learning: Providing a few examples of input posts and their corresponding extracted highlights helps the model learn the desired output format and style.
  • Evidence Summarization with LLM-based Consistency Evaluator (Task B): This stage aims to synthesize the extracted evidence from multiple posts into a coherent summary.
  • Extract-then-Generate: The summarization prompt incorporates the extracted phrases from Task A, providing a more grounded basis for the summary and reducing hallucinations.
  • Consistency Evaluator: To ensure the summary is reliable and consistent with the source posts, they employ a consistency evaluator. This involves generating multiple candidate summaries and scoring them based on how well they are entailed by the original posts. The summary with the highest consistency score is selected. They use SOLAR, a model known for its strong performance in summarization, for this purpose.

Datasets

  • UMD Reddit Suicidality Dataset: This dataset, provided by the CLPsych 2024 Shared Task, consists of posts from the r/SuicideWatch subreddit. It includes user-level labels indicating the severity of suicidality (No, Low, Moderate, or Severe), determined by crowdsourcers and domain experts. The evaluation dataset used in this paper is a subset of this, comprising 162 posts from 125 users labeled with Low, Moderate, and Severe risks.

Key Insights and Ideas

  • Domain-specific knowledge is crucial: Simply using a general LLM is insufficient for nuanced mental health analysis. Integrating domain-specific elements like a psychiatrist persona and a suicide dictionary significantly improves performance.
  • Prompt engineering is powerful: The way prompts are structured, including assigning roles and providing examples, can dramatically influence an LLM's output quality and interpretability.
  • Consistency is key for summarization: For clinical applications, summaries must be reliable. Using a consistency evaluator to filter and select the best summary from multiple candidates is vital for reducing errors and hallucinations.
  • General LLMs might outperform domain-specific ones in summarization: Interestingly, the paper notes that a general LLM (SOLAR) performed better in summarization than a domain-specific one (MentaLLaMA), suggesting that while domain-specific models are good for extraction, broader models might be more robust for synthesis tasks.

Key Results

  • Improved Recall in Extraction: Integrating few-shot learning for evidence extraction boosted recall from 91.0% to 92.2%.
  • Effectiveness of Components:
    • Using a suicide dictionary improved the consideration of suicide risk factors.
  • Assigning different expert identities (psychologist, counselor, psychiatrist) led to different focuses in the extracted evidence, highlighting the model's sensitivity to role-playing.
  • Summarization Performance: The consistency evaluator helped improve the reliability of summaries. Using SOLAR as the summarizer and evaluator yielded a consistency score of 0.973, slightly outperforming a combination of SOLAR and MentaLLaMA (0.970).
  • Qualitative Analysis: The paper provides examples demonstrating how the different prompting strategies (suicide dictionary, expert identity) lead to more relevant and insightful extracted evidence.

Limitations and Future Work

  • Limited Quantitative Analysis: Due to the absence of ground truth labels provided by the organizers, quantitative comparisons were limited, and the authors relied more on qualitative analysis.
  • LLM Size Constraints: Experiments were conducted using the smallest versions of LLMs due to limited computational resources.
  • Subjectivity and Bias: Inferring suicidality from social media is inherently subjective and can be influenced by demographic and media-specific biases. The suicide dictionary itself might also carry biases from the dataset it was trained on.
  • Future Work: The authors plan to:
  • Explore a wider range of prompt templates and LLM-based consistency evaluators (e.g., ChatGPT, LLaMa2).
  • Expand the scope to cover other mental health domains like depression and bipolar disorder.
  • Investigate domain-specific fine-tuning methods for LLMs to enhance interpretability further.

Summary updated

BibTeX
@inproceedings{jeon2024dual,
  author = {Hyolim Jeon and Dongje Yoo and Daeun Lee and Sejung Son and Seungbae Kim and Jinyoung Han},
  title = {{A Dual-Prompting for Interpretable Mental Health Language Models}},
  booktitle = {EACL},
  year = {2024},
}
Figure