Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts

Shrey Gupta, Anmol Agarwal, Manas Gaur, Kaushik Roy, Vignesh Narayanan, Ponnurangam Kumaraguru, Amit P. Sheth

Abstract

Conversational Agents (CAs) powered with deep language models (DLMs) have shown tremendous promise in the domain of mental health. Prominently, the CAs have been used to provide informational or therapeutic services to patients. However, the utility of CAs to assist in mental health triaging has not been explored in the existing work as it requires a controlled generation of follow-up questions (FQs), which are often initiated and guided by the mental health professionals (MHPs) in clinical settings. In the context of depression, our experiments show that DLMs coupled with process knowledge in a mental health questionnaire generate 12.54% and 9.37% better FQs based on similarity and longest common subsequence matches to questions in the PHQ-9 dataset respectively, when compared with DLMs without process knowledge support. Despite coupling with process knowledge, we find that DLMs are still prone to hallucination, i.e., generating redundant, irrelevant, and unsafe FQs. We demonstrate the challenge of using existing datasets to train a DLM for generating FQs that adhere to clinical process knowledge. To address this limitation, we prepared an extended PHQ-9 based dataset, PRIMATE, in collaboration with MHPs. PRIMATE contains annotations regarding whether a particular question in the PHQ-9 dataset has already been answered in the user's initial description of the mental health condition. We used PRIMATE to train a DLM in a supervised setting to identify which of the PHQ-9 questions can be answered directly from the user's post and which ones would require more information from the user. Using performance analysis based on MCC scores, we show that PRIMATE is appropriate for identifying questions in PHQ-9 that could guide generative DLMs towards controlled FQ generation suitable for aiding triaging. Dataset created as a part of this research: https://github.com/primate-mh/Primate2022

Introduction

While conversational agents (CAs) are increasingly used for mental health support, they are mostly limited to providing generic advice or reminders. Using them for triage—the process of determining the severity of a condition to prioritize care—is significantly more complex. The core challenge is that state-of-the-art Deep Language Models (DLMs) like T5 are prone to "hallucination," generating irrelevant, repetitive, or even unsafe questions. Furthermore, these models often lack the "common sense" to realize when a user has already provided specific information in their initial post. For example, if a user writes, "I haven't slept in three days," a standard AI might still redundantly ask, "How is your sleep quality?" This redundancy frustrates users and makes the triage process inefficient.

Methods and Framework

The researchers propose a pipeline that constrains AI generation using Process Knowledge—structured clinical expertise. This framework ensures that the AI stays diagnostically relevant and avoids asking about symptoms the user has already described.

The proposed pipeline for controlled follow-up question generation using process knowledge.

The methodology involves several key components:

  1. Extended PHQ-9: The Patient Health Questionnaire (PHQ-9) is a standard tool for screening depression. To provide more linguistic variety, researchers expanded these 9 questions into 134 semantically similar sub-questions with MHP validation.
  2. The Answerability Evaluator: A BERT-based classifier acts as a "gatekeeper," analyzing user posts to determine which PHQ-9 questions are already "answerable."
  3. Controlled Generation: By identifying what is already known, the system focuses on generating follow-up questions (FQs) only for the unanswered symptoms.
  4. Model Iteration: Three versions of the T5 model were compared: Model 1 (pre-trained on SQuAD), Model 2 (fine-tuned on Reddit posts), and Model 3 (fine-tuned on Reddit data specifically filtered for high similarity to the extended PHQ-9).

Datasets

  • Reddit (r/depression_help): A dataset of ~21,000 posts used to capture natural language regarding depression.
  • Extended PHQ-9: A curated list of 143 questions (9 original + 134 sub-questions) validated by MHPs.
  • PRIMATE (PRocess knowledge Integrated Mental heAlth daTasEt): The primary contribution, consisting of 2,003 Reddit posts annotated for "answerability" against the PHQ-9.

Key Results

Model 3, the PHQ-9 filtered version, significantly outperformed the others. Its "Hit Rate" on BLEURT (a measure of semantic similarity) at a 0.5 threshold was 0.71, compared to just 0.12 for the base pre-trained model. Furthermore, Model 3 showed a 9.37% improvement in generating questions that structurally matched clinical sub-questions compared to models without process knowledge. The BERT evaluator also achieved strong Matthews Correlation Coefficient (MCC) scores (above 0.6 for several categories), proving it can reliably identify when a symptom has already been mentioned.

Discussion and Future Work

Clinical constraints are necessary because general-purpose language models are often too "unruly" for mental health applications. By anchoring the model to a clinical instrument like the PHQ-9, the AI is forced to stay diagnostically relevant. Future work will focus on scaling this to other conditions like anxiety (using GAD-7) and suicide risk (using C-SSRS), as well as developing explainable safety metrics specifically for mental health AI. The ultimate goal is to provide a tool that assists professionals by providing a streamlined, focused questioning strategy.

Summary updated

Abstract

Conversational Agents (CAs) powered with deep language models (DLMs) have shown tremendous promise in the domain of mental health. Prominently, the CAs have been used to provide informational or therapeutic services to patients. However, the utility of CAs to assist in mental health triaging has not been explored in the existing work as it requires a controlled generation of follow-up questions (FQs), which are often initiated and guided by the mental health professionals (MHPs) in clinical settings. In the context of depression, our experiments show that DLMs coupled with process knowledge in a mental health questionnaire generate 12.54% and 9.37% better FQs based on similarity and longest common subsequence matches to questions in the PHQ-9 dataset respectively, when compared with DLMs without process knowledge support. Despite coupling with process knowledge, we find that DLMs are still prone to hallucination, i.e., generating redundant, irrelevant, and unsafe FQs. We demonstrate the challenge of using existing datasets to train a DLM for generating FQs that adhere to clinical process knowledge. To address this limitation, we prepared an extended PHQ-9 based dataset, PRIMATE, in collaboration with MHPs. PRIMATE contains annotations regarding whether a particular question in the PHQ-9 dataset has already been answered in the user's initial description of the mental health condition. We used PRIMATE to train a DLM in a supervised setting to identify which of the PHQ-9 questions can be answered directly from the user's post and which ones would require more information from the user. Using performance analysis based on MCC scores, we show that PRIMATE is appropriate for identifying questions in PHQ-9 that could guide generative DLMs towards controlled FQ generation suitable for aiding triaging. Dataset created as a part of this research: https://github.com/primate-mh/Primate2022
BibTeX
@inproceedings{gupta2022learning,
  author = {Shrey Gupta and Anmol Agarwal and Manas Gaur and Kaushik Roy and Vignesh Narayanan and Ponnurangam Kumaraguru and Amit P. Sheth},
  title = {{Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2022},
}
Figure