CounselTraj: Synthesizing Process-Aware Psychological Counseling Dialogues via Dialogue-Act Trajectory Planning

Zhiyang Qi, Michimasa InabaarXiv 2026 · arXiv

TL;DR

CounselTraj is a novel framework that transforms short, "shallow" synthetic counseling dialogues into long-form, process-aware sessions by planning a structured trajectory of dialogue acts. By training on human role-play data, the system generates CounselTrajD, a dataset of over 10,000 high-quality Chinese counseling dialogues, and CounselTrajLM, a model that significantly outperforms existing open-source counseling LLMs in therapeutic understanding and session coherence.

What Problem Does This Paper Address?

Training LLMs for psychological counseling is a "data desert" problem. Authentic transcripts are nearly impossible to share due to strict privacy requirements. While researchers have turned to synthetic data, existing datasets suffer from three major "hallmarks of artificiality":

  1. Short Sessions: Most synthetic dialogues last only 5–15 turns, whereas a real session typically lasts an hour (30–40+ turns).
  2. Abrupt Disclosure: Synthetic clients often dump their entire life story in the first turn, missing the gradual "warming up" and relationship-building seen in real therapy.
  3. Rigid Patterns: Synthetic counselors often fall into a repetitive "empathy-then-question" loop, failing to use the diverse strategies (reflection, affirmation, suggestion) that human experts employ as a session evolves.
Figure 1: Motivation of CounselTraj. Existing synthetic psychological counseling dialogues are diverse but of- ten brief and lack session-level process structure. Coun- selTraj expands them into process-aware session-level dialogues through dialogue-act trajectory planning.

Methods

The authors propose a five-step pipeline to bridge the gap between brief synthetic "seeds" and professional-grade sessions:

  1. Dialogue-Act Annotation: They took high-quality human role-play data (from the KokoroChat dataset) and annotated every turn with specific "dialogue acts" (e.g., Reflection, OpenQuestion for counselors; SelfDisclosure, Resistance for clients).
  2. Brief Dialogue Construction: They used LLMs to "compress" these long human sessions into brief, information-dense summaries that mimic the style of existing synthetic datasets.
  3. Trajectory Planning Training: They trained a planner (based on Qwen3-8B) to predict the full sequence of dialogue acts (the "trajectory") based only on the brief summary.
  4. Trajectory Planning: For any new short synthetic dialogue, the planner generates a 40+ turn roadmap of what acts the counselor and client should perform next.
  5. Session-Level Expansion: Finally, a large model (GPT-4o or similar) uses the brief seed and the planned trajectory as "soft guidance" to write out the full, long-form dialogue.
Figure 4: Overview of CounselTraj. High-quality Japanese counseling role-play dialogues from KokoroChat are annotated with dialogue acts and rewritten as brief Chinese dialogues through few-shot prompting. A trajectory planner is trained on the paired brief dialogues and annotated trajectories. For each existing brief synthetic dialogue, the planned trajectory flexibly guides an LLM to generate a long-form, process-aware counseling conversation.

Datasets

The study utilizes several key datasets for training and evaluation:

  • Human-Collected: KokoroChat (Japanese role-play), AnnoMI (English), and PsyDial-D4 (Chinese).
  • Synthetic Seeds: SmileChat, CPsyCounD, and PsyDTCorpus.
  • New Contribution: CounselTrajD, a new benchmark containing 10,964 process-guided Chinese counseling dialogues, each averaging over 87 utterances.

Key Insights and Ideas

  • The "Arc" of a Session: By analyzing human data, the authors found a distinct "increase-then-decrease" pattern in client utterance length. Real clients talk more as they open up in the middle of a session and less as the counselor moves toward summaries and coping strategies. Synthetic datasets usually show a flat or strictly decreasing trend.
  • The Value of Resistance: Human clients often show "Resistance" (hesitation or disagreement), which is crucial for realistic training. Synthetic clients are often "too cooperative," making the counseling process look unrealistically smooth.
  • Acts over Text: Planning the function of a sentence (the dialogue act) before the content prevents the model from drifting off-topic or becoming repetitive during long-form generation.
Figure 2: Comparison of stage-wise changes in normal- ized client utterance length across datasets. Solid lines indicate datasets with human client utterances.

Key Results

The authors evaluated their fine-tuned model, CounselTrajLM, against nine other Chinese counseling models.

  • Session Quality: In "LLM-as-a-judge" evaluations, CounselTraj-expanded dialogues scored significantly higher (avg. 4.24/5) than direct expansion (2.43/5) or the original brief seeds (2.36/5).
  • Human Preference: Professional psychology students preferred CounselTraj-expanded dialogues over the original synthetic versions in over 70% of cases.
  • Downstream Performance: CounselTrajLM achieved an overall score of 4.70 on the PsychEval benchmark, substantially exceeding the previous state-of-the-art, SoulChat2.0 (3.82). It showed particular strength in "Therapeutic Alliance" and "Process Coherence."

Limitations and Future Work

  • Role-Play vs. Reality: The model is trained on role-play data between humans, which, while high-quality, may still differ from actual clinical encounters with real patients.
  • Language Specificity: The current implementation and the resulting CounselTrajD dataset are focused on Chinese. The authors note that cross-lingual validation is a key step for future work.
  • Clinical Validation: While the model performs well on linguistic and therapeutic benchmarks, it has not been clinically validated for use in real-world medical or crisis intervention settings.

Summary updated

Abstract

The growing demand for psychological counseling has motivated the development of LLM-based systems that support human counselors, but training such systems requires large-scale, high-quality dialogue data. Authentic counseling transcripts are difficult to collect and share because of privacy concerns, making synthetic dialogues an important alternative. However, existing synthetic datasets, despite covering diverse scenarios and client profiles, often consist of brief exchanges and fail to capture session-level counseling processes. We propose CounselTraj, a dialogue-act trajectory planning framework for expanding brief synthetic dialogues into process-aware, session-level psychological counseling dialogues. CounselTraj learns dialogue-act patterns from role-play counseling dialogues produced by human counselors, plans coordinated trajectories for clients and counselors, and uses them as flexible guidance for long-form dialogue generation. Experiments across three Chinese synthetic counseling datasets show that CounselTraj produces more complete and coherent sessions with higher-quality counselor interventions than both direct expansion and expansion with randomly sampled trajectories. Based on CounselTraj, we construct CounselTrajD, a dataset containing over 10K process-guided Chinese psychological counseling dialogues, and use it to train CounselTrajLM for counseling response generation. Evaluations at both the response and session levels show that CounselTrajLM outperforms publicly available Chinese counseling models in response quality, therapeutic understanding and intervention, and counseling-process coherence and progress. Our code and model are publicly available at https://github.com/UEC-InabaLab/CounselTraj.
BibTeX
@misc{qi2026counseltraj,
  author = {Zhiyang Qi and Michimasa Inaba},
  title = {{CounselTraj: Synthesizing Process-Aware Psychological Counseling Dialogues via Dialogue-Act Trajectory Planning}},
  year = {2026},
  eprint = {2611.24168},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.24168},
}
Figure