Psychotherapy Style Scale: Development and Validation

Shegang Zhou, Yanfei Hou, Ding Liu, Duo Xu, Xiaoyuan ZhangFrontiers in Psychology 2021 · DOI

Abstract

Psychotherapy style is conceptualized as the therapeutic method that a therapist employs while working with clients during treatment. It influences both the therapeutic process and results of therapeutic actions. The present study developed and validated the Psychotherapy Style Scale (PSS). By following a systematic psychometric development process, a three-factor structure of the PSS was identified. Exploratory factor analysis and confirmatory factor analysis provided evidence of multidimensional structure and validity of the PSS. Cronbach’s α suggested that the resulting scale was highly reliable. Criterion validity was also satisfactory, demonstrated by correlations between the scale and criterion validity measures. The PSS has the potential to help better understand therapists’ behavioral characteristics and select the most appropriate therapists for clients who undergo psychotherapy.

Introduction

Research consistently indicates that the "therapist factor"—the individual differences between practitioners—accounts for 5% to 9% of the variance in psychotherapy outcomes. Despite its importance, defining and measuring these differences has proven challenging. Existing instruments often conflate a therapist's behavioral style with their theoretical orientation or include non-clinical behaviors that do not reflect in-session performance.

The Psychotherapy Style Scale (PSS) was developed to provide a "pure" measure of behavioral style, defined as a habitual way of working influenced by personality and training. By isolating style from theory, the PSS aims to facilitate better therapist-client matching and enhance clinical supervision.

Methodology

The development of the PSS involved three distinct phases using samples of therapists from various clinical settings in China (hospitals, universities, and private practice).

  1. Qualitative Foundation: In-depth interviews with nine senior experts established the conceptual dimensions of "style." A two-round Delphi procedure refined an initial 40-item pool.
  2. Structural Exploration: Exploratory Factor Analysis (EFA) was conducted with a sample of 235 therapists. This process identified a 17-item structure across three primary factors.
Table 1: Factor loadings for the 17-item PSS across three identified factors (f1, f2, f3).
  1. Validation: A separate sample of 468 therapists was used for Confirmatory Factor Analysis (CFA) to verify the model's robustness and test criterion validity against established personality measures like the IPIP-IPC and NEO-PI-R.

Key Results and Validation

The CFA confirmed that the 17-item, three-factor model provided an excellent fit for the data (χ²/df = 2.762, CFI = 0.951, RMSEA = 0.062). The three factors identified are Directiveness (D), Closeness (C), and Planning (P).

Figure 1: Confirmatory factor analysis model of the PSS (n = 468), showing the three-factor structure and item indicators.

The scale demonstrated high internal consistency, with Cronbach’s α coefficients ranging from 0.84 to 0.90 across the subscales. Criterion validity was supported by significant correlations with the Interpersonal Circumplex; for instance, the "Closeness" factor correlated strongly (r = 0.595) with the "Warm-Agreeable" dimension.

Discussion: The Three Pillars of Style

The PSS defines a therapist's "vibe" through three dimensions:

  • Directiveness: The extent to which a therapist guides the session, gives advice, and takes the lead in decision-making.
  • Closeness: The emotional distance and warmth maintained with the client, focusing on friendliness and empathy.
  • Planning: The preference for structured, pre-set procedures versus a more spontaneous, "go-with-the-flow" approach.

Importantly, the authors argue that style is independent of theoretical orientation. Therapists from different schools (e.g., CBT vs. Psychodynamic) may share similar styles, such as high closeness and low directiveness, which may be more predictive of client fit than their theoretical background alone.

Limitations and Future Directions

While the PSS is a robust tool, several limitations remain. The current data relies on therapist self-reports, which may be subject to bias; future studies should compare these results with client perceptions and objective session recordings. Additionally, the sample was limited to Chinese therapists, necessitating further cross-cultural validation. Finally, the "Planning" dimension showed lower criterion validity, suggesting a need for more refined external benchmarks for this specific trait.

Summary updated

Abstract

Psychotherapy style is conceptualized as the therapeutic method that a therapist employs while working with clients during treatment. It influences both the therapeutic process and results of therapeutic actions. The present study developed and validated the Psychotherapy Style Scale (PSS). By following a systematic psychometric development process, a three-factor structure of the PSS was identified. Exploratory factor analysis and confirmatory factor analysis provided evidence of multidimensional structure and validity of the PSS. Cronbach’s α suggested that the resulting scale was highly reliable. Criterion validity was also satisfactory, demonstrated by correlations between the scale and criterion validity measures. The PSS has the potential to help better understand therapists’ behavioral characteristics and select the most appropriate therapists for clients who undergo psychotherapy.
BibTeX
@inproceedings{zhou2021psychotherapy,
  author = {Shegang Zhou and Yanfei Hou and Ding Liu and Duo Xu and Xiaoyuan Zhang},
  title = {{Psychotherapy Style Scale: Development and Validation}},
  booktitle = {Frontiers in Psychology},
  year = {2021},
  doi = {10.3389/fpsyg.2021.543989},
}
Figure