A comprehensive psychological tendency prediction model for pregnant women based on questionnaires

Xiaosong Han, Mengchen Cao, Junru He, Dong Xu, Yanchun Liang, Xiaoduo Lang, Renchu GuanScientific 2023 · DOI

Abstract

Antenatal depression (AD) is a significant public health concern, affecting maternal well-being and child development. Early detection is crucial but often hampered by the high dimensionality and inherent class imbalance of clinical questionnaire data. This paper presents a novel machine learning framework, Stacked Auto Encoder Support Vector Data Description (SAE-SVDD), designed to predict AD by treating it as an anomaly detection task. Validated on a dataset of 5,666 pregnant women, the model achieved an F-score of 87.96%, outperforming traditional classifiers. Furthermore, the study identifies key socio-environmental risk factors, such as work stress and marital status, through an improved TF-IDF analysis.

Introduction

In modern society, the prevalence of mental disorders is rising due to increased psychological pressure. Among these, antenatal depression (AD) affects between 10% and 30% of pregnant women. AD is not only a primary predictor of postpartum depression but also correlates with adverse physical health outcomes for the mother and developmental issues for the child.

While screening questionnaires are widely used, they present two significant computational challenges:

  1. High Dimensionality: Modern surveys collect a vast array of features (147 in this study), many of which are redundant or noisy.
  2. Data Imbalance: In clinical screening, the "depressed" group is significantly smaller than the "healthy" group. Standard binary classifiers often struggle with this "needle in a haystack" scenario, frequently biasing toward the majority class.

Methodology

The researchers developed the SAE-SVDD model, a hybrid architecture combining unsupervised feature extraction with a self-adaptive one-class classifier. The workflow consists of two primary phases:

1. Feature Embedding via Stacked Auto Encoders (SAE)

To manage the 147 raw features, the model employs a Stacked Auto Encoder. This unsupervised neural network learns to compress input data into a lower-dimensional "latent" space. This acts as a sophisticated filter, retaining only the most informative patterns while stripping away noise.

The stacking process of individual Auto Encoders into a deep neural network architecture.

2. One-Class Classification (SA-SVDD)

Rather than training on both "healthy" and "depressed" labels simultaneously, the model uses Support Vector Data Description (SVDD). This technique constructs a "hypersphere" (a multi-dimensional bubble) around the majority (healthy) data. Any data point falling outside this boundary is flagged as an anomaly—in this context, a patient at risk for depression. To handle complex data distributions, the authors integrated Affinity Propagation (AP) clustering and Particle Swarm Optimization (PSO) to fine-tune the classifier's parameters.

Key Insights and Ideas

The success of the SAE-SVDD model rests on its ability to distill complex psychological data into a manageable form.

Dimensionality Reduction: The study found that compressing 147 features down to 90 (or even 30) dimensions did not degrade performance. This indicates that psychological surveys often contain significant redundancy. By focusing on a compressed feature set, the model becomes more efficient and less prone to overfitting.

Dimensionality reduction from input features (Layer L1) to a compressed latent representation (Layer L4).

Anomaly Detection for Imbalance: By framing depression as an "anomaly" relative to a healthy baseline, the researchers bypassed the common pitfalls of training on imbalanced data. This makes the model more robust for real-world clinical screening where healthy patients vastly outnumber those at risk.

Key Results

The model was first validated on three benchmark datasets (Adult, Madelon, and Protein) to ensure generalizability. When applied to the clinical dataset of 5,666 pregnant women from Jilin Women and Children Hospital, SAE-SVDD achieved an F-score of 87.96%.

This performance significantly exceeded that of traditional SVDD (85.26%) and deep learning architectures like CNNs (56.60%) and LSTMs (48.14%), which likely overfitted on the imbalanced tabular data. Beyond classification, the researchers used an improved TF-IDF (Term Frequency-Inverse Document Frequency) analysis to rank the importance of questionnaire items. The top indicators for AD included:

  • Work stress
  • Marital status
  • Husband support
  • Passive smoking
  • Alcohol consumption

Conclusion

The SAE-SVDD model provides a robust, efficient, and interpretable framework for screening antenatal depression. By successfully addressing the hurdles of high-dimensional and imbalanced data, it offers a practical tool for early clinical intervention. Future work will focus on reducing the computational overhead of the optimization phase and validating the model across diverse cultural cohorts to ensure the universality of the identified risk factors.

Summary updated

Abstract

More and more people are under high pressure in modern society, leading to growing mental disorders, such as antenatal depression for pregnant women. Antenatal depression can affect pregnant woman's physical and psychological health and child outcomes, and cause postpartum depression. Therefore, it is essential to detect the antenatal depression of pregnant women early. This study aims to predict pregnant women's antenatal depression and identify factors that may lead to antenatal depression. First, a questionnaire was designed, based on the daily life of pregnant women. The survey was conducted on pregnant women in a hospital, where 5666 pregnant women participated. As the collected data is unbalanced and has high dimensions, we developed a one-class classifier named Stacked Auto Encoder Support Vector Data Description (SAE-SVDD) to distinguish depressed pregnant women from normal ones. To validate the method, SAE-SVDD was firstly applied on three benchmark datasets. The results showed that SAE-SVDD was effective, with its F-scores better than other popular classifiers. For the antenatal depression problem, the F-score of SAE- SVDD was higher than 0.87, demonstrating that the questionnaire is informative and the classification method is successful. Then, by an improved Term Frequency-Inverse Document Frequency (TF-IDF) analysis, the critical factors of antenatal depression were identified as work stress, marital status, husband support, passive smoking, and alcohol consumption. With its generalizability, SAE-SVDD can be applied to analyze other questionnaires.
BibTeX
@inproceedings{han2023comprehensive,
  author = {Xiaosong Han and Mengchen Cao and Junru He and Dong Xu and Yanchun Liang and Xiaoduo Lang and Renchu Guan},
  title = {{A comprehensive psychological tendency prediction model for pregnant women based on questionnaires}},
  booktitle = {Scientific},
  year = {2023},
  doi = {10.1038/s41598-022-26977-3},
}
Figure