Current and Future Psychological Health Prediction using Language and Socio-Demographics of Children for the CLPysch 2018 Shared Task

Sharath Chandra Guntuku, Salvatore Giorgi, Lyle H. UngarCLPsych @ NAACL 2018 · DOI

Abstract

This study explores the potential of childhood linguistic markers to predict long-term psychological well-being. Using essays written by 11-year-olds from the National Child Development Study (NCDS), researchers applied machine learning techniques to identify correlations between early-life language use and mental health outcomes up to 30 years later. By combining linguistic features—such as word clusters, psychological lexicons, and personality scores—with socio-demographic data, the research demonstrates that while language is a strong indicator of current mental state, socio-economic factors remain primary predictors of long-term psychological distress.

Introduction

Most computational linguistics research in mental health focuses on immediate detection from contemporary sources like social media. This paper addresses the "long game": can the way a child imagines their future at age 11 provide statistically significant clues about their mental health at ages 23, 33, or 42? Identifying these early markers could facilitate preventative care and deepen our understanding of developmental trajectories.

The study utilizes the National Child Development Study (NCDS), a British birth cohort following over 17,000 individuals born in 1958. The primary text source consists of 10,511 essays where 11-year-olds imagined their lives at age 25. Mental health labels include the Bristol Social Adjustment Guide (BSAG) at age 11 and distress scores at ages 23, 33, and 42.

Methods

The researchers framed the task as a regression problem using Ridge Regression to predict continuous mental health scores. The feature extraction pipeline included:

  • Open Vocabulary: Unigrams and metadata (essay length).
  • Clustering & Topics: Word2Vec-based hard clusters and Latent Dirichlet Allocation (LDA) topics.
  • Psychological Lexicons: LIWC (Linguistic Inquiry and Word Count) and the NRC Emotion Lexicon.
  • Derived Features: Personality scores (Big Five) assigned via pre-trained models.
  • Socio-Demographics: Gender and parental social class.

Performance was measured using the Disattenuated Pearson Correlation ($r_{disatt}$), which accounts for measurement error in psychological surveys.

Results and Key Insights

The system excelled at predicting current health at age 11, with unigrams achieving $r_{disatt} = 0.477$. For future health, the team ranked fourth in the shared task, with the strongest long-term predictions for distress at age 42.

Linguistic Markers of Well-being

Linguistic analysis revealed that increased use of first-person singular pronouns ("I") and frequent misspellings at age 11 were significantly correlated with poor current mental health. In contrast, children who wrote about future physical activities, family, and friends tended to have better mental health outcomes.

Heatmap showing correlations between LIWC linguistic categories and mental health outcomes at various ages.

Socio-Demographics vs. Language

A key finding was that socio-demographic variables (e.g., parental social class) outperformed linguistic features for long-term predictions. While language serves as a sensitive "thermometer" for current psychological state, socio-economic status acts as a more robust "barometer" for outcomes decades later.

Semantic Drift and Domain Adaptation

The study noted "semantic drift," where the emotional valence of words changed over time. For instance, mentions of "husband" or "school" were positive markers at age 11 (as aspirations) but became associated with negative outcomes when looking ahead to age 23.

Word cloud representing common aspirational terms found in the childhood essays, such as "husband," "teacher," and "school."

Furthermore, models trained on modern social media language (like the NRC and Personality models) performed poorly on 1960s handwritten essays, highlighting the challenge of temporal domain adaptation.

Discussion and Limitations

The authors acknowledge that linear models may not fully capture the complex, non-linear relationships between childhood language and adult health. They suggest that future work could utilize stacked autoencoders to better model latent variables. Additionally, performance might be improved by training word clusters on historical corpora (e.g., 1960s literature) to better reflect the linguistic norms of the era in which the essays were written.

Summary updated

BibTeX
@inproceedings{guntuku2018current,
  author = {Sharath Chandra Guntuku and Salvatore Giorgi and Lyle H. Ungar},
  title = {{Current and Future Psychological Health Prediction using Language and Socio-Demographics of Children for the CLPysch 2018 Shared Task}},
  booktitle = {CLPsych @ NAACL},
  year = {2018},
  doi = {10.18653/v1/w18-0610},
}
Figure