What You Post Is What You Symptom: Estimating Psychometric Networks from Social Media Discourse

Ştefana-Arina Tăbuşcă, Ana Sabina Uban, Liviu P. DinuarXiv 2026 · arXiv

This paper, recently presented by researchers from the University of Bucharest, explores a fascinating intersection of Natural Language Processing (NLP) and psychometrics. Titled "What You Post Is What You Symptom," it investigates whether we can estimate the complex web of interacting symptoms that define mental disorders—known as psychometric networks—directly from social media discourse.

TL;DR

The authors developed a framework to estimate item-resolved psychometric networks from social media text, mapping user posts to specific clinical questionnaire items. They found that while NLP-derived networks structurally resemble clinical ones, they reveal different "bridge" symptoms, highlighting a gap between what patients report on scales and how they express distress naturally.

What Problem Does This Paper Address?

In modern psychopathology, disorders aren't just lists of symptoms; they are viewed as networks of interacting elements (e.g., insomnia leads to fatigue, which leads to loss of interest). Traditionally, these networks are built using self-report questionnaires like the Beck Depression Inventory (BDI-II).

However, questionnaires have limitations: they are "snapshots" restricted to a fixed set of questions. This paper addresses the challenge of moving beyond self-reports to naturalistic text. The core question is: Can we build a reliable symptom network from social media that actually matches clinical reality? If so, we could potentially identify "bridge symptoms"—the critical nodes that link different aspects of a disorder—which are primary targets for clinical intervention.

Methods

The authors introduced a multi-stage pipeline to transform unstructured Reddit posts into structured symptom scores:

  1. Symptom Retrieval: They used a two-stage bi-encoder cascade. First, a lightweight model (all-MiniLM-L6-v2) ranks a user's posts against the phrasing of specific questionnaire items. Then, a more powerful model (bge-large) re-encodes the top 1,000 posts to produce a continuous "symptom expression score."
  2. First-Person Filtering: To ensure the scores reflected personal experience rather than general discussion, they applied a filter requiring a minimum density of first-person singular pronouns ("I", "me", "my").
  3. Network Estimation: Using these scores, they estimated Gaussian Graphical Models (GGM). In these networks, nodes represent symptoms and edges represent partial correlations.
  4. Comparison: They used the Network Comparison Test (NCT) to formally compare the NLP-derived networks against ground-truth networks built from the same users' actual questionnaire responses.

Datasets

The study utilized three corpora from the eRisk shared tasks:

  • Depression Corpus (eRisk 2021): 169 users who completed the BDI-II (21 items).
  • Eating Disorders Corpus (eRisk 2022-2025): 92 users who completed the EDE-Q (22 items).
  • Anorexia Corpus (eRisk 2024): 784 users with binary diagnosis labels, used for cross-dataset validation of linguistic markers.
  • eRisk 2025 Task 1: A benchmark of 28k human-annotated sentences used to evaluate the retrieval pipeline's accuracy.

Key Insights and Ideas

  • Structural Skeleton vs. Bridge Nodes: The most striking finding is that while the "skeleton" of the network (the edges) is highly consistent between text and questionnaires (only 3-5% difference), the bridge symptoms diverge.
  • Clinical vs. Linguistic Bridges: In clinical networks, bridges are often somatic (e.g., Loss of Energy). In NLP networks, bridges are more cognitive and self-referential (e.g., Guilt, Worthlessness). This suggests that people might endorse physical symptoms on a scale, but they write about their cognitive distress as the connecting thread of their experience.
  • Transdiagnostic Linguistic Markers: The authors identified 29 linguistic features that were consistent across all three datasets (Depression, ED, and Anorexia). These include high use of "I" pronouns, reduced "analytic" thinking style, and increased mentions of somatic content (health/illness).
Figure 1: Signed rank-biserial effects of the 29 trans- diagnostic features in each disorder. Positive values indicate features elevated in symptomatic users.

Key Results

  • Validation: For depression, NLP-derived scores correlated with BDI-II totals at $\rho=0.434$. Impressively, 20 out of 21 individual symptoms reached statistical significance.
  • Reliability: The NLP scores showed a high split-half reliability of 0.935, indicating the measurement is stable across different subsets of a user's post history.
  • Network Similarity: The BDI-II NLP network (shown below) successfully recovered the known two-factor structure (Somatic-Affective and Cognitive) of depression.

Limitations and Future Work

  • Platform Bias: The data is exclusively from Reddit, which has specific demographic and cultural norms. Generalization to other platforms or clinical settings remains untested.
  • Small Samples for ED: The Eating Disorder results were exploratory due to a smaller sample size ($N=92$), showing weaker correlations than the depression cohort.
  • Stance Detection: The current model doesn't distinguish between someone having a symptom and someone discussing it (e.g., "I am not tired" vs "I am tired"). The authors suggest stance classification as a vital next step.
  • Ethics: The authors emphasize that these models are for population-level research and descriptive psychopathology, not for individual diagnostic screening, which raises significant privacy and clinical oversight concerns.

Summary updated

Abstract

Symptom networks in psychopathology are estimated almost exclusively from self-report questionnaires, restricting inference to whatever symptom set a given instrument covers. We introduce a framework for symptom-resolved network estimation directly from social media discourse and apply the framework to depression and eating disorders, with a third anorexia corpus as cross-dataset validation. To our knowledge, we are the first to estimate symptom-resolved psychometric networks from social media text, compare them to clinical co-endorsement networks, and replicate transdiagnostic linguistic markers across 3 independently recruited corpora spanning 2 disorders simultaneously. For depression, expression scores correlate with BDI-II totals at $ρ{=}0.434$, 20 of 21 items reach FDR significance, and split-half reliability is 0.935. The Network Comparison Test detects few edge differences between modalities (3-5\% of edges), while bridge symptoms diverge. For eating disorders, the item-level results are exploratory. Identified linguistic features replicate the same direction across all 3 corpora, and they cluster in three construct families.
BibTeX
@misc{tabusca2026what,
  author = {Ştefana-Arina Tăbuşcă and Ana Sabina Uban and Liviu P. Dinu},
  title = {{What You Post Is What You Symptom: Estimating Psychometric Networks from Social Media Discourse}},
  year = {2026},
  eprint = {2611.21362},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.21362},
}
Figure