Who You Fear Infecting: Measuring Vector Guilt in Text Across Demographic Groups and Online Communities

During an epidemic, many people are less afraid of catching the disease than of passing it on: to their children, their elderly parents, or their patients. Clinicians have measured this other-directed fear, which we call vector guilt, with surveys. Pediatric caregivers isolated with possibly infected children feared infecting family (70.7%) and others (62.3%) more than they feared infecting themselves (51.9%). Text-based mental health monitoring has never measured it. Models that read social media posts detect depression or anxiety in general, and the people they read are filtered by who uses each platform. This proposal builds the first annotated text benchmark that separates fear of infecting others from fear for oneself. It then asks a precise question about the demographic gaps these models show: are they caused by gender, or by the social role that decides whom a person could infect?

The bet is this. Vector guilt is defined by its target, and the target follows from a person's role: parent of young children, caregiver of an elderly relative, frontline clinician. The words that signal the fear should therefore cluster by role more than by gender. Roles are unevenly spread across genders and across online communities. As a result, part of what looks like a gender difference in how detectable distress is may actually be a difference in role mix. We test this directly by splitting a gender gap in detection accuracy into a role-composition part and a within-role part. We also test whether models split by role serve each group better than models split by gender.

Core Claim

The specific new claim is that, for other-directed crisis distress, the right unit for separate subgroup models is the exposure role, and gender is the wrong unit. A model that partitions by role should satisfy each group's preference for its own model more often than one that partitions by gender. It should also explain most of the observed gender gap in detection accuracy.

This builds most directly on Towards Understanding the Role of Gender in Deploying Social Media-Based Mental Health Surveillance Models. That paper trained separate depression classifiers on Reddit users from r/AskMen and r/AskWomen. It found the models worked better on men: a male-trained model scored an AUC of 0.770 on male test users, while a female-trained model scored 0.707 on female test users. (AUC is the area under the ROC curve; 0.5 is chance and 1.0 is perfect ranking.) It also found that features flip meaning across genders. "My mum" predicted depression in men, "my son" predicted it in women, and "my husband" predicted control status for men but depression for women. These are kinship and role words. That paper treated the flips as gender effects. We treat them as a hypothesis about roles, and we study a construct, vector guilt, where role is part of the definition. That paper also used a single platform and depression only, and it did not test whether subgroups actually prefer their own model.

Grounding in Prior Work

Three survey studies motivate the construct and suggest it diverges across groups. Surveying pediatric caregivers' readiness for dyad isolation in the hospital during COVID-19 is the only direct measurement of vector guilt. It used ad hoc survey items, had no text data, and had too few men (49) for a subgroup analysis. In it, depressive dejection (mean HADS score 10.38 on the Hospital Anxiety and Depression Scale) exceeded anxiety (7.35). That pattern suggests vector guilt may read more like guilt and low mood than like worry, which is exactly why generic anxiety lexicons might miss it. The impact of COVID-19 on the lives of Canadians with and without non-communicable chronic diseases found sex-divergent coping: women with chronic illness showed more anxiety and depression, while men drank more. That study used regression on survey data, with no prediction models. Subtypes of nurses' mental workload found that senior, married nurses were concentrated in the highest-workload class. This is a role effect that cuts across demographic categories, and it is the kind of confound our decomposition is built to expose.

The text setting comes from Tracking Mental Health Risks and Coping Strategies in Healthcare Workers' Online Conversations. It analysed 67 million words from Reddit healthcare workers and found self-distancing (fewer "I", "me", "my") and social withdrawal (more "they"), more so among nurses. It stratified by profession only, did not define vector guilt, and noted Reddit's skew without correcting for it.

Platform skew is the constraint. Mental Health Surveillance over Social Media with Digital Cohorts applied pooled classifiers to 48,000 randomly sampled Twitter users. It produced prevalence estimates of 30.2% for depression and 30.8% for PTSD, far above national clinical figures. OpinionGPT showed that individual subreddits impose their own demographic worldview on models fine-tuned on them. We take a lesson from both: the community a post comes from is a selection filter, and it must appear explicitly in the evaluation.

Methods come from two papers. From Fairness without Harm: Decoupled Classifiers with Preference Guarantees we take the evaluation criteria for separate per-group models. Rationality means each group does better with its own model than with the pooled one. Envy-freeness means no group would do better with another group's model. That paper's exact integer-programming solver will not scale to text, so we keep the criteria and drop the solver. From Demographic Factors Improve Classification Performance we take demographic-conditioned representations as the main shared-model alternative. Its modest gains (0.2 to 1.0 F1, significant in 8 of 30 cases) are a warning that conditioning alone often helps only a little.

Research Program

Building the benchmark. We will build a Reddit corpus covering the pandemic period. It will draw on communities with different demographic skews: the healthcare-worker subreddits used in the tracking study, parenting and caregiving communities, and r/AskMen and r/AskWomen. Posts mentioning infection or transmission will be annotated at the sentence level by trained annotators. The labels have two dimensions. The first is the target of the fear: oneself, household or family, patients or colleagues, or strangers. The second is its form: fear of transmission, guilt or self-blame over possible transmission, fear of being stigmatized as a source, or generic distress with no target.

User-level attributes come from self-disclosure in post history. Gender comes from AskMen/AskWomen participation and user flair, following the gender paper. Role comes from explicit statements such as "as an ICU nurse" or "my two toddlers". We will audit a sample of these by hand to estimate how often they are wrong. We aim for a few thousand annotated sentences, with double annotation and agreement statistics reported per label.

As a weak external validity check, we will look at caregiver-role users in our labels. We expect the target ordering found in the survey: family first, then others, then self.

Modeling. All models share one pretrained transformer encoder, a neural network that turns text into vectors, fine-tuned on the benchmark. We compare five setups:

  1. a pooled model;
  2. a pooled model with gender or role given as conditioning inputs;
  3. separate output heads per gender;
  4. separate output heads per role;
  5. a hybrid that shares the encoder but fits per-role heads only where the group has enough data.

To deal with small groups, each per-group head is shrunk toward the pooled head. The amount of shrinkage is tuned on held-out data, so a group with little data falls back to the shared model.

Decomposing the gap. Let $A_g(\pi)$ be the AUC of the deployed model on test users of gender $g$, after reweighting those users so their role mix matches the distribution $\pi$. Let $\pi_M$ and $\pi_F$ be the observed role mixes for men and women. The observed gender gap then splits into two parts:

$$A_M(\pi_M) - A_F(\pi_F) = \underbrace{[A_F(\pi_M) - A_F(\pi_F)]}_{\text{role composition}} + \underbrace{[A_M(\pi_M) - A_F(\pi_M)]}_{\text{within-role gender difference}}.$$

The reweighting is applied only to the test set. It is a measurement device, not a training fix, so the argument about reweighting during training does not affect it. Confidence intervals come from bootstrapping over users. We repeat the decomposition in each community, which shows whether community skew changes the role mix, the within-role gap, or both.

Baselines

The naive reference point is a pooled classifier trained on all users with no demographic information. It is scored per gender, per role, and per community. Every other system must beat it on group-wise AUC and macro-F1, without making any group worse off.

A second simple reference is a lexicon model: logistic regression on Linguistic Inquiry and Word Count (LIWC) anxiety and emotion categories plus word embeddings. This follows Detecting Anxiety through Reddit, which reports 98% accuracy for anxiety-subreddit detection. That number comes from separating whole communities and does not transfer to our task. The purpose of this baseline is to test whether vector guilt is anything more than anxiety vocabulary. Telling self-directed from other-directed fear with clearly higher macro-F1 than this baseline counts as evidence that the construct is distinct.

The strongest existing reference for gender-split mental health classifiers is the stratified design in Towards Understanding the Role of Gender. On depression it reports an AUC of 0.770 for the male-trained model on male users and 0.707 for the female-trained model on female users. No reported result was found on Lacuna for vector guilt detection on any dataset. So we re-run that paper's design on our labels, as gender-split logistic regression and as gender-split transformer heads. Our result to beat is that partitioning by role meets rationality for more groups than partitioning by gender, at equal or better average AUC.

The strongest shared-model competitor is demographic conditioning in the style of Demographic Factors Improve Classification Performance. We implement it as gender or role tokens and as gender-by-role interaction tokens on the shared encoder. A zero-shot large language model is also included, prompted with the annotation guideline. Group DRO (distributionally robust optimization, which trains to improve the worst-off group) is included with strong regularization and early stopping.

All trained systems get the same data splits, the same encoder, and the same hyperparameter search budget, chosen by group-averaged validation AUC. The ablation that isolates our key ingredient is to keep everything else fixed and swap the partitioning variable: gender, role, community, or a random partition with matched group sizes. If role-based partitioning does no better than a size-matched random partition, the role hypothesis fails.

Why not just…?

Why not just feed gender and role as inputs to one pooled model? This is the most serious competitor. A transformer with interaction tokens can, in principle, learn the same role-specific word meanings that separate heads learn. We will not argue around it: it is baseline number two. If it matches the per-role heads on group-wise AUC and on rationality, we will report that as the finding. The scientific contribution then comes from the decomposition and the benchmark rather than from the model design. The case against it in the file is real but indirect. The gender paper's flipped features and the marijuana-risk study, where parental closeness was protective in one group and a risk factor in another, both show that pooled linear models cancel out opposing signals. Neither shows the same for a conditioned transformer.

Why not just reweight training data to census targets, or use group DRO? Understanding Why Generalized Reweighting Does Not Improve Over ERM proves that reweighting converges to the same solution as unweighted training for overparameterized models trained to fit the data exactly. In practice, regularized and early-stopped group DRO often still helps worst-group accuracy. So the proof does not settle the matter, and we run regularized group DRO as a baseline. More fundamentally, reweighting changes how much each example counts. It cannot fix a target-specific word meaning that is learned wrongly. The decomposition experiment shows whether the gap comes from composition, which reweighting could address, or from within-role differences, which it cannot.

Why not just prompt a large language model to find fear of infecting others? For plain detection this may work well, and we may lose on that axis. That is why the zero-shot model is a reported baseline and not a strawman. The proposal does not depend on beating it. The decomposition and the preference-guarantee audit apply to any classifier, including the language model. Whether its gender gap is also mostly role composition is itself one of the results.

Why not just use existing anxiety or depression classifiers? If vector guilt is only anxiety, the lexicon baseline and an off-the-shelf anxiety classifier will separate other-directed from self-directed fear as well as a fine-tuned model does. The survey's finding that dejection exceeds anxiety predicts that they will not. The target-classification experiment tests this directly.

Decisive Checks

The program has three falsifiable predictions.

  1. The construct is distinct. Fine-tuned models separate other-directed from self-directed fear clearly better than the anxiety lexicon baseline. If they do not, vector guilt adds nothing measurable over anxiety in text.
  2. Most of the gender gap is role composition. The role-composition term accounts for most of the gender gap in AUC, with bootstrap intervals that exclude zero. If the within-role gender term dominates instead, the original gender explanation stands for this construct.
  3. Role is the better partition, and it holds across communities. Per-role heads meet rationality and envy-freeness for more groups than per-gender heads and beat size-matched random partitions. When we train on healthcare-worker communities and test on parenting communities, the per-role models lose less accuracy than gender-split ones.

If prediction 2 fails, we still deliver the first vector guilt benchmark and a clean negative result about where demographic detection gaps come from.