Models that flag depression from a person's social media history work noticeably worse for women than for men on Reddit. This matters because Reddit's users skew young, male and Western. A linear classifier trained on male users reaches an AUC of 0.770 on held-out men but 0.702 on women. Training on women barely helps: that model reaches 0.707 on women (Towards Understanding the Role of Gender in Deploying Social Media-Based Mental Health Surveillance Models). So the gap is not just a shortage of female training data. It comes from somewhere else, and the field does not know where. That paper treats each user as a static bag of words, so it cannot separate two quite different sources. The first is what individual posts say: the same phrase, such as "my husband," predicts depression for women and the absence of depression for men. The second is how a person's history is sampled by the platform: how many posts are observed, how they are spaced in time, and how signals accumulate across them.
We propose to make that separation measurable with a hierarchical recurrent model. A lower network reads each post word by word into a vector. An upper recurrent network, one that carries a running memory state from step to step, reads those post vectors in time order. Because the two levels are distinct modules, we can refit one level on women's data while freezing the other, and see how much of the gap each level recovers. We can also resample men's histories to match women's posting cadence and see how much of the gap is a sampling artifact. The core claim is that the demographic gap can be split into a lexical part, a trajectory part, and a label-noise part. The split should identify which fix is worth applying, and a fix aimed at the dominant part should close more of the gap than generic rebalancing at the same cost.
Core Claim and Positioning
The architecture is not new. It is the two-tier design introduced for dialogue by Hierarchical Neural Network Generative Models for Movie Dialogues, whose encoder-plus-context recurrent networks beat a flat recurrent network in perplexity (26.81 vs 35.63). It was adapted to utterance-level emotion recognition by HiGRU, which pools word-level gated recurrent units into utterance vectors and then runs a second gated recurrent unit over utterances. Both papers supply the method. Neither asks whether the speakers in its data are demographically skewed, and we reuse the architecture precisely because its levels can be separated.
The closest prior work on bias attribution is Step by Step to Fairness. It perturbs demographic terms in task-oriented dialogue and attributes 70–80% of system bias to the response-generation module of flat Transformer pipelines. We borrow its spirit of assigning bias to components. We differ in three ways: our components are levels of a single learned model rather than pipeline stages; we use natural longitudinal user data rather than synthetic text perturbations; and our main intervention is resampling the data distribution (posting cadence), which perturbation of a single input cannot express.
Elucidating Mechanisms of Demographic Bias in LLMs for Healthcare localized gender to one middle layer of OLMo-7B via activation patching. It motivates the hope that bias is localized enough to attribute, and we use patching as a secondary analysis on the upper memory state. NeuralHydrology showed that integrated gradients over time steps can reveal which past inputs a recurrent model's memory relies on. We use the same "time steps of influence" analysis to ask whether the upper network weights early versus recent posts differently for men and women.
The idea is new in four respects. Nobody has decomposed a demographic performance gap across the levels of a hierarchical sequence model. Nobody has tested platform posting cadence as a source of that gap. Nobody has validated such a decomposition against injected ground truth. And nobody has shown that a level-targeted fix beats untargeted ones.
Research Program
Data. We reconstruct the Reddit cohort of the gender study. Gender comes from participation and flair in r/AskMen and r/AskWomen. Depression labels come from posting in r/depression, and the label-defining posts and subreddits are removed from each history to prevent leakage. Each user becomes a time-ordered sequence of posts with timestamps. We inherit the cohort's known weaknesses: binary, self-disclosed gender, and heuristic labels. We address the label weakness directly below rather than assume it away.
Model. The model is a HiGRU-style two-level network. The lower level is a bidirectional gated recurrent unit over tokens with max-pooling, as in HiGRU. The upper level is a gated recurrent unit over post vectors, and each step also receives the log time gap since the previous post, so cadence is visible to the model rather than silently absorbed. Training uses only the user-level label. To read out which posts carry risk, we optionally use the coarse-to-fine logic constraints of Logic-driven Indirect Supervision, which tie session-level labels to utterance-level tags.
Decomposition. We start from a model trained on men and measure its AUC gap $\Delta = \mathrm{AUC}_M - \mathrm{AUC}_F$. We then make three moves at a fixed fine-tuning budget. The first refits only the lower encoder on women's data with the upper level frozen, which estimates the lexical share. The second refits only the upper level, which estimates the trajectory share. The third keeps the model fixed and evaluates on men's test histories subsampled to match the women's distribution of history length and inter-post gaps, which estimates the share due to sampling cadence. Running the refits in both orders bounds the interaction between the two levels.
Whatever these moves cannot recover is attributed to the third part, label noise. We probe it with a manual audit of a few hundred r/depression posts per group, checking whether the author is writing about themselves or about a family member, which the gender study flagged as a misattribution risk.
Targeted fixes. If the lexical share dominates, we add group-conditioned gating, in which the lower encoder's activations are scaled by a learned function of group. If the trajectory share dominates, we train with cadence-matched resampling and time-gap inputs at the upper level. Each fix is applied only at its own level.
Baselines
The naive reference point is the domain-informed logistic regression of the gender study. It reports AUC 0.770 on men and 0.702 on women when trained on men, and 0.707 on women when trained on women. We rerun it on our reconstruction so that all numbers share one split, and we report its gap alongside ours.
The strongest existing accuracy competitor is a fine-tuned pretrained Transformer over the concatenated post history, truncated to its context window. We found no reported result on Lacuna for a Transformer on this gender cohort. The nearest figure is BERT-base at 80.65 F1 on Dreaddit stress classification (Dreaddit), which is a different task and is not directly comparable.
A second strong competitor is the psycholinguistic-feature BiLSTM of What to Fuse and How to Fuse, which beat Transformer fusions on Reddit depression detection. We found no reported result on Lacuna for its gender gap.
Fairness baselines include group reweighting, separate per-group models, and a logistic regression with group-by-feature interaction terms. The last directly models the "my husband" sign flip and is therefore the most dangerous competitor.
Fairness of comparison requires the same users, splits and history-truncation rules for all methods. It also requires an equal hyperparameter search budget (the same number of trials per method), and selection on a validation set that reports both groups. Ablations isolating our key ingredient are a flat gated recurrent unit over all tokens, the hierarchical model without time-gap inputs, and conditioning applied at the wrong level.
Beating the baselines means the targeted fix reduces the female–male AUC gap more than reweighting and the interaction model do, at no more than a 0.01 loss in male AUC, with the reduction holding over five seeds and bootstrap confidence intervals that exclude zero.
Why not just…?
Why not just add group-by-word interaction terms to a linear model? This is the real threat. If the gap is mostly lexical sign flips, an interaction model should close it, and the hierarchy would add nothing. Our decomposition tests this exact prediction. A large lexical share alongside a closed gap for the interaction model would mean the simpler method wins, and we would report that. The hierarchy earns its place only if the trajectory or cadence share is substantial, because a bag of words cannot see either.
Why not just rebalance or train separate per-group models? The gender study already shows that training on women raises female AUC only from 0.702 to 0.707, so data volume is not the main issue. We still run reweighting as a baseline at equal budget.
Why not just use a long-context Transformer? It may match or beat our accuracy, and capacity may even worsen fairness: Step by Step to Fairness found T5 more biased than GPT-2. Its accuracy is not the question, though. The cadence-matching evaluation is model-agnostic, and we apply it to the Transformer too. What the Transformer cannot offer is the level-wise refit, so if cadence turns out to explain the gap, the Transformer result corroborates the finding rather than refuting it.
Decisive Checks
The first check validates the decomposition before trusting it on real data. We take the male cohort, split it into two pseudo-groups, and inject known bias into one. In one condition we flip the label association of a fixed set of phrases (purely lexical bias). In another we thin the histories to shorter, sparser posting (purely cadence bias). The method passes only if it assigns at least most of the gap to the correct level in each condition.
The second check runs the decomposition on the real cohort and reports each share with bootstrap intervals.
The third check compares the level-targeted fix against reweighting and the interaction model at matched budget.
The fourth check is the label audit. If the per-group misattribution rate differs by an amount comparable to the unexplained residual, we conclude that part of the "bias" sits in the platform's labeling proxy and that no model will fix it. That would be a useful negative result for anyone deploying these surveillance systems.
References
- Towards Understanding the Role of Gender in Deploying Social Media-Based Mental Health Surveillance Models
- Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
- HiGRU: Hierarchical Gated Recurrent Units for Utterance-Level Emotion Recognition
- Step by Step to Fairness: Attributing Societal Bias in Task-oriented Dialogue Systems
- Elucidating Mechanisms of Demographic Bias in LLMs for Healthcare
- NeuralHydrology - Interpreting LSTMs in Hydrology
- Logic-driven Indirect Supervision: An Application to Crisis Counseling
- Dreaddit: A Reddit Dataset for Stress Analysis in Social Media
- What to Fuse and How to Fuse: Exploring Emotion and Personality Fusion Strategies for Explainable Mental Disorder Detection