Reclassification Is All You Missed: Surfacing Variant Reinterpretation Need in Online Health Communities at Population Scale

Kamalakkannan Ravi, Mengshu Nie, Annapurna Poduri, Cong LiuarXiv 2026 · arXiv

TL;DR

PRISM is an agentic large-language-model (LLM) pipeline designed to identify individuals in online health communities whose genetic test results have been reclassified in clinical databases. By scanning 3.9 million Reddit posts, the system surfaced 123 candidate cases where a variant's pathogenicity had changed since the user's original post, demonstrating a scalable way to bridge the "recontact gap" in clinical genomics.

What Problem Does This Paper Address?

Genetic testing is not a one-time event; our understanding of DNA variants evolves. A variant initially labeled as a "Variant of Uncertain Significance" (VUS) may later be reclassified as "pathogenic" (disease-causing) or "benign" as more data accumulates in databases like ClinVar.

However, a massive "recontact gap" exists. Clinicians often lack the resources or clear mandates to track down former patients when these classifications change. Consequently, many patients rely on outdated information that could impact their medical management. Many of these individuals turn to online communities (like Reddit) to discuss their results, creating a public but untapped signal of unmet medical needs.

Methods

The authors developed PRISM, a three-agent cascade powered by GPT-4o-mini, to process unstructured social media text at a population scale.

Figure 1: Overview of PRISM. A three-agent cascade: triage labels each of 3.9 million posts, the 11,253 reinterpretation-relevant (B2) posts advance to Branch-2 (which resolves the variant’s ClinVar classification as of the test date against the current one), and the 123 candidate classification differences reach the outreach agent, which drafts a disclaimer-bearing outreach message. A collaborating clinician rates each of 30 held-out drafts (Step 4); dashed elements run only at evaluation time.
  1. Triage Agent: A high-throughput classifier that screens the entire corpus to identify "reinterpretation-relevant" posts (labeled B2).
  2. Branch-2 Agent: For B2 posts, this agent extracts genetic identifiers (gene, variant, and test date). The pipeline then performs a deterministic programmatic lookup in ClinVar to compare the classification at the time of the post versus the current classification.
  3. Outreach Agent: If a discrepancy is found, this agent drafts a peer-toned, disclaimer-bearing message suggesting the user follow up with a genetic counselor.
  4. Outreach Coach Agent: A meta-agent used during development to automatically refine the Outreach Agent's prompts based on reviewer feedback, ensuring messages are non-alarmist and contextually appropriate.

The system was evaluated using a "dry-run" approach—no messages were actually sent to users. Instead, drafts were subjected to rigorous clinician review.

Datasets

  • PRISM Corpus: A newly assembled dataset of 3.9 million public posts from 32 health-related Reddit subreddits, spanning 2008 to 2026. These include specialist genetics forums (e.g., r/BRCA), consumer testing sites (e.g., r/23andme), and general medical advice forums (e.g., r/AskDocs).
  • Synthetic Control Set: 6,940 synthetic posts with known "ground truth" answer keys, built backward from real ClinVar variant histories to validate the pipeline's extraction and resolution accuracy.

Key Insights and Ideas

  • Concentration vs. Volume: While reinterpretation-relevant discussion is rare in the general population (0.288%), it is highly concentrated in specialist communities. For example, the rate in r/BRCA is 21.15%, compared to just 0.11% in r/AskDocs.
  • The Dissociation of Rate and Volume: As shown in Figure 2, specialist communities provide the "densest" signal, but general advice forums, due to their massive size, still contain a significant absolute number of relevant cases.
  • Factual Accuracy $\neq$ Clinical Fitness: The LLM was highly accurate at stating the facts of reclassification (27/30 cases). However, clinicians only deemed 50% of the messages "fit to send." The failures were often due to subtle communication issues like "overreach" (e.g., implying a diagnosis) or poor contextualization.
  • Cost-Effectiveness: The authors processed the entire 3.9M post corpus for approximately $698 in API fees, suggesting that population-scale screening is financially viable for large health systems or registries.
Figure 2: Rate and volume dissociate. Each of the 32 communities is positioned by size (posts) against reinterpretation-relevant (B2) rate, both on log scales; point area scales with B2 count, dashed contours mark constant B2 volume, and the dotted line is the corpus-wide rate (0.288%). Specialist genetics communities (purple) sit upper-left (small, high-rate) and general-advice forums (grey) lower-right (large, low-rate). Inset: the B2 rate by year (2026 is a partial year).

Key Results

  • Detection: PRISM identified 11,253 reinterpretation-relevant posts and surfaced 123 candidate classification differences.
  • High-Consequence Changes: Among the 123 candidates, 5 involved a shift from an uncertain submission to a "pathogenic" or "likely pathogenic" classification.
  • Clinician Validation: In a held-out set of 30 real-post drafts, a clinician found that 90% (27/30) were factually grounded. However, the "fit to send" rate was lower at 50% (15/30), highlighting the need for a human-in-the-loop for actual outreach.
Table showing the distribution of reclassification types found in the 123-post outreach pool.

Limitations and Future Work

  • Representativeness: The study is limited to Reddit, which skews toward younger, U.S.-based, and more educated users.
  • Human-in-the-Loop Necessity: Because the "fit to send" rate was only 50%, the authors emphasize that PRISM is a "surfacing layer" intended to assist clinicians, not an autonomous outreach tool.
  • Ethics and Consent: While the study used public data for a dry run, moving to live outreach raises complex questions regarding user consent and the "duty to recontact" in digital spaces.
  • Future Directions: The authors suggest the PRISM template could be adapted for other unmet needs, such as identifying patients who might benefit from new pharmacogenomic guidelines.
Figure 3: Held-out examples: PRISM’s recontact drafts and the clinician’s verdict. Two of the N=30 test-set drafts, one fit, one unfit, paraphrased and excerpted for privacy/Terms-of-Use. Across the held-out set, 27 of 30 stated the reclassification correctly, while 15 of 30 drafts (50%) were rated fit to send under the clinician’s overall call.

Summary updated

Abstract

Genetic variants are routinely reclassified in ClinVar after a patient is tested, sometimes from uncertain to pathogenic, yet patient recontact is inconsistent, with no clear duty and responsibility diffused among labs, providers, and patients. Many affected people discuss their results in public online health communities that clinical recontact often does not reach. We built PRISM, an agentic large-language-model pipeline that screens these posts, checks whether the variant was later reclassified, and drafts a disclaimer-bearing outreach message, in a no-contact dry run. Across 3.9 million posts from 32 communities, agent-predicted reinterpretation-relevant discussion is rare (0.288%) but concentrated in specialist genetics communities (6.30% versus 0.10% in general medical-advice communities) and growing fivefold since 2014; PRISM surfaces 123 candidate classification differences, 5 of them from an uncertain submission to pathogenic or likely pathogenic. On a held-out set of 30 real-post drafts, a clinician judged 27 factually grounded and 15 fit to send: factual accuracy is necessary but not sufficient for clinically acceptable outreach. PRISM contributes a population-scale reinterpretation-need map with code and data to be released upon publication.
BibTeX
@misc{ravi2026reclassification,
  author = {Kamalakkannan Ravi and Mengshu Nie and Annapurna Poduri and Cong Liu},
  title = {{Reclassification Is All You Missed: Surfacing Variant Reinterpretation Need in Online Health Communities at Population Scale}},
  year = {2026},
  eprint = {2611.07054},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.07054},
}
Figure