Trust the Edge, Doubt the Arrow: Auditing Validation Signals for Text-Mined Clinical Causal Knowledge Graphs

Su Lan, Shicheng Zhou, Yiqi Wang, Yanming Zhu, Xuefei Yin, Alan Wee-Chung LiewarXiv 2026 · arXiv

In the world of clinical AI, Retrieval-Augmented Generation (RAG) is often hailed as the cure for hallucinations. By grounding Large Language Models (LLMs) in structured Knowledge Graphs (KGs) mined from clinical notes, we hope to give them "causal reasoning" capabilities. But there’s a catch: just because an LLM extracts a relationship like "Condition A causes Condition B" doesn't mean it's true, or even that the direction is correct.

The paper "Trust the Edge, Doubt the Arrow" provides a sobering reality check and a rigorous framework for auditing these text-mined clinical causal graphs.

TL;DR

The authors demonstrate that while LLMs are great at identifying that two clinical concepts are related (the "edge"), they and the underlying electronic health record (EHR) data are often unreliable at determining the causal direction (the "arrow"). By auditing these signals and implementing a "causal demotion" strategy, they reduced evidence-unsupported hallucinations in clinical QA from 17.3% to 6.1%.

What Problem Does This Paper Address?

Mining causal relations from clinical narratives (e.g., "hepatic encephalopathy due to alcoholic cirrhosis") is a powerful way to build KGs for medical reasoning. However, these extracted triples are merely "candidates."

The authors identify two major hurdles:

  1. Support: Does the patient's structured data (ICD codes, etc.) actually show these conditions appearing together?
  2. Direction: If they appear together, which one is the cause? A common assumption is that the condition coded earlier in time is the cause. However, in clinical data, "coding time" often reflects when a doctor discovered a condition, not when it actually started.

Existing systems often use these signals blindly. This paper asks: Which of these validation signals can we actually trust?

Table 1: Positioning against prior work. The authors' approach is the first to combine directed mining, EHR support filtering, and direction auditing.

Methods

The researchers built a framework to Build, Audit, and Apply clinical causal KGs:

  1. Build: They used Qwen2.5-7B to extract causal triples from over 328,000 MIMIC-IV discharge summaries, normalizing the terms using UMLS concepts.
  2. Audit: They tested three validation signals against SemMedDB (a massive database of relations mined from PubMed literature):
  3. Co-occurrence Lift: Do these two conditions appear in the same admission more often than chance?
  4. Temporal Precedence: Does the "cause" actually get coded before the "effect" across different hospital visits?
  5. Literature Corroboration: Does the medical literature agree with the extracted direction?
  6. Apply: They integrated the audited KG into a RAG pipeline for a causal QA task, using a "causal-screen demotion" policy that moves candidates failing the causal audit to the bottom of the retrieval list.
Fig. 1. Overview of the proposed audit-and-retrieval framework. Build: causal can- didates are mined from clinical notes and normalized to UMLS concepts. Audit: co- occurrence lift provides EHR support, coding-order time is unreliable for direction, and SemMedDB provides partial literature corroboration. Apply: support-aware causal RAG retrieves from the EHR-supported candidate graph and demotes candidates that fail the causal screen, reducing evidence-unsupported answers at fixed recall.

Datasets

  • MIMIC-IV: The primary dataset of 328,839 discharge summaries used to build the KG and the QA benchmark.
  • MIMIC-III: Used for cross-release replication to ensure the findings weren't a fluke of one dataset version.
  • SemMedDB: Used as the "silver standard" literature reference for causal direction.
  • New Benchmark: The authors introduced a patient-grounded causal QA benchmark consisting of 932 WHY and WHATCAUSES questions, controlled for data leakage.

Key Insights and Ideas

  • The "Discovery vs. Onset" Trap: The most striking finding is that coding order is a terrible signal for direction. In the EHR, chronic conditions are often co-coded, and a "cause" might only be documented after its "effect" becomes severe enough to warrant a hospital visit.
  • The Asymmetry of Evidence: It is much easier to verify that a relationship exists (using co-occurrence lift) than it is to verify its direction.
  • LLMs are better than "Naive" Data: Surprisingly, the LLM's internal "judgment" of direction during extraction (73.6% agreement with literature) was significantly more accurate than the temporal signal from the structured EHR data (54.2%).
  • Faithfulness > Raw Accuracy: In clinical settings, it's often more important that a model's answer is supported by evidence than that it simply guesses the right concept. The "causal demotion" strategy prioritizes evidence that passed the audit.

Key Results

  • Temporal Failure: On the subset of edges where the temporal signal made a definitive call, it agreed with literature only 54.2% of the time—barely better than a coin flip.
  • Directional Audit: As shown in Figure 2, of the 304 cases where the temporal signal tried to "reverse" the LLM's extracted direction, 204 were "false reversals" (errors introduced by the data) and only 100 were true corrections.
Fig. 2. Direction-signal audit. Left: on the 686 candidate relations where cross- admission temporal precedence commits to a direction, it agrees with SemMedDB less often (54.2%) than the extractor’s own direction (69.4%) and barely above chance. Right: of temporal’s 304 “reversed” verdicts, 204 are false reversals (coding artifacts) and only 100 are true corrections.
  • RAG Improvement: Using the "lift-only + demotion" strategy, the system maintained high recall while slashing the rate of evidence-unsupported answers from 17.3% to 6.1%.
  • Extraction Efficiency: LLM-based extraction was far superior to rule-based methods, doubling the UMLS link rate and creating a much more connected and usable graph.
Table 2. Candidate-KG construction on the full pre-split corpus: rule-based vs. LLM extraction.

Limitations and Future Work

  • Scope: The current audit is limited to diagnosis-coded endpoints. Future work is needed to include medications, lab results, and procedures.
  • Literature Coverage: SemMedDB only covered about 30% of the candidate relations, leaving a large portion of the "long tail" of clinical observations unverified by literature.
  • Onset Correction: The authors suggest that future research should look into "onset-correction" algorithms to make temporal signals from EHRs more reliable.
  • Benchmark Coupling: The QA benchmark is partially coupled to the "lift" signal, which the authors acknowledge as a limitation in providing a truly independent causal validation.

Summary updated

Abstract

Clinical causal retrieval-augmented generation systems increasingly use knowledge graphs (KGs) mined from notes, yet extracted assertions remain candidates that require audit for patient-level EHR support and direction. We construct a directed candidate graph from 328,839 MIMIC-IV discharge summaries using LLM extraction and UMLS normalization, and evaluate three signals against SemMedDB: within-admission co-occurrence lift, cross-admission diagnosis-coding temporal precedence, and literature corroboration. Lift filters unsupported co-mentions and provides useful EHR support, but not causal proof. Coding order is a weak direction signal: among the 686 candidates where it commits, it reaches 54.2% agreement with SemMedDB, below the extractor's 69.4% on the same subset. Literature corroboration supplies independent direction evidence but covers only 30.4% of candidate relations. A MIMIC-III replication yields the same pattern: extractor direction remains stable (70.5%), whereas coding-order direction is near chance (50.9%). Thus, text-mined clinical causal candidate KGs are best treated as EHR-supported but direction-uncertain. In a leakage-controlled causal QA benchmark, lift-only retrieval achieves 35.7% accuracy; conservative causal demotion achieves 37.2% while reducing evidence-unsupported answers from 17.3% to 6.1% at fixed retrieval recall. We release code, aggregate summaries, and scripts to regenerate restricted outputs.
BibTeX
@misc{lan2026trust,
  author = {Su Lan and Shicheng Zhou and Yiqi Wang and Yanming Zhu and Xuefei Yin and Alan Wee-Chung Liew},
  title = {{Trust the Edge, Doubt the Arrow: Auditing Validation Signals for Text-Mined Clinical Causal Knowledge Graphs}},
  year = {2026},
  eprint = {2610.24390},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.24390},
}
Figure