TL;DR
This systematic evaluation of 1,170 high-profile medical articles reveals a profound disconnect between the "associational" language researchers use to describe results and the "causal" weight of their practical recommendations. The study finds that avoiding explicit causal language does not lead to clarity; instead, it creates "Schrödinger’s causal inference," where findings are simultaneously treated as mere correlations and as the basis for clinical action.
What Problem Does This Paper Address?
In observational health research, there is a long-standing "taboo" against using causal language (e.g., "X causes Y") because these studies are prone to confounding and bias. To be "cautious," researchers often employ associational euphemisms (e.g., "X is associated with Y").
However, this creates a gap: if a study isn't claiming causality, why should a doctor change their practice based on it? The authors tackle the "linguistic gymnastics" used in high-profile journals to see if avoiding causal words actually improves clarity or if it simply allows researchers to imply causality without being held accountable to the rigorous methodological standards required for causal inference.
Methods
The authors conducted a massive systematic evaluation using a "crowdsourced" approach with 48 reviewers (primarily epidemiology and statistics experts).
- Sampling: They screened 1,170 articles from 18 high-profile journals (e.g., The Lancet, JAMA, NEJM) published between 2010 and 2019.
- Review Process: Each article was reviewed by three unique randomly selected reviewers (two independent and one arbitrator).
- Rating Scale: Reviewers rated the "causal implication strength" of linking sentences and action recommendations on a four-point scale: None, Weak, Moderate, or Strong.
- Linguistic Analysis: They performed a "root word" exercise, where reviewers rated the inherent causal strength of specific words (like "impact," "link," or "associate") both in and out of context.
Datasets
The study utilized a newly curated dataset of 1,170 articles (1,065 observational studies and 105 Randomized Controlled Trials for comparison) across 18 top-tier journals. The journals were selected based on impact factor and SJR scores across medicine, public health, and epidemiology.
Key Insights and Ideas
- The "Association" Trap: "Associate" was the most common linking word (45.7%). While often used to avoid causal claims, over half of the reviewers rated the word "association" as having at least some causal implication.
- Action vs. Language Disconnect: In 44.5% of articles, the action recommendations (what people should do) implied a stronger causal link than the sentences describing the results. Essentially, authors were "cautious" in their results but "bold" in their advice.
- Schrödinger’s Causal Inference: The authors coin this term to describe studies that avoid stating a causal interest yet are embedded with causal intent, inference, and recommendations.
- Linguistic Heterogeneity: There is no consensus on what words mean. Reviewers’ ratings of the same root words were highly varied, suggesting that the "technical" vocabulary of epidemiology is far more subjective than researchers realize.
- RCT Similarity: Surprisingly, Randomized Controlled Trials (the gold standard for causality) used similar linking words to observational studies, suggesting a universal "scientific dialect" that obscures the underlying strength of evidence.
Key Results
- Implied Causality: Even in observational abstracts, only 13.8% of linking language was rated as having "No" causal implication. The rest were rated as Weak (34.2%), Moderate (33.2%), or Strong (18.7%).
- Policy Impact: Journals with explicit policies against causal language (like JAMA) did have lower causal language strength, but they also had a lower prevalence of action recommendations.
- Causal Intent: While only 3.8% of studies used formal causal models (like Directed Acyclic Graphs), 80% offered some theoretical discussion of causal mechanisms, showing that causality is almost always the "elephant in the room."
Limitations and Future Work
The authors acknowledge that their ratings are subjective; however, they argue this is a feature, not a bug, as it reflects how the "consumers" of research actually interpret language. The study was limited to high-profile journals, so results might differ in niche or lower-tier publications.
Future Work: The authors suggest moving away from "policing" specific words. Instead, they recommend that researchers clearly state their target estimand—explicitly defining whether they are seeking a causal effect or a simple prediction. Clarity, they argue, comes from methodological transparency, not from stripping "causal" words out of the dictionary.
Summary updated