Refining Adverse Drug Reactions using Association Rule Mining for Electronic Healthcare Data

Jenna Reps, Uwe Aickelin, Jiangang Ma, Yanchun Zhang

TL;DR

This paper introduces an unsupervised data-mining approach that uses association rule mining to filter out false-positive adverse drug reaction (ADR) signals caused by confounding factors in electronic health records. By identifying alternative medical explanations in a patient's history, the method calculates a more accurate "confounding-adjusted risk" for potential side effects.

What Problem Does This Paper Address?

Discovering unknown adverse drug reactions (ADRs)—a field known as pharmacovigilance—is crucial for patient safety. While electronic healthcare databases provide massive amounts of data to spot potential drug-side-effect associations, standard signal-generation methods suffer from notoriously high false-positive rates.

The primary culprit is confounding: a drug and a health outcome might appear strongly associated simply because both are linked to a third underlying factor, such as a pre-existing illness or a shared indication. Existing refinement methods, like fitting multi-variable logistic regressions or using natural language processing (NLP) on clinical notes, are either highly time-consuming to automate or rely on unstructured text reports that are frequently missing from databases. The authors tackle the challenge of automatically filtering these signals using only structured, readily available electronic health data.

Methods

The authors propose a framework that emulates how a medical expert evaluates a patient's history to find alternative explanations for a symptom.

Instead of standard market basket analysis (e.g., "customers who buy pasta also buy cheese"), they construct "medical baskets" for each patient containing their gender, medical diagnoses, and prescribed drugs. They then apply Association Rule Mining (ARM) to find rules where a specific Health Outcome of Interest (HOI) is the consequence (i.e., {antecedent} => {HOI}).

An overview of the refinement framework that generates the confounding-adjusted risk

Standard ARM algorithms fail here because medical outcomes are often rare, yielding joint probabilities too low to clear typical minimum support thresholds. To bypass this, the authors utilize a metric called Left Support—the baseline probability of the antecedent alone—combined with a minimum confidence threshold.

The refinement pipeline works as follows:

  1. Identify all instances where a patient experiences an HOI within 1 to 60 days after taking a Drug of Interest (DOI).
  2. Scan the patient's history prior to the HOI to see if any antecedents from the mined HOI rules are present.
  3. If an antecedent is found and its rule has a lift > 1 (meaning the antecedent makes the outcome more likely than random chance), the instance is flagged as "expected" due to an alternative cause and is filtered out.
  4. Compute the Confounding-adjusted Risk by dividing the remaining "unexpected" instances by the total drug exposures.

Datasets

The method was evaluated using The Health Improvement Network (THIN) database, a massive general practice database from the UK.

  • Scope: The authors used a randomly selected subset containing complete medical records for approximately 4 million patients.
  • Coding Systems: Health outcomes were mapped using the hierarchical Read code system (up to level 3 detail), and prescriptions were mapped via the British National Formula (BNF) codes (up to level 2 detail).
An overview of the read code hierarchy

To prevent data entry bias—such as doctors retroactively entering a patient's historical illnesses with new dates upon registration—the first 12 months of records for any newly registered patient were strictly excluded.

Key Insights and Ideas

  • Left Support is Essential for Rare Events: Traditional support metrics suppress rules involving rare diseases. Shifting the constraint to Left Support ensures that rare but highly predictive medical antecedents are not ignored.
  • Confidence is a Poor Metric for Medicine: The authors noted that the confidence values for most medical rules were under 5%. Because rare health outcomes have dozens of disparate causes, no single antecedent will have high confidence.
  • Lift is the Better Discriminator: Instead of confidence, Lift proved to be the crucial metric because it accounts for the baseline rarity of the outcome, successfully identifying true confounding patterns.

Key Results

The methodology was tested on the quinolone drug family (258,397 first-time prescriptions) across four distinct health outcomes with varying characteristics:

The results of the novel method for the four quinolone-HOI signals
  • Candidiasis (Known ADR): As a known side effect, it shouldn't be entirely filtered out. The method appropriately flagged 38% of instances as having alternative causes, adjusting the absolute risk down from $1.2 \times 10^{-2}$ to $8.1 \times 10^{-3}$.
  • Secondary Malignant Neoplasm (Unlikely Acute ADR): Cancer is highly unlikely to be an acute reaction to an antibiotic. The algorithm successfully found alternative explanations for 100% of the instances, driving the confounding-adjusted risk to exactly 0.
  • Sudden Death (Temporal Bias): Death cannot occur before a drug is taken, creating a natural temporal bias in raw data. The method filtered out 79% of these instances, dropping the risk from $2.8 \times 10^{-4}$ to $5.8 \times 10^{-5}$.
  • Multiple Organ Failure (Rare Code): Because this code appeared only 262 times in the entire database, the algorithm could only generate a single rule. Consequently, no instances were filtered, highlighting a data-sparsity limitation.

Limitations and Future Work

While promising as a proof of concept, the authors identify several clear limitations:

  1. Data Sparsity: The system struggles to generate meaningful association rules for extremely rare medical codes.
  2. History Dependency: The method fails for patients with short medical histories (e.g., newly registered patients), as there is not enough baseline data to discover alternative causes.
  3. Combinatorial Explosion: Due to computational constraints, the authors limited the size of rule antecedents to three or fewer items.

Future Directions: The authors suggest integrating patient age to combat age-related confounding, automating parameter tuning based on the baseline frequencies of specific drug-outcome pairs, and utilizing high-performance parallel computing to mine larger, more complex antecedent sets.

Summary updated

Abstract

Side effects of prescribed medications are a common occurrence. Electronic healthcare databases present the opportunity to identify new side effects efficiently but currently the methods are limited due to confounding (i.e. when an association between two variables is identified due to them both being associated to a third variable). In this paper we propose a proof of concept method that learns common associations and uses this knowledge to automatically refine side effect signals (i.e. exposure-outcome associations) by removing instances of the exposure-outcome associations that are caused by confounding. This leaves the signal instances that are most likely to correspond to true side effect occurrences. We then calculate a novel measure termed the confounding-adjusted risk value, a more accurate absolute risk value of a patient experiencing the outcome within 60 days of the exposure. Tentative results suggest that the method works. For the four signals (i.e. exposure-outcome associations) investigated we are able to correctly filter the majority of exposure-outcome instances that were unlikely to correspond to true side effects. The method is likely to improve when tuning the association rule mining parameters for specific health outcomes. This paper shows that it may be possible to filter signals at a patient level based on association rules learned from considering patients' medical histories. However, additional work is required to develop a way to automate the tuning of the method's parameters.
BibTeX
@inproceedings{reps2014refining,
  author = {Jenna Reps and Uwe Aickelin and Jiangang Ma and Yanchun Zhang},
  title = {{Refining Adverse Drug Reactions using Association Rule Mining for Electronic Healthcare Data}},
  booktitle = {Workshops @ ICDM},
  year = {2014},
  doi = {10.2139/ssrn.2828032},
}
Figure