Infectious Disease Informatics and Syndromic Surveillance

Daniel Zeng 0001, Hsinchun Chen, Ping Yan, Daniel Dajun ZengDigital Government 2008 · DOI · DBLP

Introduction

Infectious Disease Informatics (IDI) is an emerging field that bridges information technology and public health to provide real-time situational awareness. A core component of IDI is "syndromic surveillance"—the practice of detecting disease outbreaks using pre-diagnostic data, such as pharmacy sales and emergency room (ER) "chief complaints," before laboratory confirmation is available. This approach is critical for managing both natural pandemics and potential bioterrorism events.

The Challenge of Latency in Public Health

Traditional public health surveillance is inherently slow, relying on confirmed laboratory results or official physician reports that can take days or weeks to materialize. In the event of a fast-moving pandemic or a bioterrorism attack, such delays can be catastrophic. IDI addresses this by building an infrastructure capable of ingesting messy, real-time data, automating classification, and detecting statistical anomalies that indicate an outbreak.

Technical Framework for Surveillance

Building an effective IDI system requires a multi-layered technical approach focusing on data interoperability and automated analysis.

Data Standardization

To ensure that disparate hospital systems can communicate effectively, IDI systems leverage established healthcare standards. These standards provide a common language for messaging, laboratory orders, and clinical terminology.

Consolidated Health Informatics (CHI) adopted standards for healthcare data exchange.

As shown in the table above, protocols like HL-7 are used for messaging, while vocabularies like LOINC and SNOMED CT standardize laboratory and clinical findings. This foundation allows for the automated aggregation of data across different jurisdictions.

Syndrome Classification

Once data is ingested, it must be categorized into syndromes (e.g., "Respiratory Syndrome"). Modern systems move beyond manual grouping to automated methods:

  • Natural Language Processing (NLP): Using simplified grammars to parse free-text "Chief Complaints" (CC) from ER records.
  • Bayesian Classifiers: Utilizing probabilistic models to categorize CCs based on historical training data.
  • Vocabulary Abstraction: Mapping specific clinical signs to higher-level syndrome groups.

Outbreak Detection Algorithms

Detection algorithms are categorized into three primary types:

  1. Temporal: (e.g., CUSUM, ARIMA) Identifying spikes in a time series.
  2. Spatial: (e.g., Scan Statistics) Identifying geographic "hotspots."
  3. Spatio-Temporal: (e.g., WSARE - "What's Strange About Recent Events") Identifying patterns that are anomalous in both time and space simultaneously.

Case Studies: RODS and BioPortal

The practical application of these technologies is demonstrated in two major systems:

  • RODS (Realtime Outbreak and Disease Surveillance): This system utilizes real-time HL7 messages from over 200 healthcare facilities and the National Retail Data Monitor (NRDM), which tracks daily sales of over-the-counter (OTC) medications.
  • BioPortal: This platform aggregates distributed datasets concerning West Nile Virus, Botulism, and Foot-and-Mouth Disease, integrating human clinical data with animal/veterinary records and genetic sequence data.

Key Insights and Results

The core advantage of syndromic surveillance is the "pre-diagnostic" window: capturing the "noise" of people buying medication or calling in sick before they are officially diagnosed. Data fusion—combining OTC sales, school absenteeism, and ER visits—significantly increases detection sensitivity while reducing false alarms.

In terms of performance, the Bayesian classification modules in the RODS system have achieved up to 77% sensitivity and 90% specificity for respiratory syndromes. Automated classifiers generally show an Area Under the ROC Curve (AUC) between 0.95 and 0.99, indicating they are highly effective at mimicking expert human coders. The RODS system was successfully deployed during the 2002 Winter Olympics, proving the viability of these frameworks during high-pressure international events.

Limitations and Future Directions

Despite its promise, IDI faces several hurdles. There is currently no universal definition for many "syndromes," leading to inconsistencies between systems. Furthermore, evaluating these systems is difficult because real-world bioterrorism events are rare; researchers must often rely on simulated outbreaks injected into real background data.

Future work must focus on global scaling, overcoming language and IT infrastructure barriers, and better integrating zoonotic (animal) health data, as many emerging infectious diseases jump from animals to humans.

Summary updated

BibTeX
@inproceedings{zeng2008infectious,
  author = {Daniel Zeng and Hsinchun Chen and Ping Yan and Daniel Dajun Zeng and Hsinchun Chen and Ping Yan},
  title = {{Infectious Disease Informatics and Syndromic Surveillance}},
  booktitle = {Digital Government},
  year = {2008},
  doi = {10.1007/978-0-387-71611-4\_26},
}
Figure