Preterm birth prediction : deriving stable and interpretable rules from high dimensional data

Truyen Tran, Wei Luo, Quoc-Dinh Phung, Jonathan Morris, Kristen Rickard, Svetha VenkateshDeakin 2016 · DOI · arXiv

Abstract

Preterm births occur at an alarming rate of 10-15%, leading to higher risks of infant mortality, developmental retardation, and long-term disabilities. Predicting preterm birth is notoriously difficult, even for the most experienced clinicians; traditional clinical studies often reach a modest sensitivity of only 18.2-24.2%. This research takes a different approach by exploiting large-scale databases of normal hospital operations. The study aims to derive an easy-to-use, interpretable prediction rule with quantified uncertainties and to construct accurate classifiers. By automatically generating and selecting from thousands of possible predictors using stability-aware techniques, a simplified 10-item prediction rule was developed. Derived from a database of 15,814 women, this rule achieves a sensitivity of 62.3% at 81.5% specificity, significantly outperforming existing clinical benchmarks.

Introduction: The Challenge of Preterm Prediction

Preterm birth (defined as birth before 37 weeks) is a leading cause of neonatal mortality and long-term disability. Despite its clinical importance, prediction remains a significant hurdle. Medical data is often highly redundant, and standard machine learning models like Lasso can be "unstable," selecting different features each time they are trained on new data. This lack of stability erodes clinical trust. Furthermore, for a model to be useful in a high-stakes clinical environment, it must be interpretable—not a "black box," but a rule that a doctor can verify and act upon quickly.

Methodology: Stability-Aware Machine Learning

The authors proposed a pipeline that balances high-performance ensemble learning with "distilled" interpretable rules. The core innovation is Stabilized Sparse Logistic Regression (SSLR). Unlike standard models that might arbitrarily discard one of two highly correlated features, SSLR uses a feature-similarity regularizer to ensure that similar features receive similar weights. This leads to a more robust set of risk factors.

To further ensure reliability, the team employed Bootstrap Model Averaging to estimate the most consistent risk factors across different data samples. Finally, through Rule Distillation, the complex model weights were scaled and rounded into simple integers, creating a point-based checklist (e.g., "Multiple fetuses = +10 points") that can be easily calculated at the bedside.

Data and Preprocessing: Managing Covariate Shift

The study utilized a large observational database from Royal North Shore (RNS) Hospital in NSW, Australia, encompassing 18,836 pregnancy episodes. The researchers extracted 762 structured features and 2,770 features from clinical text notes.

A critical preprocessing step involved detecting "covariate shift"—changes in how data is recorded over time due to evolving hospital protocols. Using t-SNE visualization, the researchers identified a major shift in data distribution around 2010.

t-SNE visualization revealing covariate shift in hospital data over time.

By identifying this shift, the team was able to refine their dataset to the more consistent 2011–2015 period, ensuring the model's predictions were based on current clinical practices.

Results: Performance of the 10-Item Rule

The machine learning models significantly outperformed historical clinical benchmarks. The full SSLR model achieved an Area Under the Curve (AUC) of 0.85 for 34-week prediction. Even after distilling the model into a simplified 10-item integer-weighted rule, the performance remained high with an AUC of 0.84.

Mapping of the simplified 10-item score to predicted risk probability.

This simplified rule achieved 62.3% sensitivity at 81.5% specificity. The most influential factors identified were multiple fetuses, cervix incompetence, and prior preterm births, followed by lifestyle factors like domestic violence and illegal drug use. Interestingly, "care allocation" (e.g., booking with a private obstetrician) also served as a strong predictor, capturing the existing clinical intuition of hospital staff.

Conclusion and Future Work

This research demonstrates that high-dimensional hospital data, including unstructured clinical text, can be transformed into stable and highly accurate prediction tools. By prioritizing model stability, the researchers created a tool that clinicians can trust and use easily. Future work will focus on integrating broader Electronic Health Records (EHR) and improving the handling of sparse data in healthy populations to further refine these life-saving predictive rules.

Summary updated

Abstract

\n\t\t\t\t\tPreterm births occur at an alarming rate of 10-15%. Preemies have a higher risk of infant mortality, developmental retardation and long-term disabilities. Predicting preterm birth is difficult, even for the most experienced clinicians. The most well-designed clinical study thus far reaches a modest sensitivity of 18.2-24.2% at specificity of 28.6-33.3%. We take a different approach by exploiting databases of normal hospital operations. We aims are twofold: (i) to derive an easy-to-use, interpretable prediction rule with quantified uncertainties, and (ii) to construct accurate classifiers for preterm birth prediction. Our approach is to automatically generate and select from hundreds (if not thousands) of possible predictors using stability-aware techniques. Derived from a large database of 15,814 women, our simplified prediction rule with only 10 items has sensitivity of 62.3% at specificity of 81.5%.\n\t\t\t\t
BibTeX
@inproceedings{tran2016preterm,
  author = {Truyen Tran and Wei Luo and Quoc-Dinh Phung and Jonathan Morris and Kristen Rickard and Svetha Venkatesh},
  title = {{Preterm birth prediction : deriving stable and interpretable rules from high dimensional data}},
  booktitle = {Deakin},
  year = {2016},
  doi = {10.48550/arxiv.1607.08310},
}
Figure