Deep Survival Analysis for Healthcare: An Empirical Study on Post-Processing Techniques

Alberto Archetti, Francesco Stranieri, Matteo MatteucciHC@AIxIA 2023 · OpenReview

Introduction

Survival analysis is a critical statistical tool in healthcare, used to estimate the time until a specific event—such as disease relapse or patient mortality—occurs. While traditional methods like the Cox Proportional Hazards model are widely used, they often struggle to model the complex, non-linear dependencies found in modern medical datasets. To address this, deep learning models such as DeepHit and Logistic Hazard have been developed.

However, many of these neural survival models are "discrete-time" models. They simplify the prediction task by dividing the continuous time horizon into a fixed number of "bins" or anchor points. This discretization leads to "staircase" survival functions that lack the precision required for real-world clinical applications. This study investigates whether post-processing interpolation techniques can bridge the gap between discrete predictions and continuous reality.

Methodology

The core of this research involves evaluating how different interpolation strategies transform discrete anchor points into continuous survival curves. The authors compared five distinct methods:

  1. Step Forward (FWD): A standard staircase approach where the survival probability remains constant until the start of the next bin.
  2. Step Backward (BWD): A method that propagates the subsequent bin's value backward.
  3. Linear: A first-order interpolation that connects anchor points with straight lines.
  4. Piece-wise Exponential (PWE): This method assumes a constant hazard rate within each interval, resulting in a more natural exponential decay curve.
  5. Monotonic Cubic Spline: A higher-order smoothing technique that uses non-increasing mathematical functions to ensure a smooth transition between points.
Comparison of interpolation strategies for transforming discrete anchor points into continuous survival functions.

These techniques were applied to four state-of-the-art neural survival models: DeepSurv, DeepHit, Logistic Hazard, and N-MTLR.

Experimental Setup

The study utilized four diverse healthcare datasets to ensure robust results:

  • WHAS500: 461 myocardial infarction patients.
  • GBSG2: 686 breast cancer patients.
  • METABRIC: 1,904 breast cancer patients, incorporating clinical and genomic features.
  • TCGA-BRCA: 1,048 breast cancer cases from The Cancer Genome Atlas.

Performance was measured using the Integrated Brier Score (IBS) and Cumulative AUC for predictive accuracy over time, and the C-Index for risk ranking.

Key Results and Insights

The empirical results highlight several critical findings regarding the utility of interpolation in survival modeling:

The "Few-Bin" Advantage

The most significant performance gains were observed when the number of discretization bins was small (e.g., 5 or 10). In these scenarios, interpolation acts as a form of regularization, helping the model generalize better to the continuous timeline of clinical events. As the number of bins increases to match the number of unique time points in the dataset, the differences between interpolation methods diminish.

Metric Sensitivity

Interpolation significantly improved time-dependent metrics. For instance, on the METABRIC dataset with 10 anchor points, Linear and PWE interpolation reduced the IBS from 22.1 (Step BWD) to 21.6. Similarly, Cumulative AUC increased from 67.5 to 69.8. Notably, the C-Index remained largely unaffected, as interpolation changes the probability values but rarely alters the relative ranking of patient risks.

Model Specificity and Robustness

Across all datasets and models, Step Backward (BWD) was consistently the poorest performer. Conversely, Linear and Piece-wise Exponential (PWE) interpolation emerged as the most robust and accurate strategies. It is important to note that models based on the proportional hazards assumption, such as DeepSurv, did not show significant benefits from these techniques, as their output structure differs fundamentally from discrete-time models.

Conclusion

Post-processing interpolation is a simple yet effective way to enhance the accuracy of discrete-time neural survival models. By smoothing the "staircase" predictions, researchers can achieve better performance on key clinical metrics like IBS and Cumulative AUC without additional training costs. Future work may involve integrating these smoothing constraints directly into the loss functions of neural networks to further optimize continuous-time predictions.

Summary updated

BibTeX
@inproceedings{archetti2023deep,
  author = {Alberto Archetti and Francesco Stranieri and Matteo Matteucci},
  title = {{Deep Survival Analysis for Healthcare: An Empirical Study on Post-Processing Techniques}},
  booktitle = {HC@AIxIA},
  year = {2023},
  url = {https://openreview.net/forum?id=kGunyvla9D},
}
Figure