Neural interval-censored survival regression with feature selection

Carlos García Meixide, Marcos Matabuena, Michael R. Kosorok, Kosorok, Michael R.Statistical 2022

This paper, recently published in the arXiv [stat.ML] category, introduces a novel framework for survival analysis when data is "interval-censored"—a common but challenging scenario in medical research.

TL;DR

The authors present the first deep learning-based framework for interval-censored survival regression that includes built-in feature selection. By combining sparse neural network architectures with stability selection, the model significantly outperforms traditional linear methods in predicting time-to-event outcomes, especially when relationships between variables are non-linear.

What Problem Does This Paper Address?

In survival analysis, we often want to know when a specific event (like the onset of a disease) will occur. Usually, researchers deal with "right-censored" data, where we only know an event hasn't happened yet. However, in clinical trials with periodic check-ups, we often encounter interval-censoring: we only know the event happened sometime between two appointments (e.g., between month 6 and month 12).

While deep learning has been applied to right-censored data, it is almost non-existent for interval-censored data, particularly in high-dimensional settings (where there are many more features than observations). Existing tools are mostly linear or semi-parametric, failing to capture the complex, non-linear interactions common in biological data. This paper fills that gap.

Methods

The authors propose a two-stage predictive framework rooted in Accelerated Failure Time (AFT) models.

  1. Sparse Neural Network Architecture: Inspired by LassoNet, the model uses a dual-component structure. It features a linear "skip-layer" and a deep non-linear component. A hierarchical constraint ensures that a feature can only enter the complex non-linear part of the model if its linear contribution is also significant. This encourages sparsity and helps identify the most relevant predictors.
  2. Stability Selection: Neural networks are notoriously sensitive to how their weights are initialized. To ensure the feature selection is robust and not just a fluke of random chance, the authors use "stability selection." They repeatedly subsample the data and track which features are consistently chosen, providing a mathematical guarantee on the expected number of false positives.
  3. Optimization: The model is trained using first-order optimization (backpropagation), making it more computationally efficient for deep architectures than the complex second-order methods traditionally used for interval-censored likelihoods.

Datasets

The framework was evaluated on both synthetic and real-world datasets:

  • Simulated Data: Two scenarios (one highly non-linear, one quasi-linear) with 100 predictor variables to test feature selection accuracy and predictive power.
  • T1D Exchange Registry: Data from 5,971 patients with Type 1 Diabetes. The goal was to predict the time until a patient develops albuminuria (a marker of kidney damage).
  • NHANES Physical Activity Data: A subset of 2,977 patients (ages 50–80) using accelerometer data to predict survival based on physical activity patterns.

Key Insights and Ideas

  • The "Residual" Philosophy: By structuring the network so the deep learning component accounts for what the linear part cannot explain, the authors maintain a level of interpretability while allowing the model to capture "hidden" non-linearities.
  • Overcoming Local Minima: Traditional cross-validation is often unreliable for feature selection in deep learning because different "folds" might settle into different local minima. Stability selection provides a "model-free" alternative that is much more stable in high-dimensional contexts.
  • Clinical Relevance: In the diabetes case study, the model revealed that the relationship between A1c levels, insulin dosage, and kidney risk is highly non-linear. A simple linear shift doesn't capture how these factors interact, proving why deep learning is necessary for personalized medicine.

Key Results

  • Predictive Accuracy: In non-linear simulations, the proposed model showed a 40% improvement in predictive power over traditional AFT algorithms.
  • Diabetes Application: The model achieved a Concordance Index (C-index) of 0.65, significantly higher than the 0.54 achieved by the standard linear log-normal AFT model.
  • NHANES Application: The model reached a C-index of 0.79, outperforming the competitor's 0.75.
  • Robust Feature Selection: In high-dimensional simulations ($n=2000$), the algorithm correctly identified all true predictors with zero false positives.

Limitations and Future Work

  • Parametric Assumptions: The current model assumes a specific parametric distribution for the "noise" (e.g., log-normal). The authors suggest that moving toward a non-parametric noise distribution could make the model even more flexible.
  • Uncertainty Quantification: While the model predicts a "risk score," the authors note a growing need to provide formal measures of uncertainty (confidence intervals) for individual predictions, potentially using conformal inference.
  • Functional Data: Future iterations could incorporate "functional" predictors—like raw medical images or continuous heart rate streams—directly into the survival regression, rather than relying on pre-calculated summaries.

Software Availability: The authors have made their implementation, spinet, available on GitHub: https://github.com/meixide/spinet

Summary updated

Abstract

Survival analysis is a fundamental area of focus in biomedical research, particularly in the context of personalized medicine. This prominence is due to the increasing prevalence of large and high-dimensional datasets, such as omics and medical image data. However, the literature on non-linear regression algorithms and variable selection techniques for interval-censoring is either limited or non-existent, particularly in the context of neural networks. Our objective is to introduce a novel predictive framework tailored for interval-censored regression tasks, rooted in Accelerated Failure Time (AFT) models. Our strategy comprises two key components: i) a variable selection phase leveraging recent advances on sparse neural network architectures, ii) a regression model targeting prediction of the interval-censored response. To assess the performance of our novel algorithm, we conducted a comprehensive evaluation through both numerical experiments and real-world applications that encompass scenarios related to diabetes and physical activity. Our results outperform traditional AFT algorithms, particularly in scenarios featuring non-linear relationships.
BibTeX
@inproceedings{meixide2022neural,
  author = {Carlos García Meixide and Marcos Matabuena and Michael R. Kosorok and Kosorok, Michael R.},
  title = {{Neural interval-censored survival regression with feature selection}},
  booktitle = {Statistical},
  year = {2022},
}
Figure