Idiopathic Pulmonary Fibrosis Mortality Risk Prediction Based on Artificial Intelligence: The CTPF Model

Xuening Wu, Chengsheng Yin, Xianqiu Chen, Yuan Zhang, Yiliang Su, Jingyun Shi, Dong Weng, Xing Jiang, Aihong Zhang, Wenqiang Zhang, Huiping LiFrontiers in Pharmacology 2022 · DOI

TL;DR

Researchers have developed a novel AI-powered model, CTPF, that accurately predicts mortality risk in patients with Idiopathic Pulmonary Fibrosis (IPF). By combining deep learning-based analysis of CT scans to quantify lung fibrosis with pulmonary function and physiological data, CTPF offers a more precise and accessible prognostic tool than existing methods.

What Problem Does This Paper Address?

Idiopathic Pulmonary Fibrosis (IPF) is a progressive and often fatal lung disease with a highly variable prognosis. Currently, there's a lack of precise and easily applicable methods to predict how quickly a patient's condition will worsen or their likelihood of survival. Existing models, like CRP, GAP, and CPI, have limitations: some are too complex, require numerous parameters, or fail to adequately incorporate crucial imaging data like the extent of lung fibrosis. This gap makes it challenging for clinicians to accurately assess patient risk, plan treatment, and counsel patients about their prognosis.

Methods

The core innovation lies in the integration of two key components:

  1. AI-driven Honeycomb Segmentation: The researchers developed a deep learning model (specifically, a semantic segmentation network) to automatically identify and quantify the extent of honeycomb lung lesions, a hallmark of IPF, in CT scans. This AI system segments the fibrotic tissue area and calculates a "CT fibrosis score" (CTS) representing the percentage of honeycomb in the entire lung. This automates a previously labor-intensive and subjective process.
  2. Comprehensive Risk Prediction Model (CTPF): This AI-derived CT score (CTS) is then combined with pulmonary function and physiological (PF) parameters. These PF parameters include FVC%pred (forced vital capacity), DLco%pred (diffusing capacity of the lung for carbon monoxide), SpO2% (oxygen saturation), age, and gender. These parameters were chosen for their proven prognostic value and clinical accessibility.

A competing risk (Fine-Gray) proportional hazards model was used to build the risk score model, leveraging a training set of 165 IPF patients and validating it on a separate set of 41 patients. The CT stages were defined into three levels (I, II, III) based on CTS, and PF grades were categorized into mild, moderate, and severe (a, b, c).

Datasets

The study utilized data from 232 IPF patients diagnosed between January 2011 and January 2020 at Shanghai Pulmonary Hospital. After excluding cases with incomplete data or revised diagnoses, 206 patients were included.

  • Training Set: 165 patients.
  • Validation Set: 41 patients.
  • AI Model Training: 102 manually labeled CT images were used to train the honeycomb segmentation system.

Key Insights and Ideas

  • AI for Objective Quantification: The study demonstrates the power of deep learning for objective and automated quantification of lung fibrosis, overcoming the subjectivity and variability inherent in manual CT scoring.
  • Synergy of Imaging and Clinical Data: The CTPF model highlights that combining imaging features (fibrosis extent) with readily available clinical and physiological data provides a more robust prediction than either modality alone.
  • Improved Prognostic Accuracy: The CTPF model significantly outperforms existing staging methods (CT, PF, and GAP) in predicting mortality risk, as evidenced by higher AUC values and lower Brier scores.
  • Clinical Utility: The model's reliance on accessible parameters and its automated CT analysis suggest a strong potential for integration into routine clinical practice.

Key Results

The CTPF model demonstrated superior performance in predicting 1, 2, and 3-year mortality risk compared to models based solely on CT staging, PF grading, or the GAP score.

  • 1-Year Prediction: CTPF achieved an AUC of 74.3% (training) and 92.0% (validation), with a Brier score of 8.6% (training) and 8.1% (validation).
  • 2-Year Prediction: CTPF achieved an AUC of 78% (training) and 75.0% (validation), with a Brier score of 16.0% (training) and 14.3% (validation).
  • 3-Year Prediction: CTPF achieved an AUC of 72.8% (training) and 76.0% (validation), with a Brier score of 18.2% (training) and 17.6% (validation).

The model's calibration curves also showed good stability across different prediction times. The study also presented example cases where the CTPF model accurately predicted outcomes for patients with different stages of fibrosis and PF severity.

Limitations and Future Work

The authors acknowledge the primary limitation of this study: the lack of an external validation cohort. They plan to conduct a multicenter clinical study to further evaluate and validate the CTPF model. Additionally, they suggest that further analysis is needed to understand the prognostic implications of pulmonary fibrosis in patients who also have emphysema. The study also notes that the AI model's CT evaluation time is a mere 11 seconds per patient, highlighting its efficiency.

Summary updated

Abstract

<b>Background:</b> Idiopathic pulmonary fibrosis (IPF) needs a precise prediction method for its prognosis. This study took advantage of artificial intelligence (AI) deep learning to develop a new mortality risk prediction model for IPF patients. <b>Methods:</b> We established an artificial intelligence honeycomb segmentation system that segmented the honeycomb tissue area automatically from 102 manually labeled (by radiologists) cases of IPF patients' CT images. The percentage of honeycomb in the lung was calculated as the CT fibrosis score (CTS). The severity of the patients was evaluated by pulmonary function and physiological feature (PF) parameters (including FVC%pred, DLco%pred, SpO2%, age, and gender). Another 206 IPF cases were randomly divided into a training set (<i>n</i> = 165) and a verification set (<i>n</i> = 41) to calculate the fibrosis percentage in each case by the AI system mentioned previously. Then, using a competing risk (Fine-Gray) proportional hazards model, a risk score model was created according to the training set's patient data and used the validation data set to validate this model. <b>Result:</b> The final risk prediction model (CTPF) was established, and it included the CT stages and the PF (pulmonary function and physiological features) grades. The CT stages were defined into three stages: stage I (CTS≤5), stage II (5 < CTS<25), and stage III (≥25). The PF grades were classified into mild (a, 0-3 points), moderate (b, 4-6 points), and severe (c, 7-10 points). The AUC index and Briers scores at 1, 2, and 3 years in the training set were as follows: 74.3 [63.2,85.4], 8.6 [2.4,14.8]; 78 [70.2,85.9], 16.0 [10.1,22.0]; and 72.8 [58.3,87.3], 18.2 [11.9,24.6]. The results of the validation sets were similar and suggested that high-risk patients had significantly higher mortality rates. <b>Conclusion:</b> This CTPF model with AI technology can predict mortality risk in IPF precisely.
BibTeX
@inproceedings{wu2022idiopathic,
  author = {Xuening Wu and Chengsheng Yin and Xianqiu Chen and Yuan Zhang and Yiliang Su and Jingyun Shi and Dong Weng and Xing Jiang and Aihong Zhang and Wenqiang Zhang and Huiping Li},
  title = {{Idiopathic Pulmonary Fibrosis Mortality Risk Prediction Based on Artificial Intelligence: The CTPF Model}},
  booktitle = {Frontiers in Pharmacology},
  year = {2022},
  doi = {10.3389/fphar.2022.878764},
}
Figure