Leveraging auxiliary measures: a deep multi-task neural network for predictive modeling in clinical research

Xiangrui Li, Dongxiao Zhu, Phillip Levy

Introduction

Predictive modeling in clinical research is essential for early intervention and personalized medicine. However, researchers often face a significant hurdle: the "small data" problem. While Deep Neural Networks (DNNs) excel at capturing the complex, non-linear biological mechanisms of disease, they typically require large datasets to avoid overfitting. In many clinical studies, sample sizes are limited to a few hundred patients, making high-capacity models difficult to deploy effectively.

The GATAN Framework

To address this limitation, researchers developed the Generalized Auxiliary-Task Augmented Network (GATAN). This framework utilizes Multi-Task Learning (MTL) to improve predictive accuracy on small clinical datasets. The core insight is that clinical data often contains "auxiliary measures"—secondary variables that are biologically or clinically related to the primary outcome of interest.

Figure 1: Motivating Example for GATAN. The model predicts a primary target (LVMI) alongside related auxiliary clinical measures to improve robustness.

By training the model to predict these auxiliary targets simultaneously with the primary target, GATAN benefits from a form of implicit data augmentation and regularization. This process forces the network to learn a more robust internal representation of the patient's overall health state, rather than simply memorizing noise in the primary target's distribution.

Methodology

The GATAN architecture is built upon three innovative pillars:

  1. Shared and Task-Specific Representations: The network architecture splits into paths that learn "shared" features (common across all tasks) and "task-specific" features (unique to the primary or auxiliary goals).
  2. Cosine-Distance Weighting: Rather than assuming all tasks are equally relevant, GATAN uses a weighting mechanism based on the cosine distance between task-specific and shared features. This allows the model to dynamically adjust the influence of auxiliary tasks based on their learned clinical relevance for each specific sample.
  3. Heuristic Feature Ranking: To overcome the "black box" nature of deep learning, the authors implemented a weight back-propagation method. This allows clinicians to see which input features (e.g., blood pressure, age, or lab results) most heavily influenced the model's predictions, ensuring the model's logic aligns with medical knowledge.

Experimental Results

The model was rigorously tested on two distinct clinical datasets:

  • Hypertension Dataset (n=155): Predicting Left Ventricular Mass Index (LVMI). GATAN achieved a Mean Squared Error (MSE) of 199.76, significantly outperforming traditional Lasso regression (205.67) and standard Multi-Layer Perceptrons (209.43).
  • Wisconsin Prognostic Breast Cancer Dataset (n=194): Predicting time to recurrence. GATAN reached an MSE of 860.63, compared to 941.88 for a standard 4-layer MLP.

Across both datasets, GATAN showed lower Median Absolute Error (MAE), indicating better robustness against outliers compared to standard linear and non-linear baselines.

Conclusion

GATAN demonstrates that auxiliary clinical measures are a valuable, often untapped resource for improving deep learning models in data-constrained environments. By learning the relationship between primary and secondary targets, the model provides more accurate and interpretable predictions. While challenges remain in predicting extreme clinical cases (the "tails" of the distribution), this multi-task approach offers a promising path forward for applying advanced AI to small-scale clinical research.

Reference: Li, X., Zhu, D. & Levy, P. Leveraging auxiliary measures: a deep multi-task neural network for predictive modeling in clinical research. BMC Med Inform Decis Mak 18 (Suppl 4), 126 (2018).

Summary updated

Abstract

Background Accurate predictive modeling in clinical research enables effective early intervention that patients are most likely to benefit from. However, due to the complex biological nature of disease progression, capturing the highly non-linear information from low-level input features is quite challenging. This requires predictive models with high-capacity. In practice, clinical datasets are often of limited size, bringing danger of overfitting for high-capacity models. To address these two challenges, we propose a deep multi-task neural network for predictive modeling. Methods The proposed network leverages clinical measures as auxiliary targets that are related to the primary target. The predictions for the primary and auxiliary targets are made simultaneously by the neural network. Network structure is specifically designed to capture the clinical relevance by learning a shared feature representation between the primary and auxiliary targets. We apply the proposed model in a hypertension dataset and a breast cancer dataset, where the primary tasks are to predict the left ventricular mass indexed to body surface area and the time of recurrence of breast cancer. Moreover, we analyze the weights of the proposed neural network to rank input features for model interpretability. Results The experimental results indicate that the proposed model outperforms other different models, achieving the best predictive accuracy (mean squared error 199.76 for hypertension data, 860.62 for Wisconsin prognostic breast cancer data) with the ability to rank features according to their contributions to the targets. The ranking is supported by previous related research. Conclusion We propose a novel effective method for clinical predictive modeling by combing the deep neural network and multi-task learning. By leveraging auxiliary measures clinically related to the primary target, our method improves the predictive accuracy. Based on featue ranking, our model is interpreted and shows consistency with previous studies on cardiovascular diseases and cancers.
BibTeX
@article{li2018leveraging,
  author = {Xiangrui Li and Dongxiao Zhu and Phillip Levy},
  title = {{Leveraging auxiliary measures: a deep multi-task neural network for predictive modeling in clinical research}},
  journal = {Bmc Medical Informatics Decis. mak},
  year = {2018},
  doi = {10.1186/s12911-018-0676-9},
}
Figure