Improving Diseases Predictions Utilizing External Bio-Banks

Hido Pinto, Eran SegalarXiv 2025 · DOI · arXiv

Introduction

The integration of high-dimensional biological data into large-scale epidemiological studies is often hindered by the prohibitive costs of comprehensive molecular profiling. While biobanks like the UK Biobank (UKBB) offer vast longitudinal health data for hundreds of thousands of participants, they frequently lack detailed molecular layers, such as metabolomics. This study explores a methodology to bridge this gap by leveraging smaller, data-rich cohorts to impute missing biological features in larger, "leaner" datasets, thereby unlocking new avenues for disease prediction and biological discovery.

Methodology

The researchers implemented a robust two-step pipeline designed to transfer biological insights across cohorts.

Overview of the two-step imputation and analysis pipeline.
  1. Imputation Phase: A LightGBM gradient boosting framework was employed to train predictive models on the "10K" dataset. These models utilized shared features—variables present in both the source and target datasets, such as age, BMI, and standard clinical blood panels—to predict complex metabolomics features.
  2. Downstream Analysis: The trained models were applied to the UKBB participants to generate imputed metabolic profiles. These profiles were then integrated into Cox Proportional Hazards (CoxPH) models to conduct survival analysis and assess improvements in disease risk prediction.
  3. Validation: To verify the biological accuracy of the imputed data, the team performed a Genome-Wide Association Study (GWAS). By comparing the genetic architecture of predicted metabolites against known genetic associations, they could confirm whether the models were capturing genuine biological signals rather than statistical noise.

Datasets

The study utilized two primary data sources:

  • 10K Bio-Bank: A high-resolution dataset from the Weizmann Institute of Science, comprising detailed medical and metabolomic data for 10,000 Israeli participants.
  • UK Biobank (UKBB): A comprehensive resource containing health and genetic data for 500,000 UK participants, which served as the target for feature imputation.

Results and Validation

The imputation process successfully generated a wide array of statistically significant predicted features. The validation phase was critical in establishing the utility of these imputed variables.

Validation R2 histograms for imputed features across different metrics and genders.

As shown in the validation histograms, the models achieved varying degrees of predictive accuracy (R2) across different metabolites. While the quantitative gains in disease prediction (measured by the C-index) were modest, the imputed features provided significant qualitative value. For instance, the GWAS on imputed features successfully identified the well-documented association between smoking and vascular dementia—a relationship not explicitly provided during model training. Furthermore, reintegrating survival models into the 10K data identified specific metabolic substances, such as 'X-12063', that are strongly linked to obesity, providing deeper biological context to clinical observations.

Discussion

The primary value of this approach lies in discovery and explainability rather than purely incremental gains in predictive accuracy. By imputing metabolic layers, researchers can move beyond "black-box" risk scores to understand the underlying metabolic pathways associated with disease progression.

The study demonstrates the feasibility of cross-cohort model transfer, suggesting that models trained on one population (e.g., Israeli) can be effectively applied to another (e.g., British) if they share common data modalities. However, limitations remain, including the necessity of population similarity and the indirect nature of validation when ground truth is absent in the target biobank. Future research may benefit from Deep Generative Models, such as Variational Autoencoders, to better capture the complex, non-linear relationships inherent in biological systems.

Conclusion

This research provides a scalable framework for enhancing the utility of large-scale biobanks. By using machine learning to "fill in the blanks" of missing biological data, we can maximize the scientific output of existing resources, leading to a more nuanced understanding of disease etiology and risk.

Summary updated

BibTeX
@misc{pinto2025improving,
  author = {Hido Pinto and Eran Segal},
  title = {{Improving Diseases Predictions Utilizing External Bio-Banks}},
  year = {2025},
  eprint = {2504.00036},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2504.00036},
}
Figure