Understanding Breast Cancer Survival: Using Causality and Language Models on Multi-omics Data

Mugariya Farooq, Shahad Hardan, Aigerim Zhumbhayeva, Yujia Zheng, Preslav Nakov, Kun ZhangarXiv 2023 · DOI · arXiv

Abstract

Identifying the underlying causes of cancer survival is a critical challenge in precision medicine. While Causal Discovery (CD) algorithms offer a path toward uncovering these mechanisms from observational data, the lack of ground-truth validation often necessitates labor-intensive manual literature reviews. This paper presents a novel framework that automates this process by employing Large Language Models (LLMs) to validate causal claims derived from multi-omics breast cancer data. Our results demonstrate that LLMs can effectively act as automated knowledge proxies, significantly accelerating the discovery of biologically relevant biomarkers.

Introduction

In the clinical domain, distinguishing between a correlation and a causal driver is paramount. While traditional machine learning models excel at predicting patient outcomes, they often fail to provide the "why" behind a prediction. Causal Discovery (CD) aims to address this by constructing Directed Acyclic Graphs (DAGs) that represent cause-and-effect relationships. However, the complexity of biological systems makes validating these graphs difficult. This study proposes an end-to-end pipeline that utilizes the vast knowledge encoded in biomedical LLMs to verify the causal links identified by CD algorithms.

Methodology

The proposed pipeline follows a structured approach to transition from raw genomic data to validated causal insights.

1. Feature Selection and Data Preparation

Using the TCGA Breast Cancer dataset (705 patients), the researchers initially faced nearly 2,000 variables across somatic mutations, copy number variations, gene expression, and protein levels. To manage this high dimensionality, Mutual Information (MI) and Max-Min Markov Blanket (MMMB) techniques were employed to select the 10–20 most influential features relative to patient survival.

2. Causal Discovery

Several algorithms were applied to the filtered data to build the causal graphs:

  • Constraint-based (PC, FCI): Utilizing statistical independence tests.
  • Score-based (FGES): Searching for the most probable graph structure.
  • Generalized Precision Matrix (GPM): A specialized approach for mixed discrete and continuous data.

3. LLM-Based Validation

The core innovation lies in using LLMs (BlueBERT and SciBERT) as automated validators. Two primary metrics were used to determine if the discovered links matched existing medical literature: Perplexity Scores (measuring the model's "surprise" at a claim) and Masked Language Modeling (testing the model's ability to predict missing biological terms within a causal statement).

The multi-stage pipeline integrating TCGA data, causal discovery algorithms, and LLM-based validation.

Results and Discussion

The integration of the Generalized Precision Matrix (GPM) with the PC algorithm yielded the most biologically plausible results. The study identified several key genetic factors, including MLL3 and TNXB, which are known biomarkers for breast cancer progression and metastasis.

Distribution of Copy Number Variations (CNV) in the IDO1 gene for surviving vs. deceased patients.

As illustrated in the figure above, the distribution of copy number variations in genes like IDO1 shows distinct patterns between surviving and deceased patient cohorts, providing empirical support for the features selected by the causal model.

In terms of validation, BlueBERT emerged as the superior validator, achieving an accuracy of 81.25% in the MLM task. Furthermore, perplexity analysis showed that validated causal claims had significantly lower scores (31.01) compared to their negations (2502.9), indicating that the LLM's internal knowledge aligns strongly with the discovered causal structures.

Conclusion

This research demonstrates a scalable method for validating AI-driven medical insights. By treating LLMs as "automated peer reviewers," researchers can bypass the manual validation bottleneck. Future work will focus on addressing the "staleness" of LLM training data and extending the framework to handle cyclic biological relationships, which are common in feedback-driven genetic pathways.

Summary updated

Abstract

The need for more usable and explainable machine learning models in healthcare increases the importance of developing and utilizing causal discovery algorithms, which aim to discover causal relations by analyzing observational data. Explainable approaches aid clinicians and biologists in predicting the prognosis of diseases and suggesting proper treatments. However, very little research has been conducted at the crossroads between causal discovery, genomics, and breast cancer, and we aim to bridge this gap. Moreover, evaluation of causal discovery methods on real data is in general notoriously difficult because ground-truth causal relations are usually unknown, and accordingly, in this paper, we also propose to address the evaluation problem with large language models. In particular, we exploit suitable causal discovery algorithms to investigate how various perturbations in the genome can affect the survival of patients diagnosed with breast cancer. We used three main causal discovery algorithms: PC, Greedy Equivalence Search (GES), and a Generalized Precision Matrix-based one. We experiment with a subset of The Cancer Genome Atlas, which contains information about mutations, copy number variations, protein levels, and gene expressions for 705 breast cancer patients. Our findings reveal important factors related to the vital status of patients using causal discovery algorithms. However, the reliability of these results remains a concern in the medical domain. Accordingly, as another contribution of the work, the results are validated through language models trained on biomedical literature, such as BlueBERT and other large language models trained on medical corpora. Our results profess proper utilization of causal discovery algorithms and language models for revealing reliable causal relations for clinical applications.
BibTeX
@misc{farooq2023understanding,
  author = {Mugariya Farooq and Shahad Hardan and Aigerim Zhumbhayeva and Yujia Zheng and Preslav Nakov and Kun Zhang},
  title = {{Understanding Breast Cancer Survival: Using Causality and Language Models on Multi-omics Data}},
  year = {2023},
  eprint = {2305.18410},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2305.18410},
}
Figure