Causal feature selection using a knowledge graph combining structured knowledge from the biomedical literature and ontologies: a use case studying depression as a risk factor for Alzheimer's disease

Scott A. Malec, Sanya B. Taneja, Steven M. Albert, C. Elizabeth Shaaban, Helmet T. Karim, Art S Levine, Paul Munro, Tiffany J. Callahan, Richard D. BoycebioRxiv 2022 · DOI

TL;DR

This paper introduces a novel method for causal feature selection using a knowledge graph (KG) that integrates biomedical literature and ontologies. By automatically extracting and structuring knowledge, the approach aims to identify potential confounders, colliders, and mediators for complex relationships like depression and Alzheimer's disease, augmenting human expertise and improving the rigor of observational studies.

What Problem Does This Paper Address?

Estimating causal effects from observational data is crucial but challenging due to uncontrolled confounding, which can distort findings. Traditionally, identifying confounders relies on expert knowledge and literature reviews, a process that is becoming increasingly infeasible as the volume of biomedical literature explodes. Furthermore, variables can play multiple causal roles (e.g., being both a confounder and a mediator), adding complexity. This paper addresses the need for a scalable, automated method to identify relevant causal variables by leveraging structured knowledge from both the vast biomedical literature and formal ontologies.

Methods

The authors developed a pipeline that combines machine reading systems with a knowledge graph (KG) and ontologies.

  1. Literature Scoping: They defined a search scope for relevant biomedical literature.
  2. Machine Reading: Three machine reading systems (SemRep, EIDOS, REACH) extracted structured knowledge (triples) from titles and abstracts.
  3. Knowledge Post-processing: This involved terminology mapping (e.g., UMLS to OBO), inferring missing links through logical closure (transitivity, symmetry), and filtering redundant or irrelevant information.
  4. KG Construction: The processed triples were integrated with biomedical ontologies using the PheKnowLator platform to create an ontology-grounded KG.
  5. KG Search: SPARQL queries, based on epidemiological definitions of confounders, colliders, and mediators, were used to search the KG. Dijkstra's shortest path algorithm was employed to find relationships.
  6. Causal Feature Selection: The KG search results were analyzed to identify variables and their potential causal roles.

Datasets

  • PubMed: Used for scoping the literature.
  • SemMedDB: A database of semantic predications extracted from PubMed, used for comparison.
  • Ontologies: Various biomedical ontologies (e.g., BFO, GO, OBO, DO, HP, RO) were merged to construct the KG.

Key Insights and Ideas

  • KG as a Bridge: Knowledge graphs are powerful tools for bridging the gap between unstructured literature and structured, computable knowledge, enabling automated reasoning for causal inference.
  • Ontology Grounding is Key: Integrating ontologies provides a semantic backbone, helping to prune erroneous information from machine reading and ensure biological plausibility.
  • Variables Play Multiple Roles: The study highlights that variables rarely fit neatly into a single causal role; many act as "chimeras" (playing multiple roles), which is critical for accurate causal modeling.
  • Automated Discovery of Novel Confounders: The KG approach can uncover potential confounders that may not be explicitly reported in existing observational studies, offering new avenues for research and intervention.

Key Results

  • The KG search identified 126 unique potential confounders for the depression-AD association, including phenotypes, drugs, and genes.
  • Out of 58 identified confounder phenotypes, only 31 exclusively acted as confounders, while 27 played other roles.
  • Obstructive sleep apnea emerged as a potential novel confounder for depression and AD.
  • Anemia was identified as a variable playing combined roles (mediator/collider in KG, confounder in SemMedDB).
  • The KG search identified 28 unique potential colliders and 18 unique potential mediators.
  • The method produced interpretable mechanistic explanations in the form of reasoning paths.

Limitations and Future Work

  • Incomplete Knowledge: Biomedical ontologies and literature are inherently incomplete, leading to potential information loss and erroneous inferences.
  • Mapping Challenges: Imperfect terminology mapping between different knowledge sources (e.g., UMLS to OBO) resulted in concept loss and reduced granularity.
  • Search Depth Constraints: The constrained search depth for efficiency might have limited recall for certain variable categories.
  • KG vs. SemMedDB Discrepancies: The KG and SemMedDB search results did not always agree, highlighting the need for expert review to adjudicate conflicting assertions.
  • Future Work:
    • Develop tools for automated visualization of KG search outputs (causal graphs and reasoning paths).
  • Improve mappings and expand ontology coverage.
  • Gather meta-data for causal assertions to assess transportability.
  • Explore causal feature selection for scenarios with multiple concurrent exposures.
  • Address "M"-bias and other complex confounding scenarios.

Summary updated

Abstract

Background: Causal feature selection is essential for estimating effects from observational data. Identifying confounders is a crucial step in this process. Traditionally, researchers employ content-matter expertise and literature review to identify confounders. Uncontrolled confounding from unidentified confounders threatens validity, conditioning on intermediate variables (mediators) weakens estimates, and conditioning on common effects (colliders) induces bias. Additionally, without special treatment, erroneous conditioning on variables combining roles introduces bias. However, the vast literature is growing exponentially, making it infeasible to assimilate this knowledge. To address these challenges, we introduce a novel knowledge graph (KG) application enabling causal feature selection by combining computable literature-derived knowledge with biomedical ontologies. We present a use case of our approach specifying a causal model for estimating the total causal effect of depression on the risk of developing Alzheimer's disease (AD) from observational data. Methods: We extracted computable knowledge from a literature corpus using three machine reading systems and inferred missing knowledge using logical closure operations. Using a KG framework, we mapped the output to target terminologies and combined it with ontology-grounded resources. We translated epidemiological definitions of confounder, collider, and mediator into queries for searching the KG and summarized the roles played by the identified variables. Finally, we compared the results with output from a complementary method and published observational studies and examined a selection of confounding and combined role variables in-depth. Results: Our search identified 128 confounders, including 58 phenotypes, 47 drugs, 35 genes, 23 collider, and 16 mediator phenotypes. However, only 31 of the 58 confounder phenotypes were found to behave exclusively as confounders, while the remaining 27 phenotypes played other roles. Obstructive sleep apnea emerged as a potential novel confounder for depression and AD. Anemia exemplified a variable playing combined roles. Conclusion: Our findings suggest combining machine reading and KG could augment human expertise for causal feature selection. However, the complexity of causal feature selection for depression with AD highlights the need for standardized field-specific databases of causal variables. Further work is needed to optimize KG search and transform the output for human consumption.
BibTeX
@misc{malec2022causal,
  author = {Scott A. Malec and Sanya B. Taneja and Steven M. Albert and C. Elizabeth Shaaban and Helmet T. Karim and Art S Levine and Paul Munro and Tiffany J. Callahan and Richard D. Boyce},
  title = {{Causal feature selection using a knowledge graph combining structured knowledge from the biomedical literature and ontologies: a use case studying depression as a risk factor for Alzheimer's disease}},
  year = {2022},
  doi = {10.1101/2022.07.18.500549},
  howpublished = {bioRxiv},
}
Figure