Decoding cell identity with multi-scale explainable deep learning

Jun Zhu, Zeyang Zhang, Yujia Xiang, Beini Xie, Xinwen Dong, Linhai Xie, Peijie Zhou, Rongyan Yao, Xiaowen Wang, Yang Li, Fuchu He, Wenwu Zhu, Ziwei Zhang, Cheng ChangbioRxiv 2024 · DOI

TL;DR

This paper introduces Cell Decoder, a novel deep learning model that leverages biological prior knowledge to decode cell identity with unprecedented multi-scale interpretability. It excels at accurately identifying cell types, integrating diverse datasets without batch effects, and even discovering novel cell types and states, offering a powerful new tool for understanding cellular heterogeneity.

What Problem Does This Paper Address?

Single-cell omics technologies have revolutionized biology, generating vast amounts of data that reveal the intricate diversity of cell types. However, accurately identifying and understanding these cell types is challenging. Traditional methods are often time-consuming, labor-intensive, and prone to bias. While deep learning approaches have shown promise, they often act as "black boxes," lacking the transparency needed to understand why a particular cell is classified as it is. This lack of interpretability hinders biological discovery. Furthermore, existing methods struggle to integrate data from different sources (batch effects) and to discover truly novel cell types not present in training data.

Methods

Cell Decoder tackles these challenges by building a graph neural network (GNN) that explicitly incorporates biological prior knowledge. This knowledge includes:

  • Protein-protein interaction (PPI) networks: How proteins within a cell interact.
  • Gene-pathway maps: Which genes are involved in specific biological pathways.
  • Pathway hierarchy: How pathways are organized and related.

This multi-scale biological information is used to construct a hierarchical graph structure. Gene expression data then serves as features for the nodes in this graph. The model uses intra-scale and inter-scale message passing layers to integrate information across different levels of biological organization (genes, pathways, biological processes).

A key innovation is the use of Automated Machine Learning (AutoML) to automatically design the GNN architecture and tune hyperparameters, making the model adaptable to various cell identification scenarios. Crucially, Cell Decoder incorporates post-hoc interpretability modules (like Grad-CAM) to provide multi-view explanations for its predictions, allowing researchers to understand which biological features drive cell identity.

Datasets

The study evaluated Cell Decoder on seven diverse datasets:

  • Human blood (HU_Blood)
  • Human bone marrow (HU_Bone)
  • Human liver (HU_Liver)
  • Human kidney (HU_Kidney)
  • Human pancreas (HU_Pancreas)
  • Mouse lung (MU_Lung)
  • Mouse pancreas (MU_Pancreas)

These datasets were used for benchmarking against existing cell identification methods. Additionally, the paper utilized human immune cell datasets for evaluating data integration capabilities and mouse embryogenesis datasets to demonstrate its application in developmental biology.

Key Insights and Ideas

  • Biological Prior Knowledge is Key: Integrating structured biological knowledge (PPIs, pathways) into a GNN significantly enhances cell identification accuracy and interpretability, going beyond just gene expression.
  • Multi-Scale Representation: Cell Decoder's ability to represent cells at multiple biological scales (genes, pathways, processes) allows for a more comprehensive understanding of cell identity.
  • Explainability is Not Sacrificed for Accuracy: The model achieves state-of-the-art performance while providing transparent insights into its decision-making process.
  • Discovering the Unknown: Cell Decoder can identify novel cell types and states that are not present in the training data, a critical capability for advancing biological discovery.
  • Robustness to Data Imperfections: The model demonstrates remarkable resilience to data noise and shifts between datasets, making it more practical for real-world applications.

Key Results

  • Superior Performance: Cell Decoder consistently ranked first in Macro F1 score and accuracy across all seven tested datasets, outperforming the second-best method by 12.5% in Macro F1.
  • Robustness: The model showed significant improvements in robustness against feature perturbations compared to other methods.
  • Data Integration: Cell Decoder effectively integrated diverse datasets without requiring batch labels, outperforming existing methods by 20.5% on average across multiple metrics.
  • Novel Cell Type Discovery: In a simulated scenario, Cell Decoder achieved a recall of 0.94 for identifying a novel cell type, significantly outperforming other methods (e.g., Cell BLAST recall of 0.20).
  • Cell State Identification: The model successfully identified intermediate cell states, such as HSPC cells transitioning to erythrocytes, and revealed distinct biological process activations associated with these states.
  • Embryonic Development Insights: Cell Decoder successfully integrated mouse embryogenesis data, revealing distinct subtypes of visceral endoderm cells and their dynamic changes across developmental stages.

Limitations and Future Work

  • Selection of Biological Knowledge: The effectiveness of the model can be influenced by the choice of biological knowledge databases, and different tissues/organs may require different knowledge sources.
  • Validation of Novel Findings: While Cell Decoder can identify novel cell types and states, their biological validation requires further domain expertise.
  • Supervised Learning Dependency: The model relies on supervised training with annotated data, meaning its performance is limited by the availability and quality of such data.

The authors suggest that Cell Decoder can be extended to multimodal datasets (e.g., integrating protein expression data) and could be used to predict cell responses to genetic perturbations, opening up new avenues for interpretability and biological insights.

Summary updated

Abstract

Abstract Cells are the fundamental structural and functional units of life. Studying the definition and composition of different cell types can help us understand the complex mechanisms underlying biological diversity and functionality. The increasing volume of extensive single-cell omics data makes it possible to provide detailed characterisations of cell types. Recently, there has been a rise in deep learning-based approaches that generate cell type labels solely through mapping query data to reference data. However, these approaches lack multi-scale descriptions and interpretations of identified cell types. Here, we propose Cell Decoder, a biological prior knowledge informed model to achieve multi-scale representation of cells. We implemented automated machine learning and post-hoc analysis techniques to decode cell identity. We have shown that Cell Decoder compares favourably to existing methods, offering multi-view interpretability for decoding cell identity and data integration. Furthermore, we have showcased its applicability in uncovering novel cell types and states in both human bone and mouse embryonic contexts, thereby revealing the multi-scale heterogeneity inherent in cell identities.
BibTeX
@misc{zhu2024decoding,
  author = {Jun Zhu and Zeyang Zhang and Yujia Xiang and Beini Xie and Xinwen Dong and Linhai Xie and Peijie Zhou and Rongyan Yao and Xiaowen Wang and Yang Li and Fuchu He and Wenwu Zhu and Ziwei Zhang and Cheng Chang and Ziwei Zhang and Cheng Chang},
  title = {{Decoding cell identity with multi-scale explainable deep learning}},
  year = {2024},
  doi = {10.1101/2024.02.05.578922},
  howpublished = {bioRxiv},
}
Figure