Generative modeling and latent space arithmetics predict single-cell perturbation response across cell types, studies and species

Mohammad Lotfollahi, Florian Wolf, Fabian J. TheisbioRxiv 2018 · DOI

TL;DR

This paper introduces scGen, a novel generative model that uses variational autoencoders and latent space arithmetic to predict how single cells will respond to perturbations. scGen can accurately forecast these responses across different cell types, studies, and even species, opening doors for in silico drug screening and experimental design.

What Problem Does This Paper Address?

Understanding how cells react to external stimuli (like drugs or infections) is crucial in biology and medicine. While we can measure these responses using single-cell RNA sequencing (scRNA-seq), predicting these responses, especially for scenarios not seen during training ( "out-of-sample" prediction), has been a major challenge. Existing methods often struggle with the complexity and high dimensionality of scRNA-seq data, leading to inaccurate predictions or being limited to specific contexts. The authors aim to bridge this gap by developing a model that can generalize perturbation responses across diverse biological settings.

Methods

The core of scGen is a variational autoencoder (VAE). VAEs are powerful deep learning models that learn a compressed, lower-dimensional representation (latent space) of complex data, like gene expression. scGen's innovation lies in how it uses this latent space:

  • Latent Space Arithmetic: scGen learns a "difference vector" ($\delta$) in the latent space that captures the typical change in gene expression when a cell is perturbed. This vector is then used to extrapolate the response of unperturbed cells to a perturbed state by simply adding $\delta$ in the latent space.
  • Generative Decoder: After predicting the perturbed latent representation, a decoder network translates this back into a high-dimensional gene expression profile, effectively generating the predicted response.
  • Cell-Type and Species Specificity: The model is designed to capture these $\delta$ vectors in a way that can be specific to cell types and even species, allowing for more nuanced predictions.

This approach is contrasted with GANs (Generative Adversarial Networks), which the authors found harder to train for this specific task and less interpretable for generating cells with desired properties.

Datasets

The authors evaluated scGen on several publicly available scRNA-seq datasets:

  • Human Peripheral Blood Mononuclear Cells (PBMCs): Used for predicting responses to IFN-β stimulation. This dataset was split to hold out specific cell types or entire studies for testing.
  • Intestinal Epithelial Cells: Datasets from experiments involving Salmonella and Heligmosomoides polygyrus (H.poly) infections were used to predict responses to pathogens.
  • Mouse, Rat, Rabbit, and Pig Phagocytes: Used to demonstrate cross-species prediction of responses to lipopolysaccharide (LPS).
  • Pancreatic Datasets: Merged datasets were used to evaluate scGen's ability to remove batch effects.

Key Insights and Ideas

  • Latent Space Linearity is Key: The authors found that while gene expression is highly non-linear, the differences in gene expression due to perturbations often behave in a surprisingly linear fashion within the learned latent space. This linearity is what enables the simple vector arithmetic approach.
  • Generalization Beyond Training: The most significant insight is scGen's ability to predict responses for cell types, studies, and species that were not explicitly included in the training data. This "out-of-sample" prediction capability is a major leap forward.
  • Capturing Biological Nuance: scGen doesn't just predict a generic response; it learns to capture cell-type-specific and species-specific responses, implying it learns underlying biological mechanisms.
  • Batch Effect Correction: Beyond perturbation prediction, scGen also demonstrates effectiveness in removing technical batch effects from scRNA-seq data, a common challenge in integrating datasets.

Key Results

  • Accurate Perturbation Prediction: scGen achieved high correlation (R² values up to 0.97) between predicted and real gene expression for perturbed cells across various cell types and conditions.
  • Outperforms Baselines: In benchmarks against methods like CVAE, style-transfer GANs, and PCA-based approaches, scGen consistently showed superior performance in predicting perturbation responses.
  • Cross-Study and Cross-Species Success: The model successfully predicted responses in new studies and across different species, demonstrating robust generalization.
  • Batch Effect Removal: scGen effectively integrated multiple datasets, achieving low average silhouette width (ASW), indicating good batch correction.

Limitations and Future Work

  • Dataset Size Matters: The authors acknowledge that scGen's performance is best when trained on sufficiently large and diverse datasets. Predictions might be less reliable for cell types or conditions that are very rare or highly dissimilar to the training data.
  • Interpretability: While scGen captures biological features, further work is suggested to build deeper biological interpretations of the learned latent space and the $\delta$ vectors.
  • Experimental Design Tool: The authors envision scGen as a powerful tool for in silico screening to guide experimental design, especially in the context of disease and drug treatment, leveraging upcoming large-scale organ atlases.

Summary updated

Abstract

Abstract Accurately modeling cellular response to perturbations is a central goal of computational biology. While such modeling has been proposed based on statistical, mechanistic and machine learning models in specific settings, no generalization of predictions to phenomena absent from training data (‘out-of-sample’) has yet been demonstrated. Here, we present scGen, a model combining variational autoencoders and latent space vector arithmetics for high-dimensional single-cell gene expression data. In benchmarks across a broad range of examples, we show that scGen accurately models dose and infection response of cells across cell types, studies and species. In particular, we demonstrate that scGen learns cell type and species specific response implying that it captures features that distinguish responding from non-responding genes and cells. With the upcoming availability of large-scale atlases of organs in healthy state, we envision scGen to become a tool for experimental design through in silico screening of perturbation response in the context of disease and drug treatment.
BibTeX
@misc{lotfollahi2018generative,
  author = {Mohammad Lotfollahi and Florian Wolf and Fabian J. Theis},
  title = {{Generative modeling and latent space arithmetics predict single-cell perturbation response across cell types, studies and species}},
  year = {2018},
  doi = {10.1101/478503},
  howpublished = {bioRxiv},
}
Figure