Generating hard-to-obtain information from easy-to-obtain information: Applications in drug discovery and clinical inference

Matthew Amodio, Dennis L. Shung, Daniel B. Burkhardt, Patrick Wong, Michael Simonov, Yu Yamamoto, David van Dijk, Francis Perry Wilson, Akiko Iwasaki, Smita Krishnaswamy

TL;DR

FMGAN (Feature Mapping GAN) is a conditional generative framework designed to predict expensive, "hard-to-obtain" biological data (like transcriptomes or flow cytometry) from cheap, "easy-to-obtain" information (like drug structures or basic clinical vitals). By leveraging the stochastic nature of GANs, the model doesn't just provide a single guess; it generates a realistic distribution of potential biological responses, significantly accelerating drug discovery and clinical decision-making.

What Problem Does This Paper Address?

In biomedical research, there is a persistent "data bottleneck." We can easily collect "Easy-to-obtain Information" (EI)—such as the chemical formula of a drug or a patient’s heart rate—on millions of subjects. However, "Hard-to-obtain Information" (HI)—like how that drug changes the expression of 20,000 genes or the specific state of a patient’s immune cells—is expensive, time-consuming, and often invasive.

The challenge is that the relationship between EI and HI is rarely linear or deterministic. A tiny change in a drug's chemical structure can lead to a massive change in cellular response. Furthermore, biological systems are inherently noisy; repeating the same experiment can yield slightly different results. Traditional regression models struggle with these "one-to-many" mappings and often fail to capture the complex, manifold structure of biological data.

Methods

The authors introduce Feature Mapping GAN (FMGAN), based on a Conditional Generative Adversarial Network (cGAN) architecture.

  • The Core Logic: Unlike a standard GAN that generates images from random noise, a cGAN generates data based on a "condition." In FMGAN, the EI (e.g., drug structure) serves as the condition, and the HI (e.g., gene expression) is the target data distribution.
  • Handling Complexity: To make the EI usable, the authors use specialized encoders. For drug discovery, they use Convolutional Neural Networks (CNNs) to process either SMILES strings (textual representations of chemicals) or 2D structure diagrams.
  • Manifold Learning: In cases where the EI is already numerical but high-dimensional, they use PHATE (a dimensionality reduction tool) to find the "intrinsic coordinates" of the data. This helps the GAN understand the underlying biological "shape" of the input space, making the mapping to HI much more accurate.
  • Stochastic Output: Because it is a generative model, FMGAN can produce multiple "synthetic" samples for a single input condition, effectively simulating experimental replicates.

Datasets

The study validates FMGAN across three distinct domains:

  1. L1000 Connectivity Map: A massive dataset of gene expression profiles (RNA-seq) from cell lines treated with various drug perturbations.
  2. eICU Collaborative Research Database: De-identified clinical data from intensive care units, used here to predict patient mortality.
  3. COVID-19 Clinical Data: A cohort from Yale New Haven Hospital containing standard clinical lab values and matched single-cell flow cytometry (FACS) data, which measures specific immune cell populations.

Key Insights and Ideas

  • Stochasticity as a Feature, Not a Bug: The authors argue that because biological replicates vary, a model should produce a distribution. FMGAN’s ability to generate a range of outcomes makes it more biologically "honest" than deterministic models.
  • Regularizing the Input Space: Raw data (like a string of chemical characters) is often "jagged"—small changes in the string don't map smoothly to changes in function. By using CNNs to embed these into a latent space, FMGAN creates a more "regular" space where distances actually mean something biologically.
  • Imputing the Future: In the COVID-19 study, the authors used clinical data from the first 24 hours of an ICU stay to generate FACS data from later weeks. This suggests FMGAN can act as a "virtual diagnostic," providing high-resolution immune insights from low-resolution routine monitoring.

Key Results

The authors used Maximum Mean Discrepancy (MMD) to evaluate their results—a metric that measures how similar two distributions are (lower is better).

  • Drug Perturbations: FMGAN outperformed linear baselines significantly. When predicting gene expression from chemical images, FMGAN achieved an MMD of 1.177 vs. the baseline's 1.798.
  • Clinical Mortality: In the eICU dataset, FMGAN predicted the density of mortality across the patient manifold with an error rate below 0.01, while the linear baseline error was 2x to 10x higher.
  • COVID-19 FACS Generation: This was the most striking result. FMGAN generated synthetic flow cytometry data that closely matched real patient distributions (MMD 0.022 vs. baseline 0.898), successfully identifying specific T-cell populations (CD3+, CD4+, CD8+) from simple blood work.

Limitations and Future Work

  • Representativeness: The model’s accuracy depends entirely on the training set. If the training data doesn't capture a specific biological mechanism, the model cannot "hallucinate" it correctly for new samples.
  • Signal Bottleneck: If the "Easy Information" (EI) simply doesn't contain the signal necessary to determine the "Hard Information" (HI), no amount of generative modeling will bridge the gap.
  • Future Directions: The authors suggest integrating more diverse EI sources, such as unstructured doctor’s notes using Natural Language Processing (NLP), to further refine clinical predictions. They also aim to apply this to other "expensive" modalities like high-resolution medical imaging.

Summary updated

Abstract

Abstract In many important contexts involving measurements of biological entities, there are distinct categories of information: some information is easy-to-obtain information (EI) and can be gathered on virtually every subject of interest, while other information is hard-to-obtain information (HI) and can only be gathered on some of the biological samples. For example, in the context of drug discovery, measurements like the chemical structure of a drug are EI, while measurements of the transcriptome of a cell population perturbed with the drug is HI. In the clinical context, basic health monitoring is EI because it is already being captured as part of other processes, while cellular measurements like flow cytometry or even ultimate patient outcome are HI. We propose building a model to make probabilistic predictions of HI from EI on the samples that have both kinds of measurements, which will allow us to generalize and predict the HI on a large set of samples from just the EI. To accomplish this, we present a conditional Generative Adversarial Network (cGAN) framework we call the Feature Mapping GAN (FMGAN). By using the EI as conditions to map to the HI, we demonstrate that FMGAN can accurately predict the HI, with heterogeneity in cases of distributions of HI from EI. We show that FMGAN is flexible in that it can learn rich and complex mappings from EI to HI, and can take into account manifold structure in the EI space where available. We demonstrate this in a variety of contexts including generating RNA sequencing results on cell lines subjected to drug perturbations using drug chemical structure, and generating clinical outcomes from patient lab measurements. Most notably, we are able to generate synthetic flow cytometry data from clinical variables on a cohort of COVID-19 patients—effectively describing their immune response in great detail, and showcasing the power of generating expensive FACS data from ubiquitously available patient monitoring data. Bigger Picture Many experiments face a trade-off between gathering easy-to-collect information on many samples or hard-to-collect information on a smaller number of small due to costs in terms of both money and time. We demonstrate that a mapping between the easy-to-collect and hard-to-collect information can be trained as a conditional GAN from a subset of samples with both measured. With our conditional GAN model known as Feature-Mapping GAN (FMGAN), the results of expensive experiments can be predicted, saving on the costs of actually performing the experiment. This can have major impact in many settinsg. We study two example settings. First, in the field of pharmaceutical drug discovery early phase pharmaceutical experiments require casting a wide net to find a few potential leads to follow. In the long term, development pipelines can be re-designed to specifically utilize FMGAN in an optimal way to accelerate the process of drug discovery. FMGAN can also have a major impact in clinical setting, where routinely measured variables like blood pressure or heart rate can be used to predict important health outcomes and therefore deciding the best course of treatment.
BibTeX
@article{amodio2021generating,
  author = {Matthew Amodio and Dennis L. Shung and Daniel B. Burkhardt and Patrick Wong and Michael Simonov and Yu Yamamoto and David van Dijk and Francis Perry Wilson and Akiko Iwasaki and Smita Krishnaswamy},
  title = {{Generating hard-to-obtain information from easy-to-obtain information: Applications in drug discovery and clinical inference}},
  journal = {Patterns},
  year = {2021},
  doi = {10.1016/j.patter.2021.100288},
}
Figure