Can generative AI replace immunofluorescent staining processes? A comparison study of synthetically generated cellpainting images from brightfield

Xiaodan Xing, Siofra Murdoch, Chunling Tang, Giorgos Papanastasiou, Jan Oscar Cross-Zamirski, Yunzhe Guo, Xianglu Xiao, Carola-Bibiane Schönlieb, Yinhai Wang, Guang Yang

TL;DR

This paper benchmarks five generative AI models (CNN, GAN, and Diffusion) to see if they can "virtually stain" cells by predicting fluorescent images from simple brightfield microscopy. While GANs (specifically Pix2Pix) produce the most visually convincing results, the study reveals a critical "generalizability gap": models trained on one cell line fail significantly on others, suggesting that AI isn't ready to fully replace the wet lab just yet.

What Problem Does This Paper Address?

In drug discovery and cell biology, researchers use immunofluorescence (IF) to see specific organelles (like the nucleus or mitochondria). However, IF is a "destructive" process: it requires expensive dyes, takes days of manual labor, and usually kills the cells in the process.

Brightfield (BF) imaging, on the other hand, is cheap, fast, and keeps cells alive, but the images look like translucent blobs to the human eye. The "holy grail" is to use Generative AI to translate these "blobs" into high-fidelity fluorescent images—essentially performing "in silico" staining. The authors wanted to know: which AI architecture is best for this, and can we actually trust the biological data these models generate?

Methods

The researchers compared three major families of generative models:

  1. CNN (UNet): The traditional baseline for image-to-image tasks.
  2. GANs (Pix2Pix and SPADE): Models that use a "discriminator" to force the generator to produce more realistic textures.
  3. Diffusion Models (Palette and SPADE-Diffusion): The current state-of-the-art in AI art (like DALL-E), adapted here for scientific imaging.

Unlike many previous studies that only looked at pixel-level accuracy (like MSE), this team built a "biological meaning" pipeline. They used CellProfiler to extract over 3,000 morphological features (shape, texture, intensity) from both the real and synthetic images to see if the AI-generated cells behaved like real ones in downstream analysis.

Datasets

The study utilized the cpg0000 dataset from the Cell Painting Gallery.

  • Scale: Over 3 million pairs of brightfield and fluorescent images.
  • Diversity: Includes two cell lines (A549 lung cancer and U2OS bone cancer) treated with over 300 different chemical compounds and CRISPR gene knockouts.
  • Benchmark: The authors used specific "plates" for training, validation, and testing, including a dedicated test for generalizability to unseen cell lines.

Key Insights and Ideas

  • The GAN Supremacy (for now): Pix2Pix emerged as the winner for visual quality. It captured fine details that CNNs blurred out and avoided the "hallucinations" (fake structures) sometimes seen in Diffusion models.
  • Visual Quality $\neq$ Biological Utility: Surprisingly, even though Diffusion models produced "noisier" images with lower standard scores (PSNR/SSIM), they were often just as good—or better—at predicting the Mechanism of Action (MoA) of a drug. This suggests the models are picking up on subtle biological signals that aren't necessarily "pretty" to look at.
  • The "Generalizability Wall": This is the biggest "aha" moment. A model trained on A549 cells performs poorly when asked to predict U2OS cells. Performance in cell counting dropped by over 60%. This means we cannot yet build a "universal" virtual stainer without massive, diverse datasets.
  • Granularity is the Key: The models were most accurate at replicating "granularity" (the texture and distribution of organelles). This is crucial because granularity is a primary indicator of how a cell is responding to a drug.

Key Results

  • Top Performer: Pix2Pix achieved the best balance of image quality and computational efficiency.
  • MoA Accuracy: Both real and synthetic features achieved roughly 70% accuracy in identifying how a drug affected a cell. This proves synthetic images can be used for high-throughput drug screening.
  • Speedup: Generating a synthetic image takes 0.07 seconds (Pix2Pix) compared to 1–2 days for traditional wet-lab staining.
  • The Diffusion Bottleneck: While powerful, Diffusion models were incredibly slow, taking 240 seconds per image—making them less practical for screening millions of cells.

Limitations and Future Work

The authors are refreshingly honest: Generative AI cannot replace IF staining yet. 1. Trustworthiness: Most feature correlations between real and synthetic images were low (under 0.3). While the "big picture" (MoA) was accurate, the fine-grained measurements were often off. 2. Batch Effects: The models are sensitive to the specific conditions of the lab where the training data was gathered. 3. Foundation Models: The authors suggest that the next step is moving away from small, specific models toward "Foundation Models for Biology"—AI trained on billions of images across hundreds of cell types to finally overcome the generalizability problem.

Summary updated

Abstract

Highlights•This study benchmarks five models across CNN, GAN, and diffusion backbones using a public dataset for a comparative analysis.•Deep learning-generated synthetic immunofluorescence images show high visual quality and can distinguish single-cell mechanisms under various treatments.•Model generalizability is a concern, with performance dropping on unseen cell lines, raising trustworthiness issues.•The generalisability of the synthesis models is a concern. When tested on unseen cell lines, performance dropped sharply. Additionally, despite high mechanisms of action prediction accuracy, most feature correlations are low, raising concerns about the trustworthiness of these algorithms.
BibTeX
@article{xing2024can,
  author = {Xiaodan Xing and Siofra Murdoch and Chunling Tang and Giorgos Papanastasiou and Jan Oscar Cross-Zamirski and Yunzhe Guo and Xianglu Xiao and Carola-Bibiane Schönlieb and Yinhai Wang and Guang Yang},
  title = {{Can generative AI replace immunofluorescent staining processes? A comparison study of synthetically generated cellpainting images from brightfield}},
  journal = {Computers in Biology and Medicine},
  year = {2024},
  doi = {10.1016/j.compbiomed.2024.109102},
}

Loading related content...

Figure