PerturbJEPA: Joint-Embedding Predictive Learning of Cellular Perturbation Responses

Jiangshuan Pang, Youzhe He, Yiting Deng, Wangyang Tang, Huinan Xu, Qi Lu, Shiping Liu, Zhenkun ZhuangarXiv 2026 · arXiv

TL;DR

PerturbJEPA is a novel joint-embedding framework designed to predict how cell populations respond to specific drugs and doses. By introducing a mechanism to prevent "interventional contrast collapse"—where models ignore subtle drug effects in favor of larger cell-type differences—it achieves a state-of-the-art 91.46% accuracy in identifying the exact drug-dose combination responsible for a cellular response.

What Problem Does This Paper Address?

In drug discovery, researchers often use single-cell transcriptomics to see how gene expression changes after treatment. A core challenge is source-intervention retrieval: given an observed cellular response, can we work backward to identify which drug and dose caused it?

This is difficult for two reasons. First, single-cell sequencing is "destructive"—you can't measure the same cell before and after treatment, only different populations. Second, the "signal" of a drug's effect is often tiny compared to the "noise" of the cellular background (e.g., the difference between a lung cell and a heart cell is much larger than the difference between a treated lung cell and a control lung cell).

The authors identify a specific failure mode they call Interventional Contrast Collapse (ICC). In ICC, a model might be great at distinguishing cell types (global diversity) but "collapses" the treatment effect, representing treated and control cells as identical within the same background. This makes it impossible to retrieve the correct drug-dose combination.

Methods

PerturbJEPA utilizes a Joint-Embedding Predictive Architecture (JEPA). Unlike traditional Variational Autoencoders (VAEs) that try to reconstruct entire gene expression profiles, JEPAs learn to predict representations in a latent space, which is often more efficient and robust.

The key innovations are:

  • Pseudobulk-to-latent Effect Alignment (PEA): The model calculates the "pseudobulk" difference (the change in mean gene expression) between treated and control populations. It then forces the "displacement" between the centroids of these populations in the latent space to align with this expression-contrast vector.
  • Effect-Space Isotropy (ESI): This is a critical regularizer. It ensures that these "effect vectors" don't all shrink to zero or become identical. It forces the model to maintain variation across different drug-dose pairs.
  • Intervention-Discriminative Ranking (IDR): During training, the model is specifically tasked with ranking the true drug/dose higher than similar "hard negatives" (e.g., the same drug at a different dose, or a chemically similar drug).
  • Population Energy Discrepancy (PED): To compare unpaired populations, the model uses an energy-based distance metric that looks at the distributional structure of the cells in latent space rather than just matching individual cells.

Datasets

The model was evaluated on the Tahoe-100M dataset, a massive benchmark for drug-induced molecular phenotypes.

  • Queries: 3,592 held-out combinations of interventions and cellular backgrounds.
  • Scope: Spans five different cell lines.
  • Catalog: Each query required the model to rank the true intervention against a background-specific catalog of over 700 drug–dose candidates.

Key Insights and Ideas

  • Global Diversity is Not Enough: A model can have a perfectly spread-out latent space (high entropy) and still suffer from ICC. You must explicitly protect the "delta" caused by the intervention.
  • The Power of Regularization: The authors found that simply aligning the latent displacement to the effect vector wasn't enough; without the ESI regularizer to keep those vectors diverse, the model's performance plummeted. Adding ESI raised joint Recall@1 from 18.57% to 87.47%.
  • Geometry as Supervision: By treating the drug effect as a geometric displacement (a vector moving from "control" to "treated"), the model creates a retrieval-friendly space where the "direction" of the drug effect is preserved.

Key Results

  • State-of-the-Art Performance: PerturbJEPA achieved 91.46% macro joint drug–dose Recall@1, outperforming the previous best model (STATE) by 3.4 percentage points.
  • Dose Precision: If the drug is already known, the model identifies the correct dose with 99.31% accuracy.
  • Efficiency: Because it operates in a joint-embedding space without needing to reconstruct high-dimensional gene expression, it is highly effective for large-scale retrieval tasks.

Limitations and Future Work

  • Closed-World Catalog: Currently, the model uses a lookup table for drug identities. This means it cannot yet predict the effects of entirely new, "unseen" chemical compounds. The authors suggest replacing the lookup table with a chemical-structure encoder (like a Graph Neural Network) in future iterations.
  • Cell Line Transfer: While the model handles new drug-background combinations, its ability to generalize to entirely new cell lines (not present in the training set) remains an open question.
  • Mean-Shift Bias: The PEA mechanism relies on changes in mean expression. If a drug primarily changes the variance or the shape of the cell distribution without shifting the mean, the current alignment strategy might miss it.

Summary updated

Abstract

Identifying the drug and dose that produced a cellular response requires preserving treatment effects within each cellular background. A joint-embedding predictor can match its targets while ignoring the intervention if its encoder preserves differences across backgrounds but erases differences between treated and control populations within each one. We call this failure interventional contrast collapse. PerturbJEPA encodes the difference in mean gene expression between treated and control populations as an effect vector. It aligns the displacement between their latent centroids with this vector and regularizes the vectors to preserve variation across population pairs. We show that the measured displacements cannot all coincide within a batch when effect-vector variation exceeds the root-mean-square alignment error. Trained with separate drug and dose ranking objectives, the model predicts candidate responses from a common control population and matches them to the observed response without cell pairing or expression reconstruction. We evaluate 3,592 Tahoe-100M queries on held-out combinations of known interventions and cellular backgrounds, each with over 700 drug-dose candidates in a fixed, background-specific catalog. PerturbJEPA achieves 91.46% macro joint drug-dose Recall@1, exceeding STATE by 3.40 percentage points (95% drug-cluster bootstrap interval of 1.72 to 5.07 points). Controlled diagnostics show that treatment-control differences can shrink even when representations remain globally dispersed. With the drug ranking objective fixed, adding effect-vector regularization to alignment raises joint Recall@1 from 18.57% to 87.47%.
BibTeX
@misc{pang2026perturbjepa,
  author = {Jiangshuan Pang and Youzhe He and Yiting Deng and Wangyang Tang and Huinan Xu and Qi Lu and Shiping Liu and Zhenkun Zhuang},
  title = {{PerturbJEPA: Joint-Embedding Predictive Learning of Cellular Perturbation Responses}},
  year = {2026},
  eprint = {2611.20575},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.20575},
}
Figure