ACE: Explaining cluster from an adversarial perspective

Yang Young Lu, Timothy C. Yu, Giancarlo Bonora, William Stafford NobleICML 2021

Overview

In single-cell RNA-seq (scRNA-seq) analysis, the standard workflow typically follows a "three-step" process: project high-dimensional data into a latent space, cluster the cells, and then find "marker genes" that define those clusters.

However, this conventional approach harbors a major flaw: these steps are usually performed independently. When researchers look for marker genes after clustering, they often ignore the non-linear transformations used to create the clusters in the first place. Furthermore, most standard tools (like DESeq2) treat each gene as an independent variable. This leads to "marker gene" lists that are highly redundant and fail to account for the fact that biological identity is often defined by complex gene-gene interactions or even the absence (depletion) of certain genes.

To address this, researchers have developed ACE (Adversarial Clustering Explanation), a deep learning framework that identifies "explanatory gene panels" for cell clusters. By asking, "What is the smallest change needed to make this cell look like it belongs to a different group?", ACE treats cluster explanation as an adversarial perturbation task, capturing complex gene dependencies and non-linear relationships that traditional independent-gene tests miss.

Methods: An Integrated Deep Learning Approach

ACE moves away from the "independent marker gene" mindset toward an integrated, end-to-end differentiable approach. Its architecture consists of three main components:

  1. Dimensionality Reduction: It uses a deep autoencoder (specifically SAUCIE) to learn a low-dimensional embedding of the cells while simultaneously performing batch correction.
  2. Neuralized Clustering: The authors "neuralize" the traditional k-means algorithm. By reformulating k-means as a functionally equivalent multi-layer neural network, they make the clustering process differentiable. This allows gradients to flow all the way from the cluster assignment back to the original input features (genes).
  3. Adversarial Perturbation: Borrowing from "white-box" adversarial attacks in computer vision, ACE seeks the minimal perturbation to a cell's gene expression profile that would cause the neuralized clustering model to flip its assignment to a different cluster.
The ACE framework architecture

The genes that require the most "effort" to change (or those that contribute most to the cluster flip) are ranked as the most explanatory. This allows the model to identify "gene panels" that are both highly discriminative and non-redundant.

Datasets

The authors evaluated ACE across three distinct types of data to prove its efficacy and generality:

  • Simulated scRNA-seq (SymSim): "Clean" and "complex" (with dropout and batch effects) synthetic datasets containing causal, dependent, and noise genes were used to test if ACE could pick out the minimal set of informative features.
  • Real scRNA-seq (PBMC): A dataset of 2,638 peripheral blood mononuclear cells categorized into eight cell types.
  • Image Recognition (MNIST): As a proof-of-concept, ACE was applied to handwritten digits to see which pixels explain the transition between numbers.

Key Insights and Results

Explanatory Panels vs. Marker Genes

Traditional methods look for genes that are "upregulated" in a cluster. ACE, on the other hand, identifies "explanatory panels" which can include genes that are enriched, depleted, or essential for distinguishing between two very similar cell types. For example, a striking finding in the PBMC dataset was that CD4 T cell identity is often defined by the depletion of specific genes (like CCL5 and GZMK) rather than just the presence of others. ACE successfully identified these depleted genes, whereas traditional methods overlooked them.

High Discriminative Power with Minimal Redundancy

Because ACE looks for a set of changes to flip a cluster label, it naturally avoids picking multiple genes that all serve the same function. It favors a diverse panel where each gene provides unique discriminative power.

Performance of ACE on PBMC data

When using only the top 1% of ranked genes to train an SVM classifier, ACE-identified genes yielded higher AUROC scores than most baselines (including SHAP and DESeq2), particularly when the number of genes allowed was very small (≤ 3%). Furthermore, ACE’s top-ranked genes showed significantly lower Pearson correlation with each other compared to traditional methods, proving that the "panels" it selects are more efficient and less redundant.

Superior Feature Selection

On simulated data, ACE outperformed six baseline methods in identifying the minimal set of genes required to recover the true clustering structure, as measured by Jaccard distance. By using adversarial perturbations, the model accounts for the non-linear "shape" of the clusters in latent space, providing a more faithful explanation of why the machine learning model grouped the cells the way it did.

Limitations and Future Work

While ACE represents a significant step forward in cluster explanation, the authors note a few areas for future development:

  • Embedder Dependency: The performance of ACE is inherently tied to the quality of the underlying autoencoder (SAUCIE). Future work could explore integrating other popular embedders like scVI.
  • Clustering Algorithms: The current version focuses on a neuralized version of k-means. Neuralizing more complex algorithms, like Louvain or Leiden clustering (which are standard in the scRNA-seq field), would be a valuable next step.
  • Statistical Significance: The framework currently lacks a mechanism for confidence estimation for the gene rankings. Integrating "knockoffs" or other statistical frameworks to provide q-values for the identified explanatory genes would improve its utility for downstream biological validation.

Summary updated

BibTeX
@inproceedings{lu2021ace,
  author = {Yang Young Lu and Timothy C. Yu and Giancarlo Bonora and William Stafford Noble},
  title = {{ACE: Explaining cluster from an adversarial perspective}},
  booktitle = {International Conference on Machine Learning},
  year = {2021},
}
Figure