An Unsupervised Classification Algorithm for Heterogeneous Cryo-EM Projection Images Based on Autoencoders

Xiangwen Wang, Yonggang Lu, Xianghong Lin, Jianwei Li, Zequn ZhangInternational Journal of Molecular Sciences 2023 · DOI

TL;DR

This paper introduces a novel unsupervised algorithm for classifying heterogeneous cryo-EM projection images using autoencoders. By learning feature representations without prior knowledge of orientations or common lines, the method effectively separates different structural states of biological macromolecules, paving the way for more accurate 3D reconstruction of flexible molecules.

What Problem Does This Paper Address?

Single-particle cryo-electron microscopy (cryo-EM) is a powerful technique for determining the 3D structures of biological macromolecules. However, many biological molecules are not rigid; they exist in multiple conformations or functional states. This "structural heterogeneity" means that a single cryo-EM dataset contains projection images from various 3D structures. Traditional cryo-EM reconstruction methods assume homogeneity, leading to blurred or inaccurate results when applied to heterogeneous samples. Addressing this requires classifying projection images into subsets corresponding to distinct 3D structures before reconstruction. Existing classification methods often rely on supervised learning or require significant prior knowledge (like known orientations or common lines), which can be difficult to obtain or limit applicability. This paper tackles the challenge of classifying these heterogeneous images in an unsupervised manner, requiring only the number of expected distinct structures.

Methods

The core of the proposed method is an autoencoder-based approach for feature extraction and classification.

  • Autoencoders for Feature Extraction: Two types of autoencoders are employed:
  • AE-MLP: A simpler autoencoder using multi-layer perceptrons (MLPs). It's trained iteratively to learn latent representations of the projection images.
  • AE-RES: A more complex autoencoder utilizing residual networks. This model is trained in a "one-pass learning" mode, which can be more efficient. Both autoencoders aim to encode the input projection images into a lower-dimensional "latent space," capturing essential category features.

  • Dimensionality Reduction: The high-dimensional latent features extracted by the autoencoders are then reduced to 2D using the Uniform Manifold Approximation and Projection (UMAP) algorithm. This step helps in visualizing and preparing the features for clustering.

  • Spectral Clustering: The 2D features are then clustered using a normalized spectral clustering algorithm. This unsupervised clustering technique groups similar projection images together, effectively separating the heterogeneous dataset into homogeneous subsets.
  • Heterogeneous 3D Reconstruction: Once classified, each homogeneous subset of projection images is used with traditional single-particle 3D reconstruction methods (like RELION or cryoSPARC) to reconstruct preliminary 3D density maps for each distinct structural state.

Datasets

The authors evaluated their method on two synthetic cryo-EM datasets:

  1. Discrete Compositional Conformation Dataset: This dataset comprises projection images from three different ribosomes (EMD-0230, EMD-0231, EMD-0232). This dataset represents compositional heterogeneity, where different types of macromolecules are present.
  2. Conformational Heterogeneity Dataset (Bacterial Ribosome): This dataset includes projection images from four different conformations of the bL17-depleted large ribosomal subunit assembly intermediate (EMD-8440, EMD-8441, EMD-8445, EMD-8450). This dataset focuses on conformational heterogeneity within the same macromolecule.

Both datasets were generated by simulating noisy projection images from published 3D density maps, with a signal-to-noise ratio (SNR) of 0.1 to mimic real cryo-EM data.

Key Insights and Ideas

  • Unsupervised Feature Learning: The most significant insight is the successful application of autoencoders for unsupervised feature extraction in cryo-EM. This bypasses the need for manual annotation or complex prior knowledge, making the method more broadly applicable.
  • AE-RES for Efficiency and Accuracy: The AE-RES model, despite its complexity, demonstrates strong performance, particularly in achieving higher classification accuracy and enabling faster one-pass learning compared to the iterative AE-MLP.
  • UMAP + Spectral Clustering Synergy: The combination of UMAP for dimensionality reduction and spectral clustering for classification proves effective in grouping the learned features, leading to accurate separation of different structural states.
  • Direct Feature Visualization: Visualizing the 2D features extracted by the autoencoders (Figure 2 and 4) clearly shows how the models separate distinct conformations, outperforming direct dimensionality reduction of raw images.

Key Results

  • High Classification Accuracy:
    • On the discrete compositional dataset, both AE-MLP and AE-RES achieved 100% classification accuracy, outperforming direct use of original images (96.00%).
  • On the more challenging bacterial ribosome conformational dataset, AE-RES achieved a mean classification accuracy of 67.25%, AE-MLP 57.60%, significantly outperforming direct use of original images (26.90%).
  • Improved 3D Reconstruction: The reconstructed 3D density maps using features from the AE-RES model were visually more similar to the published ground truth maps, and FSC curves indicated higher reconstruction accuracy, especially for the AE-RES model.
  • Broader Applicability: The method does not require prior knowledge of projection orientations or common lines, making it more versatile than many existing techniques.

Limitations and Future Work

  • Computational Cost of AE-RES: While AE-RES offers advantages, its complex architecture might still be computationally intensive.
  • Performance on Real Data: The current study uses synthetic datasets. Future work should focus on validating the algorithm on real cryo-EM datasets.
  • Exploration of Deeper Models: The authors suggest exploring more advanced deep generative network models with enhanced learning and representation capabilities for future work.
  • Further Optimization: Investigating more sophisticated clustering or dimensionality reduction techniques could potentially further improve performance.

Summary updated

Abstract

Heterogeneous three-dimensional (3D) reconstruction in single-particle cryo-electron microscopy (cryo-EM) is an important but very challenging technique for recovering the conformational heterogeneity of flexible biological macromolecules such as proteins in different functional states. Heterogeneous projection image classification is a feasible solution to solve the structural heterogeneity problem in single-particle cryo-EM. The majority of heterogeneous projection image classification methods are developed using supervised learning technology or require a large amount of a priori knowledge, such as the orientations or common lines of the projection images, which leads to certain limitations in their practical applications. In this paper, an unsupervised heterogeneous cryo-EM projection image classification algorithm based on autoencoders is proposed, which only needs to know the number of heterogeneous 3D structures in the dataset and does not require any labeling information of the projection images or other a priori knowledge. A simple autoencoder with multi-layer perceptrons trained in iterative mode and a complex autoencoder with residual networks trained in one-pass learning mode are implemented to convert heterogeneous projection images into latent variables. The extracted high-dimensional features are reduced to two dimensions using the uniform manifold approximation and projection dimensionality reduction algorithm, and then clustered using the spectral clustering algorithm. The proposed algorithm is applied to two heterogeneous cryo-EM datasets for heterogeneous 3D reconstruction. Experimental results show that the proposed algorithm can effectively extract category features of heterogeneous projection images and achieve high classification and reconstruction accuracy, indicating that the proposed algorithm is effective for heterogeneous 3D reconstruction in single-particle cryo-EM.
BibTeX
@article{wang2023unsupervised,
  author = {Xiangwen Wang and Yonggang Lu and Xianghong Lin and Jianwei Li and Zequn Zhang},
  title = {{An Unsupervised Classification Algorithm for Heterogeneous Cryo-EM Projection Images Based on Autoencoders}},
  journal = {International Journal of Molecular Sciences},
  year = {2023},
  doi = {10.3390/ijms24098380},
}
Figure