ACE-HetEM for ab initio Heterogenous Cryo-EM 3D Reconstruction

Weijie Chen, Lin Yao, Zeqing Xia, Yuhang Wang

Abstract

Due to the extremely low signal-to-noise ratio (SNR) and unknown poses (projection angles and image translation) in cryo-EM experiments, reconstructing 3D structures from 2D images is very challenging. On top of these challenges, heterogeneous cryo-EM reconstruction also has an additional requirement: conformation classification. An emerging solution to this problem is called amortized inference, implemented using the autoencoder architecture or its variants. Instead of searching for the correct image-to-pose/conformation mapping for every image in the dataset as in non-amortized methods, amortized inference only needs to train an encoder that maps images to appropriate latent spaces representing poses or conformations. Unfortunately, standard amortized-inference-based methods with entangled latent spaces have difficulty learning the distribution of conformations and poses from cryo-EM images. In this paper, we propose an unsupervised deep learning architecture called "ACE-HetEM" based on amortized inference. To explicitly enforce the disentanglement of conformation classifications and pose estimations, we designed two alternating training tasks in our method: image-to-image task and pose-to-pose task. Results on simulated datasets show that ACE-HetEM has comparable accuracy in pose estimation and produces even better reconstruction resolution than non-amortized methods. Furthermore, we show that ACE-HetEM is also applicable to real experimental datasets.

Introduction

Cryo-electron microscopy (cryo-EM) is a cornerstone of modern structural biology, enabling the visualization of biological molecules in their native states. However, the reconstruction of 3D structures from 2D cryo-EM images is plagued by three primary challenges: extreme noise (often with an SNR as low as -10 dB), unknown projection orientations (poses), and molecular heterogeneity, where molecules transition between different conformational states.

Comparison of a reconstructed noise-free image (a) and a typical noisy cryo-EM input image (b), illustrating the extreme signal-to-noise ratio challenges.

Traditional methods often struggle with "entanglement," where the reconstruction algorithm confuses a change in a molecule's orientation with a change in its actual shape. This leads to blurred reconstructions and inaccurate conformational classification.

Methodology: The ACE-HetEM Framework

ACE-HetEM addresses these challenges through an unsupervised deep learning architecture based on amortized inference. The core innovation lies in the explicit enforcement of latent-space disentanglement using two alternating training tasks within a Variational Autoencoder (VAE) framework.

The ACE-HetEM architecture featuring (a) the image-to-image reconstruction task and (b) the pose-to-pose disentanglement task.

Dual-Task Training

  1. Image-to-Image Task: The encoder analyzes an input image to predict pose parameters and a conformation latent. The decoder then attempts to reconstruct the original image from these latents.
  2. Pose-to-Pose Task: This "reversed" task starts with known synthetic poses and conformations. The decoder generates a clean synthetic image, to which synthetic noise is added. The encoder must then successfully recover the original pose parameters from this noisy synthetic input. This forces the encoder to learn a robust mapping that is independent of conformational changes.

Adaptive Synthetic Noise

To further improve training stability, ACE-HetEM employs Adaptive Synthetic Noise. By scaling the noise added during the pose-to-pose task relative to the model's current reconstruction performance, the network can learn coarse structural features early in training before refining its understanding of fine details under high-noise conditions.

Experimental Results

The researchers evaluated ACE-HetEM against state-of-the-art methods across several datasets:

  • 80S Ribosome (Simulated): In a bimodal dataset of 20,000 images, ACE-HetEM achieved a remarkable 0.01% classification error, drastically outperforming existing amortized methods which had error rates as high as 38%. This demonstrates the power of disentanglement in low-data regimes.
  • 1D-Motion (Simulated): The model accurately captured a continuous range of 10 rotational states, achieving a Spearman correlation of 0.976 between predicted and ground-truth states.
  • Precatalytic Spliceosome (Real Experimental): Using the EMPIAR-10180 dataset, ACE-HetEM successfully mapped the flexible motions of a complex molecular machine, producing 3D volumes that align with established structural literature.

Conclusion

ACE-HetEM represents a significant advancement in amortized inference for cryo-EM. By explicitly disentangling pose and conformation through a multi-task training strategy, it provides a fast, accurate, and scalable solution for heterogeneous 3D reconstruction. Future work will focus on more sophisticated noise modeling and higher-dimensional latent space visualizations to capture even more complex molecular dynamics.

Summary updated

Abstract

Due to the extremely low signal-to-noise ratio (SNR) and unknown poses (projection angles and image translation) in cryo-EM experiments, reconstructing 3D structures from 2D images is very challenging. On top of these challenges, heterogeneous cryo-EM reconstruction also has an additional requirement: conformation classification. An emerging solution to this problem is called amortized inference, implemented using the autoencoder architecture or its variants. Instead of searching for the correct image-to-pose/conformation mapping for every image in the dataset as in non-amortized methods, amortized inference only needs to train an encoder that maps images to appropriate latent spaces representing poses or conformations. Unfortunately, standard amortized-inference-based methods with entangled latent spaces have difficulty learning the distribution of conformations and poses from cryo-EM images. In this paper, we propose an unsupervised deep learning architecture called "ACE-HetEM" based on amortized inference. To explicitly enforce the disentanglement of conformation classifications and pose estimations, we designed two alternating training tasks in our method: image-to-image task and pose-to-pose task. Results on simulated datasets show that ACE-HetEM has comparable accuracy in pose estimation and produces even better reconstruction resolution than non-amortized methods. Furthermore, we show that ACE-HetEM is also applicable to real experimental datasets.
BibTeX
@misc{chen2023ace,
  author = {Weijie Chen and Lin Yao and Zeqing Xia and Yuhang Wang},
  title = {{ACE-HetEM for ab initio Heterogenous Cryo-EM 3D Reconstruction}},
  year = {2023},
  eprint = {2308.04956},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2308.04956},
}
Figure