PIXER: an automated particle-selection method based on segmentation using a deep neural network

Jingrong Zhang, Zihao Wang, Yu Chen, Renmin Han, Zhiyong Liu, Fei Sun, Fa Zhang

TL;DR

This paper introduces PIXER, a novel deep learning-based method for automatically selecting protein particles from noisy cryo-electron microscopy (cryo-EM) images. By leveraging a segmentation network to create probability maps and a grid-based local-maximum approach, PIXER achieves performance comparable to semi-automated methods while significantly reducing manual labor and processing time.

What Problem Does This Paper Address?

Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the 3D structures of proteins and macromolecular complexes. However, a critical bottleneck in the process is the selection of hundreds of thousands of individual particle images from noisy 2D micrographs. These micrographs suffer from extremely low signal-to-noise ratios (SNR) due to electron beam damage to the specimen, making automated particle selection challenging. Existing methods often struggle with low SNR, require significant manual intervention, or generate numerous false positives, leading to laborious and time-consuming workflows. This paper aims to address these limitations by developing a fully automated, robust, and efficient particle selection method.

Methods

PIXER employs a two-stage deep learning approach:

  1. Segmentation Network: The core innovation is the use of a segmentation network. This network takes noisy cryo-EM micrographs as input and outputs probability density maps. These maps indicate the likelihood of each pixel belonging to a particle, effectively enhancing the signal and making particle detection more robust, especially in low-SNR conditions. The segmentation network is built upon a classification network architecture, with parameters initialized from a pre-trained classification network to accelerate training. To handle particles of varying sizes, the network incorporates "Atrous convolution," a technique that allows for a wider receptive field without increasing computational cost or parameters.
  2. Grid-based, Local-Maximum Particle Selection: After generating the probability density maps, a grid-based, local-maximum method is used to identify particle coordinates. This method involves dividing the micrograph into grids, finding the maximum value within each grid, and then iteratively searching for local maxima to pinpoint particle locations. This approach helps to avoid selecting multiple particles from a single grid cell and efficiently converges to particle candidates.
  3. Classification Network for False Positive Removal: Finally, a classification network is employed to re-evaluate the preliminary particle candidates identified by the segmentation and local-maximum methods. This step filters out false positives, further improving the accuracy of the particle selection.

Datasets

The authors created a comprehensive training dataset by combining real-world and simulated data.

  • Real-world data: Five datasets were used: beta-galactosidase, Plasmodium falciparum 80S ribosome, cyclic nucleotide-gated ion channel, influenza hemagglutinin trimer, and GroEL.
  • Simulated data: 321 different kinds of structures were used to generate simulated projection images using the InSilicoTEM software.

For evaluation, the authors used several benchmark datasets, including KLH, bacteriophage MS2, TRPV1, and rabbit muscle aldolase, ensuring that these test datasets were not part of the training set to prevent overfitting.

Key Insights and Ideas

  • Segmentation as a Novel Approach: Applying segmentation networks for particle selection in cryo-EM is a novel concept. Instead of directly classifying image patches, PIXER first generates a continuous probability map, which is more robust to noise and variations.
  • Automated Training Data Generation: The paper addresses the critical challenge of the lack of labeled cryo-EM segmentation datasets by proposing an automated method to generate training data from existing high-resolution reconstruction results. This significantly lowers the barrier to entry for developing and training such models.
  • Atrous Convolution for Multi-scale Handling: The integration of Atrous convolution is key to PIXER's ability to handle particles of varying sizes within the same micrograph, a common challenge in cryo-EM.
  • Robustness to Low SNR: The segmentation-based approach demonstrably improves performance in low-SNR conditions, a significant advantage over many traditional methods.

Key Results

  • Performance: PIXER achieves results comparable to semi-automated methods like RELION and DeepEM, and outperforms other fully automated methods like DeepPicker, especially in low-SNR scenarios.
  • Accuracy: On simulated data with varying SNRs, PIXER maintained a mean IOU of 0.86 even at an SNR as low as 0.01. Precision-recall curves on real-world datasets show PIXER achieving high precision and recall, often outperforming other methods.
  • Efficiency: PIXER can process a single micrograph in under a minute, making it significantly faster than many existing methods, particularly when considering the reduction in manual effort.

Limitations and Future Work

  • Potential of Probability Density Maps: The authors acknowledge that the full potential of the probability density maps generated by the segmentation network may not have been entirely exploited.
  • Dynamic Updating Strategy: PIXER currently lacks a dynamic updating strategy for its model. The authors suggest that developing such a strategy would be a focus for future work, allowing the model to adapt and improve over time with new data.

Summary updated

Abstract

Background Cryo-electron microscopy (cryo-EM) has become a widely used tool for determining the structures of proteins and macromolecular complexes. To acquire the input for single-particle cryo-EM reconstruction, researchers must select hundreds of thousands of particles from micrographs. As the signal-to-noise ratio (SNR) of micrographs is extremely low, the performance of automated particle-selection methods is still unable to meet research requirements. To free researchers from this laborious work and to acquire a large number of high-quality particles, we propose an automated particle-selection method (PIXER) based on the idea of segmentation using a deep neural network. Results First, to accommodate low-SNR conditions, we convert micrographs into probability density maps using a segmentation network. These probability density maps indicate the likelihood that each pixel of a micrograph is part of a particle instead of just background noise. Particles selected from density maps have a more robust signal than do those directly selected from the original noisy micrographs. Second, at present, there is no segmentation-training dataset for cryo-EM. To enable our plan, we present an automated method to generate a training dataset for segmentation using real-world data. Third, we propose a grid-based, local-maximum method to locate the particles from the probability density maps. We tested our method on simulated and real-world experimental datasets and compared PIXER with the mainstream methods RELION, DeepEM and DeepPicker to demonstrate its performance. The results indicate that, as a fully automated method, PIXER can acquire results as good as the semi-automated methods RELION and DeepEM. Conclusion To our knowledge, our work is the first to address the particle-selection problem using the segmentation network concept. As a fully automated particle-selection method, PIXER can free researchers from laborious particle-selection work. Based on the results of experiments, PIXER can acquire accurate results under low-SNR conditions within minutes.
BibTeX
@article{zhang2019pixer,
  author = {Jingrong Zhang and Zihao Wang and Yu Chen and Renmin Han and Zhiyong Liu and Fei Sun and Fa Zhang},
  title = {{PIXER: an automated particle-selection method based on segmentation using a deep neural network}},
  journal = {BMC Bioinformatics},
  year = {2019},
  doi = {10.1186/s12859-019-2614-y},
}
Figure