Self-Supervised Cryo-Electron Tomography Volumetric Image Restoration from Single Noisy Volume with Sparsity Constraint

Zhidong Yang, Fa Zhang, Renmin Han

Abstract

SC-Net is a novel self-supervised deep learning model designed to restore high-quality 3D Cryo-Electron Tomography (cryo-ET) volumes from a single noisy input. By integrating a volumetric "blind-spot" training strategy with a data-derived sparsity constraint, SC-Net significantly outperforms existing single-volume restoration techniques and achieves performance comparable to supervised models without requiring ground-truth data.

Introduction

Cryo-Electron Tomography (cryo-ET) is essential for visualizing the 3D ultrastructure of biological samples. However, the technique is limited by an extremely low Signal-to-Noise Ratio (SNR) because low electron doses must be used to prevent radiation damage. Current restoration approaches have significant limitations: supervised methods require unavailable "clean" labels; Noise2Noise-based self-supervised methods require multiple noisy observations; and Noise2Void often produces artifacts or over-smooths fine structures in 3D volumes. SC-Net addresses these challenges by enabling high-fidelity restoration from a single noisy volume.

Methods: The SC-Net Architecture

SC-Net utilizes a 3D U-Net-based architecture optimized for self-supervised learning on volumetric data. Its primary innovations include:

  1. Volumetric Blind-Spot Replacement: Unlike standard 2D "blind-spot" methods that predict a pixel from its neighbors, SC-Net uses a 3D $n \times n \times n$ region. This approach better captures the spatial correlations inherent in volumetric cryo-ET data.
  2. Sparsity-Guided Smoothing: To provide structural guidance without external labels, the authors generate a "smoothed" volume by filtering 2D projections before 3D reconstruction. A Sparsity Representation Extractor then identifies structural edges to guide the network.
  3. Multi-Component Loss: The training objective combines reconstruction loss (at blind spots), sparsity loss (matching structural edges), and an expectancy constraint to prevent brightness drift.
The SC-Net architecture overview, highlighting the encoder-decoder structure and the Sparsity Representation Extractor.

Datasets and Evaluation

The model was rigorously tested on both simulated and real-world datasets:

  • Simulated Benchmarks: SARS-CoV-2, Synapse, and Adhesion Belt datasets were created using a physics-based simulation pipeline to provide ground truth for quantitative metrics like PSNR and SSIM.
  • Real-World Data: The model was applied to diverse biological structures including Centrioles, Mitochondria, Vesicles, and VEEV (Venezuelan Equine Encephalitis Virus).

Key Results

SC-Net demonstrated significant improvements over existing self-supervised methods. In simulations, it achieved a PSNR of 32.38 dB on the "Belt" dataset, vastly outperforming Noise2Void's 23.38 dB. Visually, SC-Net produces sharper membranes and fewer artifacts than popular tools like Topaz, despite requiring less training data.

Visual restoration results on the Synapse dataset, showing improved clarity and structural detail.

Resolution analysis using Fourier Shell Correlation (FSC) confirmed that SC-Net achieved state-of-the-art resolution on the majority of real-world datasets tested.

Conclusion and Future Work

SC-Net represents a major step forward in cryo-ET restoration by providing high-quality results from single noisy volumes. While it excels in most scenarios, performance can dip on extremely sparse samples like VEEV where structural "guides" are harder to extract. Future research will focus on refining sparsity extraction for such edge cases and incorporating broader structural priors.

Summary updated

Abstract

Cryo-Electron Tomography (cryo-ET) is a powerful tool for 3D cellular visualization. Due to instrumental limitations, cryo-ET images and their volumetric reconstruction suffer from extremely low signal-to-noise ratio. In this paper, we propose a novel end-to-end self-supervised learning model, the Sparsity Constrained Network (SC-Net), to restore volumetric image from single noisy data in cryo-ET. The proposed method only requires a single noisy data as training input and no ground-truth is needed in the whole training procedure. A new target function is proposed to preserve both local smoothness and detailed structure. Additionally, a novel procedure for the simulation of electron tomographic photographing is designed to help the evaluation of methods. Experiments are done on three simulated data and four real-world data. The results show that our method could produce a strong enhancement for a single very noisy cryo-ET volumetric data, which is much better than the state-of-the-art Noise2Void, and with a competitive performance comparing with Noise2Noise. Code is available at https://github.com/icthrm/SC-Net.
BibTeX
@inproceedings{yang2021self,
  author = {Zhidong Yang and Fa Zhang and Renmin Han},
  title = {{Self-Supervised Cryo-Electron Tomography Volumetric Image Restoration from Single Noisy Volume with Sparsity Constraint}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {2021},
  doi = {10.1109/iccv48922.2021.00402},
}
Figure