Gaussian Splatoms: Direct Atomic Structure Identification in Electron Tomography

Nalini Singh, Tiffany Chien, Cedric Lim, Arthur R. C. McCray, Colin Ophus, Laura WallerarXiv 2026 · arXiv

TL;DR

Researchers have adapted Gaussian Splatting—a breakthrough technique in computer vision—to map individual atoms in 3D using electron microscopy. By modeling samples as a collection of discrete 3D Gaussians rather than a grid of voxels, the "Gaussian Splatoms" method produces significantly more accurate and physically realistic atomic structures, even when dealing with noisy or incomplete experimental data.

What Problem Does This Paper Address?

Atomic electron tomography (AET) is essentially a CT scan for the nano-world, allowing scientists to see the 3D arrangement of atoms in a material. However, the process is fraught with challenges. Samples are sensitive to electron beams (limiting the "dose" or brightness), and mechanical constraints prevent researchers from rotating the sample fully, leading to a "missing wedge" of data in Fourier space.

Traditional reconstruction methods rely on voxels (3D pixels). This approach is problematic because it treats the entire volume as a dense grid, even though most of it is empty space. Furthermore, it requires a messy two-step pipeline: first, reconstruct a blurry 3D volume, and then use "atom tracing" algorithms to guess where the atoms are. This often results in "shadow" atoms, elongated shapes, or missed sites that require hundreds of hours of manual correction by human experts.

Methods

The authors introduce Gaussian Splatoms, an atom-centric parameterization that skips the intermediate voxel grid entirely.

The Core Idea

Inspired by 3D Gaussian Splatting, the model represents the sample as a list of $N$ atoms. Each atom is a 3D Gaussian defined by:

  • Location ($x, y, z$)
  • Scale ($\sigma$)
  • Amplitude ($a$)

Physics-Based Priors

Because the model "knows" it is looking for atoms, the authors can bake physical constraints directly into the optimization process:

  1. Isotropy: Atoms are constrained to be spherical.
  2. Minimum Distance: Atoms cannot be closer than a physically plausible bond length.
  3. Maximum Radius: Atoms cannot grow into giant, diffuse blobs.

The optimization is fully differentiable. The system simulates 2D projections from the current 3D Gaussian model and compares them to the actual microscope measurements. It then uses gradient descent to nudge the atoms into their correct positions, as shown in Figure 1.

Figure 1. Gaussian Splatoms recovers atomic structures from atomic electron tomography (AET). (a) A nanoparticle sits on a tilt stage and rotates through a series of angles. At each angle, a detector records a 2D projection of the transmitted electron beam. The limited set of tilt angles produces a missing wedge in Fourier space where no data exists, and the reconstruction method must impute a solution. (b) At each step of our optimization procedure, Gaussian Splatoms simulates a tomographic projection and compares the result to acquired measurements. This loss is used to perform a gradient update to the parameters of the atoms, represented by 3D Gaussians each characterized by a position, amplitude, and scale. The Gaussians are constrained to be isotropic and of the appropriate size and distance apart (set by the bond-length) such that each Gaussian represents a single atom.

Datasets

The method was evaluated on both simulated and experimental data:

  • Experimental FePt Nanoparticle: A real-world dataset of an iron-platinum nanoparticle containing roughly 23,000 atoms.
  • Simulated Nanoparticles: FePt (~8,300 atoms) and Gold (Au) structures used to benchmark performance against controlled levels of noise and data loss (missing wedges).

Key Insights and Ideas

  • Dimensionality Reduction: Moving from a voxel grid (which might have 17 million parameters for a $256^3$ volume) to an atomic list (only ~115,000 parameters for 23,000 atoms) dramatically simplifies the optimization problem.
  • Fourier Infilling: The "missing wedge" problem is essentially a hole in the data. By enforcing an "atomic" prior, the model naturally "hallucinates" the missing information in a way that is physically consistent, leading to much cleaner Fourier transforms (see Figure 2).
  • Direct Identification: By optimizing for atom positions directly from raw 2D projections, the method avoids the artifacts and errors that typically accumulate during the traditional two-step reconstruction and tracing process.

Key Results

Gaussian Splatoms consistently outperformed volumetric baselines (like GENFIRE and Implicit Neural Representations) across all stress tests.

  • Experimental Accuracy: On the 23,000-atom FePt particle, the method recovered 98.3% of core atoms with a root-mean-square distance (RMSD) of just 0.32 Å, all without the manual refinement required by previous methods.
  • Robustness to Noise: In low-dose simulations (high noise), Splatoms maintained high True Positive Rates while baselines began to fail, producing "misshapen" atoms or false positives (Figure 3).
  • Species Identification: The learned Gaussian amplitudes proved to be a reliable proxy for atomic species, clearly separating iron from platinum even in challenging imaging conditions.
Figure 3. Gaussian Splatoms reconstructions are robust to challenging imaging conditions. (a) We simulate an iron-platinum nanoparticle (b) under standard imaging conditions as well as (c) large missing wedge, (d) large angular step and (e) low electron dose. In each case, we visualize the reconstruction, a zoomed-in patch, and the Fourier transform for the GENFIRE and INR baselines as well as our Gaussian Splatoms method. Across all corruptions, Gaussian Splatoms yields well-resolved, accurate atoms and correctly fills in the Fourier space, while the baselines fail to do so.

Limitations and Future Work

  • Hyperparameter Sensitivity: The model requires a priori knowledge of approximate bond lengths and atomic radii to set the clustering and splitting thresholds.
  • "Plausible" Errors: Because the model is forced to produce atoms, any errors it makes will still look like atoms. This could potentially mislead researchers if they aren't careful, as the errors won't manifest as obvious "streaks" or "blurs" like they do in voxel methods.
  • Future Directions: The authors suggest that future versions could incorporate even more complex physics, such as energetic favorability of certain atomic configurations or handling dynamic samples where atoms move during the imaging process.

Summary updated

Abstract

Atomic electron tomography (AET) computationally reconstructs the 3D atomic structure of materials from a series of 2D projection measurements acquired at different tilt angles. Inspired by Gaussian splatting techniques from computer vision, we introduce an atom-centric parameterization for modeling AET samples. Instead of a conventional volumetric representation with a grid of voxels, we model the sample as a list of atoms, where each atom is a 3D Gaussian characterized by learned location, scale, and amplitude. The Gaussian model is a natural fit for atoms that allows us to easily incorporate prior information grounded in physics; we impose isotropy of atoms, a minimum interatomic distance, and realistic atomic radii. We show in simulation that our method is more robust than volumetric baselines to real-world imaging challenges, including a limited number of measurements and low electron dose. We further show that our method yields a more physically plausible reconstruction of an experimental 23,000 atom iron-platinum nanoparticle than a previously published volumetric reconstruction. Beyond tomography, our representation is a promising tool for any atomic resolution imaging modality (e.g. multislice electron ptychography).
BibTeX
@misc{singh2026gaussian,
  author = {Nalini Singh and Tiffany Chien and Cedric Lim and Arthur R. C. McCray and Colin Ophus and Laura Waller},
  title = {{Gaussian Splatoms: Direct Atomic Structure Identification in Electron Tomography}},
  year = {2026},
  eprint = {2611.23444},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.23444},
}
Figure