niiv: Interactive Self-supervised Neural Implicit Isotropic Volume Reconstruction

Jakob Troidl, Yiqing Liang, Johanna Beyer, Mojtaba Tavakoli, Johann Danzl, Markus Hadwiger, Hanspeter Pfister, James Tompkin

Abstract

Abstract Three-dimensional (3D) microscopy data often is anisotropic with significantly lower resolution (up to 8×) along the z axis than along the xy axes. Computationally generating plausible isotropic resolution from anisotropic imaging data would benefit the visual analysis of large-scale volumes. This paper proposes niiv, a self-supervised method for isotropic reconstruction of 3D microscopy data that can quickly produce images at arbitrary output resolutions. The representation embeds a learned latent code within a neural field that describes the implicit higher-resolution isotropic image region. We use a novel attention-guided latent interpolation approach, which allows flexible information exchange over a local latent neighborhood. Under isotropic volume assumptions, we self-supervise this representation on low-/high-resolution lateral image pairs to reconstruct an isotropic volume from low-resolution axial images. We evaluate our method on simulated and real anisotropic electron (EM) and light microscopy (LM) data. Compared to a state-of-the- art diffusion-based method, niiv shows improved reconstruction quality (+1 dB PSNR) and is over three orders of magnitude faster (1,000×) to infer. Specifically, niiv reconstructs a 128 3 voxel volume in 2/10th of a second, renderable at varying (continuous) high resolutions for display.
BibTeX
@inproceedings{troidl2025niiv,
  author = {Jakob Troidl and Yiqing Liang and Johanna Beyer and Mojtaba Tavakoli and Johann Danzl and Markus Hadwiger and Hanspeter Pfister and James Tompkin},
  title = {{niiv: Interactive Self-supervised Neural Implicit Isotropic Volume Reconstruction}},
  booktitle = {EMA4MICCAI},
  year = {2025},
  doi = {10.1007/978-3-032-13961-0\_26},
}

Loading related content...

Figure