niiv: Interactive Self-supervised Neural Implicit Isotropic Volume Reconstruction
Lists
Only you see this
Abstract
Abstract Three-dimensional (3D) microscopy data often is anisotropic with significantly lower resolution (up to 8×) along the z axis than along the xy axes. Computationally generating plausible isotropic resolution from anisotropic imaging data would benefit the visual analysis of large-scale volumes. This paper proposes niiv, a self-supervised method for isotropic reconstruction of 3D microscopy data that can quickly produce images at arbitrary output resolutions. The representation embeds a learned latent code within a neural field that describes the implicit higher-resolution isotropic image region. We use a novel attention-guided latent interpolation approach, which allows flexible information exchange over a local latent neighborhood. Under isotropic volume assumptions, we self-supervise this representation on low-/high-resolution lateral image pairs to reconstruct an isotropic volume from low-resolution axial images. We evaluate our method on simulated and real anisotropic electron (EM) and light microscopy (LM) data. Compared to a state-of-the- art diffusion-based method, niiv shows improved reconstruction quality (+1 dB PSNR) and is over three orders of magnitude faster (1,000×) to infer. Specifically, niiv reconstructs a 128 3 voxel volume in 2/10th of a second, renderable at varying (continuous) high resolutions for display.
BibTeX
@inproceedings{troidl2025niiv,
author = {Jakob Troidl and Yiqing Liang and Johanna Beyer and Mojtaba R. Tavakoli and Johann G. Danzl and Markus Hadwiger and Hanspeter Pfister and James Tompkin},
title = {{niiv: Interactive Self-supervised Neural Implicit Isotropic Volume Reconstruction}},
booktitle = {EMA4MICCAI},
year = {2025},
doi = {10.1007/978-3-032-13961-0\_26},
}Loading related content...