TrIND: Representing Anatomical Trees by Denoising Diffusion of Implicit Neural Fields

Ashish Sinha, Ghassan Hamarneh

Abstract

Representing complex anatomical structures such as blood vessels and airways is a fundamental challenge in medical imaging. Traditional explicit representations like voxel grids are memory-intensive, while meshes often struggle with intricate branching topologies. We introduce TrIND (Trees by Implicit Neural Diffusion), a novel framework that leverages Implicit Neural Representations (INRs) to model anatomical trees. TrIND "overfits" a small Multi-Layer Perceptron (MLP) to each tree instance, acting as a continuous neural occupancy field. Generative modeling is then performed by training a denoising diffusion transformer directly on the flattened weight space of these MLPs. Our approach achieves up to 220× compression compared to volumetric grids and enables high-fidelity, resolution-independent synthesis of diverse anatomical structures. We demonstrate the versatility of TrIND across eight datasets, including intracranial vasculature and bronchial trees.

Introduction

Accurately representing anatomical trees, such as vasculature and bronchial networks, is critical for medical imaging, surgical planning, and fluid dynamics simulations. However, existing methods face significant trade-offs. Voxel grids suffer from $O(n^3)$ memory scaling, making high-resolution modeling prohibitive. Explicit meshes and medial axes often fail to capture the varying, intricate topologies of organic branching. Rule-based systems, like L-systems, lack the organic variability seen in real patient data.

TrIND addresses these issues by moving away from explicit geometry toward a continuous, coordinate-based representation. By modeling trees as neural fields and applying diffusion models to the parameters of these fields, we create a generative pipeline that is both memory-efficient and topologically robust.

Overview of the TrIND framework, illustrating per-instance optimization, isosurface extraction, and the diffusion-based generation of novel tree structures.

Methodology

The TrIND framework consists of a two-stage pipeline: per-sample INR optimization followed by weight-space diffusion.

Stage 1: Learning Per-Sample INRs

Each anatomical tree is represented as an Implicit Neural Representation (INR). We "overfit" a small Multi-Layer Perceptron (MLP) to the occupancy field of an individual tree. Given a 3D coordinate $(x, y, z)$, the MLP outputs the probability of that point being inside the structure. This continuous formulation allows for arbitrary resolution querying, enabling the extraction of smooth surfaces via Marching Cubes without being bound to a fixed grid.

Stage 2: Diffusion in Weight Space

To generate novel structures, we perform generative modeling in the "weight space" of the trained MLPs. The weights and biases of the optimized networks are flattened into 1D vectors. We then train a Denoising Diffusion Model (DDM)—specifically a Diffusion Transformer—on these vectors. To accommodate the multi-layer structure of the MLPs, we decompose the weights into layer-specific tokens before processing them with the transformer. By reversing the diffusion process, the model samples new sets of MLP parameters that represent plausible, novel anatomical trees.

Detailed technical pipeline showing the transition from mesh to point cloud for INR optimization, and the forward/reverse diffusion processes within the transformer architecture.

Results and Key Insights

The framework was evaluated across eight diverse datasets, including synthetic (VascuSynth), intracranial (IntRA, CoW), and clinical data (BraTS, DRIVE, EXACT, WBMRA).

  • Massive Compression: INRs provide a powerful compression mechanism. TrIND achieved up to 220× compression relative to standard volumetric grids while maintaining higher reconstruction accuracy than decimated meshes of equivalent size.
  • Biological Meaning in Weight Space: t-SNE visualizations reveal that the weight space of the MLPs preserves biological characteristics. Models representing trees with similar topological complexity (e.g., number of bifurcations) naturally cluster together.
  • High-Fidelity Synthesis: TrIND consistently outperformed traditional downsampling methods in terms of Chamfer Distance. Generative quality, measured by Minimum Matching Distance (MMD) and Coverage (COV), confirmed that synthesized trees are both diverse and biologically plausible.
  • Resolution Independence: The continuous nature of the representation allows the same model to generate low-resolution previews or high-fidelity meshes for specialized applications like fluid dynamics without retraining.

Conclusion

TrIND demonstrates that denoising diffusion on the parameters of implicit neural fields is a viable and efficient path for modeling complex 3D anatomical structures. While the current implementation requires significant training time (approx. 3 days on an A40 GPU), it offers a proof-of-concept for high-fidelity, compressed, and topologically aware generative modeling. Future work will focus on integrating semantic labeling into the neural fields and embedding TrIND into end-to-end medical segmentation and analysis pipelines.

Summary updated

Abstract

Anatomical trees play a central role in clinical diagnosis and treatment planning. However, accurately representing anatomical trees is challenging due to their varying and complex topology and geometry. Traditional methods for representing tree structures, captured using medical imaging, while invaluable for visualizing vascular and bronchial networks, exhibit drawbacks in terms of limited resolution, flexibility, and efficiency. Recently, implicit neural representations (INRs) have emerged as a powerful tool for representing shapes accurately and efficiently. We propose a novel approach, TrIND, for representing anatomical trees using INR, while also capturing the distribution of a set of trees via denoising diffusion in the space of INRs. We accurately capture the intricate geometries and topologies of anatomical trees at any desired resolution. Through extensive qualitative and quantitative evaluation, we demonstrate high-fidelity tree reconstruction with arbitrary resolution yet compact storage, and versatility across anatomical sites and tree complexities. Our code is available here.
BibTeX
@inproceedings{sinha2024trind,
  author = {Ashish Sinha and Ghassan Hamarneh},
  title = {{TrIND: Representing Anatomical Trees by Denoising Diffusion of Implicit Neural Fields}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2024},
  doi = {10.1007/978-3-031-72390-2\_33},
}
Figure