Void Space Surfaces to Convey Depth in Vessel Visualizations

Julian Kreiser, Pedro Hermosilla, Timo Ropinski

TL;DR

Researchers have developed "Void Space Surfaces" (VSS), a novel visualization technique that communicates the depth of complex 3D vascular trees by utilizing the empty space between branches. By shifting depth cues (like color and topographic lines) to an interpolated background surface, the vessel walls are left "clean," allowing doctors to overlay critical functional data like blood flow or pressure without visual clutter.

What Problem Does This Paper Address?

Visualizing 3D vascular structures (like the branching arteries in a brain or liver) is notoriously difficult. Because these structures are complex and overlapping, it is hard for a viewer to tell which branch is in front of another.

Standard techniques often use "Chromadepth"—coding depth into color (e.g., red is close, blue is far). While effective, this creates a major conflict: if the color of the vessel is already being used to show depth, you can't use it to show anything else. In medical contexts, surgeons often need to see "functional parameters" on the vessel surface, such as wall shear stress or blood pressure. Current methods force a trade-off between understanding the 3D shape and seeing the underlying medical data.

Methods

The authors propose Void Space Surfaces (VSS). Instead of coloring the vessels, they create an artificial surface that fills the "voids" between them.

  1. Surface Generation: The system takes the 3D depth map of the vessels and identifies the silhouettes. It then uses Inverse Distance Weighting (IDW) to interpolate a smooth "height field" or surface in the empty spaces between these silhouettes.
  2. Depth Anchoring: To prevent the vessels from looking like they are floating disconnectedly above a background, the authors use Screen Space Ambient Occlusion (SSAO). This creates subtle shadows where the vessels "meet" the VSS, effectively "gluing" them together visually.
  3. Perceptual Enhancements: Once the background surface is generated, they apply various cues to it:
  4. Pseudo-Chromadepth: A red-to-blue color scale applied only to the background.
  5. Iso-lines: Topographic contour lines that help the eye track changes in depth across the empty space.
  6. Illumination: Global illumination effects that highlight the "valleys" and "peaks" of the void surface.
  7. GPU Pipeline: The entire process is implemented on the GPU, allowing for interactive, real-time manipulation of the 3D models.

Datasets

The study utilized six different vascular models representing various complex vessel trees. For the evaluation phase, they conducted a user study with 20 participants (university population) to compare VSS against traditional baselines and direct vessel coloring.

Key Insights and Ideas

  • The "Indirection" Strategy: The core insight is that the human brain can infer the depth of an object by looking at the surface it is "attached" to. By moving the "data-heavy" depth cues to the background, the foreground remains a blank canvas for other information.
  • Topographic Intuition: Using iso-lines (similar to a hiking map) on the void surface allows users to judge relative depth between two distant branches more accurately than color alone.
  • Color Preservation: By using a monochromatic or limited color scale for the VSS, the authors ensure that the high-saturation colors on the vessels themselves (representing blood flow, etc.) remain distinct and readable.

Key Results

  • Accuracy: The user study showed that VSS is significantly more accurate for depth judgment than a neutral baseline (plain shading). Crucially, it performed on par with direct vessel coloring in terms of accuracy.
  • Response Time: Participants were slightly slower when using VSS compared to direct vessel coloring. The authors attribute this to "indirection"—the eye has to look at the space next to the vessel to confirm its depth, rather than looking at the vessel itself.
  • Multi-modal Success: Qualitative results (see Fig. 11 in the paper) demonstrate that VSS allows for the simultaneous display of depth and functional parameters (like flow velocity) with much higher clarity than previous state-of-the-art methods.
  • Performance: The GPU implementation achieved interactive frame rates, ranging from 25ms to 165ms per frame depending on the complexity of the view and the "step size" used for interpolation.

Limitations and Future Work

  • Density Constraints: VSS relies on having "voids." In extremely dense vascular clusters where there is no empty space between branches, the technique has nothing to interpolate and fails to provide cues.
  • Background Occlusion: If one vessel is directly in front of another such that they share no "void" space between their silhouettes, VSS cannot help; the user must rely on standard occlusion and shading.
  • Future Directions: The authors suggest using eye-tracking to better understand how users scan these surfaces. They also see potential for VSS in other medical areas, such as visualizing rib cages or planning needle placements for tumor ablation, where depth perception in "empty" space is critical.

Summary updated

Abstract

To enhance depth perception and thus data comprehension, additional depth cues are often used in 3D visualizations of complex vascular structures. There is a variety of different approaches described in the literature, ranging from chromadepth color coding over depth of field to glyph-based encodings. Unfortunately, the majority of existing approaches suffers from the same problem: As these cues are directly applied to the geometry's surface, the display of additional information on the vessel wall, such as other modalities or derived attributes, is impaired. To overcome this limitation we propose Void Space Surfaces which utilizes empty space in between vessel branches to communicate depth and their relative positioning. This allows us to enhance the depth perception of vascular structures without interfering with the spatial data and potentially superimposed parameter information. With this article, we introduce Void Space Surfaces, describe their technical realization, and show their application to various vessel trees. Moreover, we report the outcome of two user studies which we have conducted in order to evaluate the perceptual impact of Void Space Surfaces compared to existing vessel visualization techniques and discuss expert feedback.
BibTeX
@article{kreiser2021void,
  author = {Julian Kreiser and Pedro Hermosilla and Timo Ropinski},
  title = {{Void Space Surfaces to Convey Depth in Vessel Visualizations}},
  journal = {IEEE Trans. Vis. Comput. Graph.},
  year = {2021},
  url = {https://openreview.net/forum?id=OONPlFvAFG},
}

Loading related content...

Figure