<title>3D virtual colonoscopy with real-time volume rendering</title>

Ming Wan, Wei Li, Kevin Kreeger, Ingmar Bitter, Arie Kaufman, Zhengrong Liang, Dongqing Chen, Mark R. WaxProceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE 2000 · DOI

TL;DR

This paper tackles the challenge of making advanced 3D virtual colonoscopy accessible on low-cost PCs by porting a high-end system to a new PC-based volume rendering board. The authors introduce novel techniques for simulating perspective projection and efficiently rendering large datasets, enabling real-time interactive navigation for mass cancer screening.

What Problem Does This Paper Address?

Colorectal cancer is a significant health concern, often diagnosed late due to the discomfort and cost associated with traditional optical colonoscopy. 3D virtual colonoscopy, using CT scans, offers a less invasive alternative. However, previous high-performance virtual colonoscopy systems were limited to expensive, specialized hardware. The authors aim to bridge this gap by adapting their system to a commercially available, low-cost PC board (VolumePro) to increase its accessibility for widespread screening. The core challenges are that the VolumePro board lacks perspective projection (crucial for realistic navigation) and struggles to render the large datasets typically generated from patient CT scans in real-time.

Methods

The paper proposes two key solutions to overcome the limitations of the VolumePro board:

  • Simulated Perspective Projection: Since the VolumePro board only supports parallel projection, the authors devised a method to simulate perspective projection. This involves dividing the 3D volume into multiple "slabs" along the viewing direction. Each slab is rendered independently, and the resulting images are then composited using alpha blending. To optimize this, they developed an "uniform error" method for determining slab thickness, ensuring that distortion is evenly distributed across the view, leading to more accurate perspective rendering compared to a naive uniform thickness approach.
  • Subvolume Rendering (Axis-Aligned Boxing): To handle large colon datasets that exceed the VolumePro's real-time rendering capacity (limited to 256³ volumes), the authors implemented a subvolume rendering strategy. The entire dataset is divided into smaller, overlapping subvolumes. During navigation, only the subvolumes that are likely to be visible within the current view frustum are loaded and rendered. This significantly reduces the amount of data processed, enabling real-time performance even for larger datasets. They also incorporate a visibility detection algorithm to further optimize which parts of the dataset are loaded.

Datasets

The paper mentions using "patient colon data" which is typically acquired via spiral CT scans. The datasets are described as being "much larger than 256³" and can be up to 512³. The VolumePro board is stated to handle volumes up to 256³ directly.

Key Insights and Ideas

  • Perspective Projection is Paramount: The authors emphasize that perspective projection is not just a visual enhancement but a critical requirement for realistic and intuitive interior colon navigation. Their simulated approach successfully addresses this limitation of the hardware.
  • Adaptive Slab Thickness for Accuracy: The "uniform error" method for determining slab thickness in simulated perspective projection is a key insight. It highlights that simply dividing the volume equally doesn't yield the best results; an adaptive approach based on error distribution is crucial for visual fidelity.
  • Subvolume Rendering for Scalability: The subvolume rendering strategy is a practical solution for handling large medical datasets on hardware with limited memory or processing power. The concept of rendering only relevant portions of the data is a common and effective technique in scientific visualization.
  • Bridging the Gap to Low-Cost PCs: The overarching insight is that advanced visualization techniques, previously confined to high-end workstations, can be made accessible on commodity hardware through clever software solutions and specialized rendering boards.

Key Results

The paper demonstrates that their implemented virtual colonoscopy system on a low-cost PC using the VolumePro board achieves:

  • High Image Quality: The rendered images are comparable in quality to those generated on expensive SGI workstations, thanks to the VolumePro's full lighting model and 3D interpolation.
  • Real-time Interactive Navigation: The proposed solutions for simulated perspective projection and subvolume rendering enable real-time frame rates for interactive navigation within the colon.
  • Improved Rendering Accuracy: Figures 4 and 5 show that the "uniform error" slab thickness method produces images with fewer artifacts compared to the naive uniform thickness method, particularly in areas where soft tissue behind the colon wall might be visible.

Limitations and Future Work

  • Data Duplication in Subvolume Rendering: A significant disadvantage of the subvolume rendering method is the duplication of data due to the 50% overlap between subvolumes. This limits the current version of the VolumePro board to handling volume data up to 256³.
  • Future Work: The authors suggest that combining subvolume rendering with their perspective projection method is a promising direction. They also imply that further optimization of subvolume size and overlap could improve performance and reduce storage requirements. The goal is to make this technology widely available to medical practitioners on low-cost PCs.

Summary updated

Abstract

In our previous work, we developed a virtual colonoscopy system on a high-end 16-processor SGI Challenge with an expensive hardware graphics accelerator. The goal of this work is to port the system to a low cost PC in order to increase its availability for mass screening. Recently, Mitsubishi Electric has developed a volume-rendering PC board, called VolumePro, which includes 128 MB of RAM and vg500 rendering chip. The vg500 chip, based on Cube-4 technology, can render a 256<SUP>3</SUP> volume at 30 frames per second. High image quality of volume rendering inside the colon is guaranteed by the full lighting model and 3D interpolation supported by the vg500 chip. However, the VolumePro board is lacking some features required by our interactive colon navigation. First, VolumePro currently does not support perspective projection which is paramount for interior colon navigation. Second, the patient colon data is usually much larger than 256<SUP>3</SUP> and cannot be rendered in real-time. In this paper, we present our solutions to these problems, including simulated perspective projection and axis aligned boxing techniques, and demonstrate the high performance of our virtual colonoscopy system on low cost PCs.
BibTeX
@inproceedings{wan2000lt,
  author = {Ming Wan and Wei Li and Kevin Kreeger and Ingmar Bitter and Arie Kaufman and Zhengrong Liang and Dongqing Chen and Mark R. Wax},
  title = {{\&lt;title\&gt;3D virtual colonoscopy with real-time volume rendering\&lt;/title\&gt;}},
  booktitle = {Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE},
  year = {2000},
  doi = {10.1117/12.383395},
}
Figure