Epitomized Summarization of Wireless Capsule Endoscopic Videos for Efficient Visualization

Xinqi Chu, Chee Khun Poh, Liyuan Li, Kap Luk Chan, Shuicheng Yan, Weijia Shen, That Mon Htwe, Jiang Liu, Joo-Hwee Lim, Eng Hui Ong

Introduction

Wireless Capsule Endoscopy (WCE) has transformed the diagnosis of small intestine disorders by providing a non-invasive view of the gastrointestinal (GI) tract. However, the resulting data volume is immense; a typical exam generates approximately 55,000 frames. Manually reviewing these videos is a labor-intensive process for gastroenterologists, often leading to fatigue and potential diagnostic errors. While traditional summarization techniques rely on "key frame" extraction, this risks omitting critical, small-scale lesions. This paper presents a novel "epitomization" approach that condenses video sequences into single summary frames without losing essential visual information.

Methodology: The Epitome Approach

The core of this method is the Epitome, a generative model that creates a miniature, condensed version of a video sequence. Unlike simple frame selection, epitomization "folds" the information from multiple frames into one, ensuring that every patch from the original sequence can be reconstructed from the summary.

Semantic Spatial Priors

To enhance clinical utility, the authors introduced a semantic layer to the epitomization process. A neural network classifies image patches into three categories: suspected tissues (e.g., bleeding, lesions), normal tissues, and non-informative contents (e.g., bubbles, feces).

To guide the doctor's attention, the algorithm employs Gaussian-like spatial distributions to organize the summary frame. As illustrated in Figure 1, "Suspected" patches are prioritized in the center of the epitome, while "Non-informative" patches are relegated to the periphery.

Spatial priors for semantic organization: Suspected tissues (Category 1) are centered to draw clinical attention, while non-informative content (Category 3) is moved to the edges.

Local Context and EM Learning

To prevent the "mushy" appearance common in standard epitomes, a patch-weighting mechanism based on local variance was implemented. This ensures that high-detail areas—critical for diagnosis—are preserved with high fidelity. The parameters are learned using a specialized Expectation-Maximization (EM) algorithm tailored for these constrained sequences.

Results and Discussion

The proposed method was evaluated on 50 sequences from 7 patients, totaling 1,500 frames. The system achieved a significant reduction in clinical workload, compressing the video data by a factor of 10 or more.

Visual comparison: A sequence of original WCE frames (left) is condensed into a semantically organized epitome (right), where pathological features are concentrated and enhanced in the center.

Quantitatively, at a 15:1 reduction rate, the system maintained a Peak Signal-to-Noise Ratio (PSNR) of 25.33 dB, indicating high reconstruction quality. Qualitatively, the "bullseye" organization successfully concentrated suspected bleeding in the center of the summary frames, making abnormalities significantly easier to detect during rapid screening.

Conclusion

By moving from frame selection to information condensation, this epitomization framework offers a powerful tool for streamlining WCE video review. Future work will focus on improving classifier robustness and integrating these summaries into image registration workflows to map lesion locations within the GI tract.

Summary updated

Abstract

A video recording of an examination by Wireless Capsule Endoscopy (WCE) may typically contain more than 55,000 video frames, which makes the manual visual screening by an experienced gastroenterologist a highly time-consuming task. In this paper, we propose a novel method of epitomized summarization of WCE videos for efficient visualization to a gastroenterologist. For each short sequence of a WCE video, an epitomized frame is generated. New constraints are introduced into the epitome formulation to achieve the necessary visual quality for manual examination, and an EM algorithm for learning the epitome is derived. First, the local context weights are introduced to generate the epitomized frame. The epitomized frame preserves the appearance of all the input patches from the frames of the short sequence. Furthermore, by introducing spatial distributions for semantic interpretation of image patches in our epitome formulation, we show that it also provides a framework to facilitate the semantic description of visual features to generate organized visual summarization of WCE video, where the patches in different positions correspond to different semantic information. Our experiments on real WCE videos show that, using epitomized summarization, the number of frames have to be examined by the gastroenterologist can be reduced to less than one-tenth of the original frames in the video.
BibTeX
@inproceedings{chu2010epitomized,
  author = {Xinqi Chu and Chee Khun Poh and Liyuan Li and Kap Luk Chan and Shuicheng Yan and Weijia Shen and That Mon Htwe and Jiang Liu and Joo-Hwee Lim and Eng Hui Ong},
  title = {{Epitomized Summarization of Wireless Capsule Endoscopic Videos for Efficient Visualization}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2010},
  doi = {10.1007/978-3-642-15745-5\_64},
}
Figure