IDDF2018-ABS-0253 A deep learning method for intestinal position locating in wce

Liansheng Wang, Qi QiuClinical 2018 · DOI

The Context Problem in WCE

Wireless Capsule Endoscopy (WCE) provides a non-invasive method for visualizing the entire gastrointestinal (GI) tract. However, a single WCE procedure can generate upwards of 60,000 images, creating a massive data burden for clinicians. While automated diagnostic systems are being developed to identify abnormalities, they face a fundamental "context" challenge: the clinical significance of a finding often depends on its location.

For example, visible blood vessels are a normal anatomical feature in the ileum but are considered pathological in the duodenum or upper jejunum. Similarly, the presence of bile is expected in the duodenum but indicates bile reflux if found in the stomach. Therefore, accurate anatomical localization—identifying whether the capsule is in the esophagus, stomach, or small intestine—is a critical prerequisite for any reliable automated detection system.

Methodology: Dense CNNs and Temporal Logic

To address this, researchers developed a system based on a dense, connected convolutional neural network (CNN). Dense connections improve feature propagation and efficiency, which is vital for processing the high volume of images generated by WCE.

The classification pipeline categorized images into four primary classes:

  1. Esophagus
  2. Stomach
  3. Small Intestine
  4. Others (e.g., images outside the target GI segments)

Notably, the system does not need to distinguish between the esophagus and the small intestine directly, as the capsule follows a fixed linear path through the gut. A key innovation in this approach was the use of temporal correction. By leveraging the "continuity of the intestine," the researchers could refine the model's output. This allowed the system to correct isolated misclassifications—such as a single "stomach" frame appearing in a long sequence of "small intestine" frames—based on the logical progression of the capsule.

Dataset and Training

The model was trained and validated using a large-scale dataset from several hospitals:

  • Data Volume: Complete WCE videos from 16 patients, totaling nearly one million images.
  • Ground Truth: Images were manually labeled by a professional gastroenterologist.
  • Evaluation Split: A patient-level split was used, with 10 videos (60%) for training and 6 videos (40%) for testing, ensuring the model's ability to generalize to new patients.

Results and Performance

The dense CNN achieved high accuracy across all target segments. The model was particularly effective at distinguishing between adjacent organs, which is often the most challenging task due to transitional mucosal features.

Classification Task Accuracy Specificity Sensitivity
Esophagus vs. Stomach 98.91% 99.78% 98.47%
Stomach vs. Small Intestine 99.22% 99.17% 99.23%
Overall (ESO/STO/Small Intes) 98.8% - -
Figure 1: Visual comparison of original WCE frames (origin), expert-labeled ground truth, and the model's predicted segmentation.

The overall accuracy of 98.8% demonstrates that deep learning can effectively capture the subtle mucosal textures and structural differences that define different GI segments.

Challenges and Future Directions

Despite the high performance, two main challenges were identified:

  1. Anatomical Junctions: Misclassifications were most frequent at the junctions between organs (e.g., the gastroesophageal junction), where the tissue naturally exhibits characteristics of both regions.
  2. Intestinal Cleanliness: The presence of food residue or fecal matter can obscure the intestinal wall, making it difficult for the CNN to determine the capsule's location.

Future work will focus on improving robustness against visual obstructions and expanding the model to include the large intestine. Ultimately, this localization framework will serve as the foundation for comprehensive systems capable of automatically detecting specific pathologies like ulcers, polyps, and bleeding with high contextual accuracy.

Summary updated

Abstract

<h3>Background</h3> In a wireless capsule endoscopy (WCE) abnormal automatic detection system, the same image content may have different meanings in different locations. For example, visible blood vessels are usual in ileum but abnormal in the duodenum and upper jejunum, and bile is normal in the duodenum but indicating bile reflux in the stomach, as shown in figure 1. Therefore, the essential first step of building this system is to locate the intestinal position of the image. <h3>Methods</h3> To tackle this problem, a dense, connected convolution neural network (CNN) was adopted. The data were collected from several hospitals, consist of complete WCE videos of 16 patients, which has an average of 60 000 images per video. Those images were classified into four classes: oesophagus, stomach, small intestine and others by a gastroenterologist. The images before oesophagus part and after small intestine part were excluded because the large intestine disease is not the goal of the WCE. <h3>Results</h3> We used images of 10 videos (60%) for training and the rest 6 videos (40%) for testing. The performances are shown in table 1. We do not classify oesophagus vs. small intestine because of the order of WCE passing through the human gut. Due to the intestinal of patients are not clean enough, some images were fulfilled with food residue or faecal residue, which leads to the inability to determine its location. Rest of the misclassified samples are almost located at the junction of two parts because the intestinal wall of these places contains the characteristics of the front and back parts. <h3>Conclusions</h3> The CNNs show the great ability to distinguish the WCE images belongs to the oesophagus, stomach or small intestine. Some misclassified results were corrected based on the continuity of intestine for more robust performance, which will benefit the WCE abnormal automatic detection system behind.
BibTeX
@inproceedings{wang2018iddf,
  author = {Liansheng Wang and Qi Qiu},
  title = {{IDDF2018-ABS-0253 A deep learning method for intestinal position locating in wce}},
  booktitle = {Clinical},
  year = {2018},
  doi = {10.1136/gutjnl-2018-iddfabstracts.176},
}
Figure