Photoshopping Colonoscopy Video Frames
Lists
Only you see this
Abstract
The automatic detection of frames containing polyps from a colonoscopy video sequence is an important first step for a fully automated colonoscopy analysis tool. Typically, such detection system is built using a large annotated data set of frames with and without polyps, which is expensive to be obtained. In this paper, we introduce a new system that detects frames containing polyps as anomalies from a distribution of frames from exams that do not contain any polyps. The system is trained using a one-class training set consisting of colonoscopy frames without polyps - such training set is considerably less expensive to obtain, compared to the 2-class data set mentioned above. During inference, the system is only able to reconstruct frames without polyps, and when it tries to reconstruct a frame with polyp, it automatically removes (i.e., photoshop) it from the frame - the difference between the input and reconstructed frames is used to detect frames with polyps. We name our proposed model as anomaly detection generative adversarial network (ADGAN), comprising a dual GAN with two generators and two discriminators. To test our framework, we use a new colonoscopy data set with 14317 images, split as a training set with 13350 images without polyps, and a testing set with 290 abnormal images containing polyps and 677 normal images without polyps. We show that our proposed approach achieves the state-of-the-art result on this data set, compared with recently proposed anomaly detection systems.
BibTeX
@inproceedings{liu2020photoshopping,
author = {Yuyuan Liu and Yu Tian and Gabriel Maicas and Leonardo Zorron Cheng Tao Pu and Rajvinder Singh and Johan W. Verjans and Gustavo Carneiro},
title = {{Photoshopping Colonoscopy Video Frames}},
booktitle = {ISBI},
year = {2020},
doi = {10.1109/isbi45749.2020.9098406},
}