Polyp segmentation and classification using predicted depth from monocular endoscopy

Faisal Mahmood; Ziyun Yang; Richard Chen; Daniel Borders; Wenhao Xu; Nicholas J. Durr

doi:10.1117/12.2513117

15 March 2019 Polyp segmentation and classification using predicted depth from monocular endoscopy

Faisal Mahmood, Ziyun Yang, Richard Chen, Daniel Borders, Wenhao Xu, Nicholas J. Durr

Proceedings Volume 10950, Medical Imaging 2019: Computer-Aided Diagnosis; 1095011 (2019) https://doi.org/10.1117/12.2513117
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Colorectal cancer is the fourth leading cause of cancer deaths worldwide, the standard for detection and prevention is the identification and removal of premalignant lesions through optical colonoscopy. More than 60% of colorectal cancer cases are attributed to missed polyps. Current procedures for automated polyp detection are limited by the amount of data available for training, underrepresentation of non-polypoid lesions and lesions which are inherently difficult to label and do not incorporate information about the topography of the surface of the lumen. It has been shown that information related to depth and topography of the surface of the lumen can boost subjective lesion detection. In this work, we add predicted depth information as an additional mode of data when training deep networks for polyp detection, segmentation and classification. We use conditional GANs to predict depth from monocular endoscopy images and fuse these predicted depth maps with RGB white light images in feature space. Our empirical analysis demonstrates that we achieve state-of-the-art results with RGB-D polyp segmentation with a 98% accuracy on four different publically available datasets. Moreover, we demonstrate a 87.24% accuracy on lesion classification. We also show that our networks can domain adapt to a variety of different kinds of data from different sources.

Conference Presentation

Citation Download Citation

Faisal Mahmood, Ziyun Yang, Richard Chen, Daniel Borders, Wenhao Xu, and Nicholas J. Durr "Polyp segmentation and classification using predicted depth from monocular endoscopy", Proc. SPIE 10950, Medical Imaging 2019: Computer-Aided Diagnosis, 1095011 (15 March 2019); https://doi.org/10.1117/12.2513117

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available