Anatomy segmentation evaluation with sparse ground truth data

Jieyu Li; Jayaram K. Udupa; Yubing Tong; Lisheng Wang; Drew A. Torigian

doi:10.1117/12.2549327

10 March 2020 Anatomy segmentation evaluation with sparse ground truth data

Jieyu Li, Jayaram K. Udupa, Yubing Tong, Lisheng Wang, Drew A. Torigian

Proceedings Volume 11313, Medical Imaging 2020: Image Processing; 113131G (2020) https://doi.org/10.1117/12.2549327
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

The performance and evaluation of segmentation algorithms will benefit from large fully annotated data sets, but the heavy workload of manual contouring is unrealistic in clinical and research practice. In this work, we propose a method of automatically creating pseudo ground truth (p-GT) segmentations of anatomical objects from given sparse manually annotated slices and utilize them to evaluate actual segmentations. Sparse slices are selected spatially evenly on the whole slice range of the target object, where one slice is selected to conduct manual annotation and the next t slices are skipped, repeating this process starting from one end of the object to its other end. A shape-based interpolation (SI) strategy and an object-specific 2D U-net based deep learning (DL) strategy are investigated to create p-GT. The largest t value where the created p-GT is considered to be not statistically significantly different from the actual ground with its natural imprecision due to variability in manually specified ground truth is determined as the optimal t for the considered object. Experiments are conducted on ~300 computed tomography (CT) studies involving two objects – cervical esophagus and mandible and two segmentation evaluation metrics – Dice Coefficient and average symmetric boundary distance. Results show that the DL strategy overwhelmingly outperforms the SI strategy, where ~95% and ~66-83% of manual workload can be reduced without sacrificing evaluation accuracy compared to actual ground truth data via the DL and SI strategies respectively. Furthermore, the p-GT with optimal t is able to evaluate actual segmentations with accurate metric values.

Conference Presentation

Citation Download Citation

Jieyu Li, Jayaram K. Udupa, Yubing Tong, Lisheng Wang, and Drew A. Torigian "Anatomy segmentation evaluation with sparse ground truth data", Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 113131G (10 March 2020); https://doi.org/10.1117/12.2549327

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available