A comparison of ROC inferred from FROC and conventional ROC

Mark F. McEntee; Stephen Littlefair; Mariusz W. Pietrzyk

doi:10.1117/12.2044341

11 March 2014 A comparison of ROC inferred from FROC and conventional ROC

Mark F. McEntee, Stephen Littlefair, Mariusz W. Pietrzyk

Proceedings Volume 9037, Medical Imaging 2014: Image Perception, Observer Performance, and Technology Assessment; 903718 (2014) https://doi.org/10.1117/12.2044341
Event: SPIE Medical Imaging, 2014, San Diego, California, United States

Abstract

This study aims to determine whether receiver operating characteristic (ROC) scores inferred from free-response receiver operating characteristic (FROC) were equivalent to conventional ROC scores for the same readers and cases. Forty-five examining radiologists of the American Board of Radiology independently reviewed 47 PA chest radiographs under at least two conditions. Thirty-seven cases had abnormal findings and 10 cases had normal findings. Half the readers were asked to first locate any visualized lung nodules, mark them and assign a level of confidence [the FROC mark-rating pair] and second give an overall to the entire image on the same scale [the ROC score]. The second half of readers gave the ROC rating first followed by the FROC mark-rating pairs. A normal image was represented with number 1 and malignant lesions with numbers 2-5. A jackknife free-response receiver operating characteristic (JAFROC), and inferred ROC (infROC) was calculated from the mark-rating pairs using JAFROC V4.1 software. ROC based on the overall rating of the image calculated using DBM MRMC software, which was also used to compare infROC and ROC AUCs treating the methods as modalities. Pearson’s correlations coefficient and linear regression were used to examine their relationship using SPSS, version 21.0; (SPSS, Chicago, IL). The results of this study showed no significant difference between the ROC and Inferred ROC AUCs (p≤0.25). While Pearson’s correlation coefficient was 0.7 (p≤0.01). Inter-reader correlation calculated from Obuchowski- Rockette covariance’s ranged from 0.43-0.86 while intra-reader agreement was greater than previously reported ranging from 0.68-0.82.

Citation Download Citation

Mark F. McEntee, Stephen Littlefair, and Mariusz W. Pietrzyk "A comparison of ROC inferred from FROC and conventional ROC", Proc. SPIE 9037, Medical Imaging 2014: Image Perception, Observer Performance, and Technology Assessment, 903718 (11 March 2014); https://doi.org/10.1117/12.2044341

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Receivers

Binary data

Chest imaging

Medical imaging

Visualization

Image compression

Image visualization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years