Regular Articles

Alternative performance index to analyze receiver operating characteristic data under the exponential assumption

[+] Author Affiliations
Francisco J. Sanchez-Marin

Centro de Investigaciones en Optica, Loma del Bosque 115 Col. Lomas del Campestre, Leon, Guanajuato 37150, Mexico

Jose A. Padilla-Medina

Instituto Tecnológico de Celaya, Celaya, Guanajuato 38010, Mexico

J. Electron. Imaging. 15(2), 023009 (April 18, 2006). doi:10.1117/1.2195462
History: Received January 20, 2004; Revised July 15, 2004; Revised December 14, 2004; Accepted December 07, 2005; Published April 18, 2006
Text Size: A A A

Thirty human observers are tested in a visual detection task under the rating receiver operating characteristic (ROC) paradigm. Since most of the observers were not able to use the rating categories as instructed, their data are excluded from the analysis. From the 30 observers, the four best and most experienced are selected to do long experiments (with 1000 presentations). However, the assumption of Gaussians with equal variance of classical ROC theory is not satisfied by the new data. Nevertheless, assuming Gaussian underlying distributions with unequal variances, the three well-known indices of performance dm, de, and dx are calculated in terms of the geometry of the linear fits in normal deviated coordinates. The areas under the ROC curves are also calculated. We found that the power-law ROC, which assumes underlying exponential distributions, fit well our data. Under the exponential-exponential assumption, we derive a new performance (detectability) index that is easily calculated from experimental data and that depends on a single parameter. The obtained values of the proposed index are in agreement with the corresponding values of the dm, de, and dx indices, but with the new index it is much easier to discriminate between observers with similar performance with considerably lower uncertainty.

Figures in this Article
© 2006 SPIE and IS&T

Topics

Receivers

Citation

Francisco J. Sanchez-Marin and Jose A. Padilla-Medina
"Alternative performance index to analyze receiver operating characteristic data under the exponential assumption", J. Electron. Imaging. 15(2), 023009 (April 18, 2006). ; http://dx.doi.org/10.1117/1.2195462


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.