Quality Control by Artificial Vision

Practical use of receiver operating characteristic analysis to assess the performances of defect detection algorithms

[+] Author Affiliations
Yann Le Meur

Trixell, 38430 Moirans, France

Jean-Michel Vignolle

Trixell, 38430 Moirans, France

Jocelyn Chanussot

GIPSA-Lab, Department Image et Signaux, 38402 Saint Martin d’Heres, France

J. Electron. Imaging. 17(3), 031104 (July 09, 2008). doi:10.1117/1.2952590
History: Received August 01, 2007; Revised February 13, 2008; Accepted February 13, 2008; Published July 09, 2008
Text Size: A A A

Defect detection in images is a current task in quality control and is often integrated in partially or fully automated systems. Assessing the performances of defect detection algorithms is thus of great interest. However, because this is application- and context-dependent, it remains a difficult task. We describe a methodology to measure the performances of such algorithms on large images in a semi-automated defect inspection situation. Considering standard problems occurring in real cases, we compare typical performance evaluation methods. This analysis leads to the construction of a simple and practical receiver operating characteristic (ROC) based method. This method extends the pixel-level ROC analysis to an object-based approach by dilating the ground truth and the set of detected pixels before calculating the true-positive and false-positive rates. These dilations are computed thanks to the a priori knowledge of a human-defined ground truth and gives to true-positive and false-positive rates more consistent values in the semi-automated inspection context. Moreover, the dilation process is designed to be automatically suited to the object’s shape in order to be applied on all types of defects without any parameter to be tuned.

© 2008 SPIE and IS&T

Citation

Yann Le Meur ; Jean-Michel Vignolle and Jocelyn Chanussot
"Practical use of receiver operating characteristic analysis to assess the performances of defect detection algorithms", J. Electron. Imaging. 17(3), 031104 (July 09, 2008). ; http://dx.doi.org/10.1117/1.2952590


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.