Classifier performance measures in multifault diagnosis for aircraft engines

Weizhong Yan; Kai Goebel; James C.M. Li

doi:10.1117/12.475498

16 July 2002 Classifier performance measures in multifault diagnosis for aircraft engines

Weizhong Yan, Kai Goebel, James C.M. Li

Proceedings Volume 4733, Component and Systems Diagnostics, Prognostics, and Health Management II; (2002) https://doi.org/10.1117/12.475498
Event: AeroSense 2002, 2002, Orlando, FL, United States

Abstract

Classifier performance evaluation is an important step in designing diagnostic systems. The purposes of performing classifier performance evaluation include: 1) to select the best classifiers from the several candidate classifiers, 2) to verify that the classifier designed meets the design requirement, and 3) to identify the need for improvements in the classifier components. In order to effectively evaluate classifier performance, a classifier performance measure needs to be defined that can be used to measure the goodness of the classifiers considered. This paper first argues that in fault diagnostic system design, commonly used performance measures, such as accuracy and ROC analysis are not always appropriate for performance evaluation. The paper then proposes using misclassification cost as a general performance measure that is suitable for binary as well as multi-class classifiers, and -most importantly- for classifiers with unequal cost consequence of the classes. The paper also provides strategies for estimating the cost matrix by taking advantage of fault criticality information obtained from FMECA. By evaluating the performance of different classifiers considered during the design process of an engine fault diagnostic system, this paper demonstrates that misclassification cost is an effective performance measure for evaluating the performance of multi-class classifiers with unequal cost consequence for different classes.

Citation Download Citation

Weizhong Yan, Kai Goebel, and James C.M. Li "Classifier performance measures in multifault diagnosis for aircraft engines", Proc. SPIE 4733, Component and Systems Diagnostics, Prognostics, and Health Management II, (16 July 2002); https://doi.org/10.1117/12.475498

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available