Surgical skill level assessment using automatic feature extraction methods

Marzieh Ershad; Robert Rege; Ann Majewicz

doi:10.1117/12.2293911

13 March 2018 Surgical skill level assessment using automatic feature extraction methods

Marzieh Ershad, Robert Rege, Ann Majewicz

Proceedings Volume 10576, Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling; 105762W (2018) https://doi.org/10.1117/12.2293911
Event: SPIE Medical Imaging, 2018, Houston, Texas, United States

Abstract

Objective and automatic evaluation of surgical skill is important for the design of surgical simulators used in surgical robotics training. Extensive research has been done to identify and evaluate a variety of evaluation metrics (e.g., path length, completion time); however, these metrics are only provided to the user after completion of the task, and may not fully use the underlying information in the movement data. This study proposes a method for automatic and objective evaluation of surgical expertise levels, in short time intervals, during task performance. We first compare three different automatic feature extraction methods including: (1) principle component analysis (PCA), (2) independent component analysis (ICA), and (3) linear discriminant analysis (LDA) on low-level position data, in their ability to distinguish among different expertise levels. We then study the performance of the best feature extraction method in different time intervals, for the purpose of finding the minimal time frame that accurately predicts user skill level. 14 subjects of different expertise levels were recruited to perform two simulated tasks on the da Vinci training simulator. The position of the subjects’ arm joints (shoulder, elbow and wrist) in the dominant hand, as well as the position of both hands, were recorded. Four classifiers (Naive Bayes, support vector machine, nearest neighbor, and Decision Tree) were used to identify the best feature extraction method. The results indicate that PCA in combination with support vector machine can classify expertise levels with an accuracy of 98% in time frames of 0.25 seconds.

Citation Download Citation

Marzieh Ershad, Robert Rege, and Ann Majewicz "Surgical skill level assessment using automatic feature extraction methods", Proc. SPIE 10576, Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, 105762W (13 March 2018); https://doi.org/10.1117/12.2293911

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available