Human performance of face recognition inferred from characteristics of observing eye movement patterns learned by hidden Markov model

Shun Oue; Ryoko Yamada; Shigeru Akamatsu

doi:10.1117/12.2566952

1 June 2020 Human performance of face recognition inferred from characteristics of observing eye movement patterns learned by hidden Markov model

Shun Oue, Ryoko Yamada, Shigeru Akamatsu

Author Affiliations +

Proceedings Volume 11515, International Workshop on Advanced Imaging Technology (IWAIT) 2020; 1151502 (2020) https://doi.org/10.1117/12.2566952
Event: International Workshop on Advanced Imaging Technologies 2020 (IWAIT 2020), 2020, Yogyakarta, Indonesia

Abstract

We investigated the relationship between the face recognition performance of individuals and their eye movement characteristics that were measured while each subject observed the faces that were displayed on a screen. We formulated the statistical nature of their eye movements from a machine-learning perspective by applying a hidden Markov model (HMM). We used a set of computer-generated faces that included both the images of actual faces and synthetic images obtained by slightly transforming the impressions of the original faces. With these visual stimuli, we conducted a simple face recognition experiment, and subjects judged whether they had seen the faces before. We obtained a quantitative hit rate score for each stimulus and subject. We also tracked their eye movements and recorded as temporal chains their eye fixation points using an eye-tracking system. For each class of face stimulus and subject, we estimated the HMM parameters from the training samples of the eye movement. For the given eye movement data as test samples, we conducted a classification test among the pre-defined classes based on the differences of the log-likelihood values obtained from each HMM. Better discrimination of the subjects by the HMM-based classification of the eye movement data corresponded to lower face recognition scores by the subjects, suggesting that individually consistent eye movement patterns may lower the face recognition performance by humans.

Citation Download Citation

Shun Oue, Ryoko Yamada, and Shigeru Akamatsu "Human performance of face recognition inferred from characteristics of observing eye movement patterns learned by hidden Markov model", Proc. SPIE 11515, International Workshop on Advanced Imaging Technology (IWAIT) 2020, 1151502 (1 June 2020); https://doi.org/10.1117/12.2566952

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available