Facial micro-expression recognition based on local region of the key frame

Wenjun Zhong; Xinhe Yu; Ling Shi; Zhihua Xie

doi:10.1117/12.2539437

14 February 2020 Facial micro-expression recognition based on local region of the key frame

Wenjun Zhong, Xinhe Yu, Ling Shi, Zhihua Xie

Proceedings Volume 11430, MIPPR 2019: Pattern Recognition and Computer Vision; 114301L (2020) https://doi.org/10.1117/12.2539437
Event: Eleventh International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2019), 2019, Wuhan, China

Abstract

Traditional studies on micro-expression feature extraction primarily focused on global face from all frames. To improve the efficiency of feature extraction, this paper proposes a new framework based on the local region and the key frame to represent facial micro-expressions. Firstly, the face feature point detection technique is used to acquire the coordinates of the 68 key points, and the region of interest is divided by those key point coordinates and the action unit. Secondly, in order to remove redundant information in the micro-expression video sequence, structural similarity index (SSIM) is used to select key frames for each local region of interest. Finally, the dual-cross patterns (DCP) are extracted for the local regions of interest and are concatenated into a feature vector for the final classification. The experimental results show that compared with the traditional micro-expression method, the proposed method has higher recognition rate and achieves better time computation performance.

Citation Download Citation

Wenjun Zhong, Xinhe Yu, Ling Shi, and Zhihua Xie "Facial micro-expression recognition based on local region of the key frame", Proc. SPIE 11430, MIPPR 2019: Pattern Recognition and Computer Vision, 114301L (14 February 2020); https://doi.org/10.1117/12.2539437

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available