Deep neural network using color and synthesized three-dimensional shape for face recognition

Seon-Min Rhee; ByungIn Yoo; Jae-Joon Han; Wonjun Hwang

doi:10.1117/1.JEI.26.2.020502

22 March 2017 Deep neural network using color and synthesized three-dimensional shape for face recognition

Seon-Min Rhee, ByungIn Yoo, Jae-Joon Han, Wonjun Hwang

Author Affiliations +

Journal of Electronic Imaging, Vol. 26, Issue 2, 020502 (March 2017). https://doi.org/10.1117/1.JEI.26.2.020502

Abstract

We present an approach for face recognition using synthesized three-dimensional (3-D) shape information together with two-dimensional (2-D) color in a deep convolutional neural network (DCNN). As 3-D facial shape is hardly affected by the extrinsic 2-D texture changes caused by illumination, make-up, and occlusions, it could provide more reliable complementary features in harmony with the 2-D color feature in face recognition. Unlike other approaches that use 3-D shape information with the help of an additional depth sensor, our approach generates a personalized 3-D face model by using only face landmarks in the 2-D input image. Using the personalized 3-D face model, we generate a frontalized 2-D color facial image as well as 3-D facial images (e.g., a depth image and a normal image). In our DCNN, we first feed 2-D and 3-D facial images into independent convolutional layers, where the low-level kernels are successfully learned according to their own characteristics. Then, we merge them and feed into higher-level layers under a single deep neural network. Our proposed approach is evaluated with labeled faces in the wild dataset and the results show that the error rate of the verification rate at false acceptance rate 1% is improved by up to 32.1% compared with the baseline where only a 2-D color image is used.

Citation Download Citation

Seon-Min Rhee, ByungIn Yoo, Jae-Joon Han, and Wonjun Hwang "Deep neural network using color and synthesized three-dimensional shape for face recognition," Journal of Electronic Imaging 26(2), 020502 (22 March 2017). https://doi.org/10.1117/1.JEI.26.2.020502

Received: 10 September 2016; Accepted: 6 March 2017; Published: 22 March 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available