JEI Letters

Deep neural network using color and synthesized three-dimensional shape for face recognition

[+] Author Affiliations
Seon-Min Rhee, Jae-Joon Han

Samsung Advanced Institute of Technology, Suwon City, Republic of Korea

ByungIn Yoo

Samsung Advanced Institute of Technology, Suwon City, Republic of Korea

Korea Advanced Institute of Science and Technology, Department of Electrical Engineering, Daejeon City, Republic of Korea

Wonjun Hwang

Ajou University, Department of Software and Computer Engineering, Suwon City, Republic of Korea

J. Electron. Imaging. 26(2), 020502 (Mar 22, 2017). doi:10.1117/1.JEI.26.2.020502
History: Received September 10, 2016; Accepted March 6, 2017
Text Size: A A A

Abstract.  We present an approach for face recognition using synthesized three-dimensional (3-D) shape information together with two-dimensional (2-D) color in a deep convolutional neural network (DCNN). As 3-D facial shape is hardly affected by the extrinsic 2-D texture changes caused by illumination, make-up, and occlusions, it could provide more reliable complementary features in harmony with the 2-D color feature in face recognition. Unlike other approaches that use 3-D shape information with the help of an additional depth sensor, our approach generates a personalized 3-D face model by using only face landmarks in the 2-D input image. Using the personalized 3-D face model, we generate a frontalized 2-D color facial image as well as 3-D facial images (e.g., a depth image and a normal image). In our DCNN, we first feed 2-D and 3-D facial images into independent convolutional layers, where the low-level kernels are successfully learned according to their own characteristics. Then, we merge them and feed into higher-level layers under a single deep neural network. Our proposed approach is evaluated with labeled faces in the wild dataset and the results show that the error rate of the verification rate at false acceptance rate 1% is improved by up to 32.1% compared with the baseline where only a 2-D color image is used.

Figures in this Article
© 2017 SPIE and IS&T

Citation

Seon-Min Rhee ; ByungIn Yoo ; Jae-Joon Han and Wonjun Hwang
"Deep neural network using color and synthesized three-dimensional shape for face recognition", J. Electron. Imaging. 26(2), 020502 (Mar 22, 2017). ; http://dx.doi.org/10.1117/1.JEI.26.2.020502


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.