Realistic texture extraction for 3D face models robust to self-occlusion

Chengchao Qu; Eduardo Monari; Tobias Schuchert; Jürgen Beyerer

doi:10.1117/12.2079924

27 February 2015 Realistic texture extraction for 3D face models robust to self-occlusion

Chengchao Qu, Eduardo Monari, Tobias Schuchert, Jürgen Beyerer

Proceedings Volume 9405, Image Processing: Machine Vision Applications VIII; 94050P (2015) https://doi.org/10.1117/12.2079924
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

In the context of face modeling, probably the most well-known approach to represent 3D faces is the 3D Morphable Model (3DMM). When 3DMM is fitted to a 2D image, the shape as well as the texture and illumination parameters are simultaneously estimated. However, if real facial texture is needed, texture extraction from the 2D image is necessary. This paper addresses the possible problems in texture extraction of a single image caused by self-occlusion. Unlike common approaches that leverage the symmetric property of the face by mirroring the visible facial part, which is sensitive to inhomogeneous illumination, this work first generates a virtual texture map for the skin area iteratively by averaging the color of neighbored vertices. Although this step creates unrealistic, overly smoothed texture, illumination stays constant between the real and virtual texture. In the second pass, the mirrored texture is gradually blended with the real or generated texture according to the visibility. This scheme ensures a gentle handling of illumination and yet yields realistic texture. Because the blending area only relates to non-informative area, main facial features still have unique appearance in different face halves. Evaluation results reveal realistic rendering in novel poses robust to challenging illumination conditions and small registration errors.

Citation Download Citation

Chengchao Qu, Eduardo Monari, Tobias Schuchert, and Jürgen Beyerer "Realistic texture extraction for 3D face models robust to self-occlusion", Proc. SPIE 9405, Image Processing: Machine Vision Applications VIII, 94050P (27 February 2015); https://doi.org/10.1117/12.2079924

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available