Robust smile detection using convolutional neural networks

Simone Bianco; Luigi Celona; Raimondo Schettini

doi:10.1117/1.JEI.25.6.063002

14 November 2016 Robust smile detection using convolutional neural networks

Simone Bianco, Luigi Celona, Raimondo Schettini

Author Affiliations +

Journal of Electronic Imaging, Vol. 25, Issue 6, 063002 (November 2016). https://doi.org/10.1117/1.JEI.25.6.063002

Abstract

We present a fully automated approach for smile detection. Faces are detected using a multiview face detector and aligned and scaled using automatically detected eye locations. Then, we use a convolutional neural network (CNN) to determine whether it is a smiling face or not. To this end, we investigate different shallow CNN architectures that can be trained even when the amount of learning data is limited. We evaluate our complete processing pipeline on the largest publicly available image database for smile detection in an uncontrolled scenario. We investigate the robustness of the method to different kinds of geometric transformations (rotation, translation, and scaling) due to imprecise face localization, and to several kinds of distortions (compression, noise, and blur). To the best of our knowledge, this is the first time that this type of investigation has been performed for smile detection. Experimental results show that our proposal outperforms state-of-the-art methods on both high- and low-quality images.

Citation Download Citation

Simone Bianco, Luigi Celona, and Raimondo Schettini "Robust smile detection using convolutional neural networks," Journal of Electronic Imaging 25(6), 063002 (14 November 2016). https://doi.org/10.1117/1.JEI.25.6.063002

Published: 14 November 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available