Audio-visual affective expression recognition

Thomas S. Huang; Zhihong Zeng

doi:10.1117/12.782299

15 November 2007 Audio-visual affective expression recognition

Thomas S. Huang, Zhihong Zeng

Proceedings Volume 6788, MIPPR 2007: Pattern Recognition and Computer Vision; 678802 (2007) https://doi.org/10.1117/12.782299
Event: International Symposium on Multispectral Image Processing and Pattern Recognition, 2007, Wuhan, China

Abstract

Automatic affective expression recognition has attracted more and more attention of researchers from different disciplines, which will significantly contribute to a new paradigm for human computer interaction (affect-sensitive interfaces, socially intelligent environments) and advance the research in the affect-related fields including psychology, psychiatry, and education. Multimodal information integration is a process that enables human to assess affective states robustly and flexibly. In order to understand the richness and subtleness of human emotion behavior, the computer should be able to integrate information from multiple sensors. We introduce in this paper our efforts toward machine understanding of audio-visual affective behavior, based on both deliberate and spontaneous displays. Some promising methods are presented to integrate information from both audio and visual modalities. Our experiments show the advantage of audio-visual fusion in affective expression recognition over audio-only or visual-only approaches.

Citation Download Citation

Thomas S. Huang and Zhihong Zeng "Audio-visual affective expression recognition", Proc. SPIE 6788, MIPPR 2007: Pattern Recognition and Computer Vision, 678802 (15 November 2007); https://doi.org/10.1117/12.782299

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available