Hierarchical human action recognition around sleeping using obscured posture information

Yuta Kudo; Takehiko Sashida; Yoshimitsu Aoki

doi:10.1117/12.2182870

30 April 2015 Hierarchical human action recognition around sleeping using obscured posture information

Yuta Kudo, Takehiko Sashida, Yoshimitsu Aoki

Proceedings Volume 9534, Twelfth International Conference on Quality Control by Artificial Vision 2015; 953418 (2015) https://doi.org/10.1117/12.2182870
Event: The International Conference on Quality Control by Artificial Vision 2015, 2015, Le Creusot, France

Abstract

This paper presents a new approach for human action recognition around sleeping with the human body parts locations and the positional relationship between human and sleeping environment. Body parts are estimated from the depth image obtained by a time-of-flight (TOF) sensor using oriented 3D normal vector. Issues in action recognition of sleeping situation are the demand of availability in darkness, and hiding of the human body by duvets. Therefore, the extraction of image features is difficult since color and edge features are obscured by covers. Thus, first in our method, positions of four parts of the body (head, torso, thigh, and lower leg) are estimated by using the shape model of bodily surface constructed by oriented 3D normal vector. This shape model can represent the surface shape of rough body, and is effective in robust posture estimation of the body hidden with duvets. Then, action descriptor is extracted from the position of each body part. The descriptor includes temporal variation of each part of the body and spatial vector of position of the parts and the bed. Furthermore, this paper proposes hierarchical action classes and classifiers to improve the indistinct action classification. Classifiers are composed of two layers, and recognize human action by using the action descriptor. First layer focuses on spatial descriptor and classifies action roughly. Second layer focuses on temporal descriptor and classifies action finely. This approach achieves a robust recognition of obscured human by using the posture information and the hierarchical action recognition.

Citation Download Citation

Yuta Kudo, Takehiko Sashida, and Yoshimitsu Aoki "Hierarchical human action recognition around sleeping using obscured posture information", Proc. SPIE 9534, Twelfth International Conference on Quality Control by Artificial Vision 2015, 953418 (30 April 2015); https://doi.org/10.1117/12.2182870

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available