Action recognition based on virtual simulation for prosthetic vision

Dantong Xu; Ying Zhao; Aiping Yu; Donghui Wang

doi:10.1117/12.2547997

27 November 2019 Action recognition based on virtual simulation for prosthetic vision

Dantong Xu, Ying Zhao, Aiping Yu, Donghui Wang

Proceedings Volume 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence; 113211I (2019) https://doi.org/10.1117/12.2547997
Event: The Second International Conference on Image, Video Processing and Artifical Intelligence, 2019, Shanghai, China

Abstract

For now, even the state-of-the-art of retinal prostheses is limited by low resolution and image processing algorithms. In order to find suitable parameters for prosthetic vision and help visual prosthesis wearers get on well with low-resolution gray-scale image correctly and effectively, the action recognition experiments based on virtual simulation were performed in this paper. Animated videos of skeletonized walking upright were structured in 3ds Max, then the action animation video clips were pixelized by MATLAB. The actions were classified into three categories: combined actions, simple actions and difficult actions. All action clips have 6 resolutions (6×16, 24×24, 32×32, 48×48, 64×64, 128×128). Twenty observers (classified by gender and experience) were recruited to participate in the test. They were asked to recognize actions at different resolutions. The results showed that there was no significant regular pattern of gender difference on the recognition accuracy. As for experience difference, the recognition accuracy of experienced observers was higher than the unexperienced ones. The conclusion was drawing that learning experience can improve recognition accuracy, experienced observers recognized an action requires lower resolution, 48×48 was a suitable resolution which has considerable latent capacity.

Citation Download Citation

Dantong Xu, Ying Zhao, Aiping Yu, and Donghui Wang "Action recognition based on virtual simulation for prosthetic vision", Proc. SPIE 11321, 2019 International Conference on Image and Video Processing, and Artificial Intelligence, 113211I (27 November 2019); https://doi.org/10.1117/12.2547997

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Video

3D modeling

Image resolution

3D image processing

Virtual reality

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years