A method for realizing real-time abnormal behavior recognition based on compressed video

Yunfei Cheng; Wu Wang; Yuexia Liu

doi:10.1117/12.2655744

9 January 2023 A method for realizing real-time abnormal behavior recognition based on compressed video

Yunfei Cheng, Wu Wang, Yuexia Liu

Proceedings Volume 12507, Advanced Optical Manufacturing Technologies and Applications 2022; and 2nd International Forum of Young Scientists on Advanced Optical Manufacturing (AOMTA and YSAOM 2022); 125071G (2023) https://doi.org/10.1117/12.2655744
Event: 2nd International Forum of Young Scientists on Advanced Optical Manufacturing (AOMTA and YSAOM 2022), 2022, Changchun, China

Abstract

A robust algorithm is proposed for real-time abnormal behavior recognition in dynamic challenge including illumination change and pose variations. To cope with these factors, we present a new method through segmented sampling processing evenly divides the original video into several fragments and according to a certain sampling density, the description of one I frame and the description information of several P frames are obtained from each video clip. Through the Res2Net18 network, a behavior classifier based on the cumulative motion vector of P frames and a behavior classifier based on the cumulative residuals of P frames are built. The various frame information extracted from each video clip is entered into the corresponding network, and each network outputs a classification score. According to the type of frame information entered, the classification score based on each type of input in all video clips is summed and averaged, and the classification score based on each type of input is obtained at the original video level. The ensemble is carried out by means of weighted summation, and the total classification score is obtained as the output of the abnormal behavior recognition network. Experimental results on benchmark datasets demonstrate that the proposed method performs robustly and favorably.

Citation Download Citation

Yunfei Cheng, Wu Wang, and Yuexia Liu "A method for realizing real-time abnormal behavior recognition based on compressed video", Proc. SPIE 12507, Advanced Optical Manufacturing Technologies and Applications 2022; and 2nd International Forum of Young Scientists on Advanced Optical Manufacturing (AOMTA and YSAOM 2022), 125071G (9 January 2023); https://doi.org/10.1117/12.2655744

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available