Video summarization using descriptors of motion activity: a motion activity based approach to key-frame extraction from video shots

Ajay Divakaran; Regunathan Radhakrishnan; Kadir A. Peker

doi:10.1117/1.1406507

1 October 2001 Video summarization using descriptors of motion activity: a motion activity based approach to key-frame extraction from video shots

Ajay Divakaran, Regunathan Radhakrishnan, Kadir A. Peker

Author Affiliations +

Journal of Electronic Imaging, Vol. 10, Issue 4, (October 2001). https://doi.org/10.1117/1.1406507

We describe a video summarization technique that uses motion descriptors computed in the compressed domain. It can either speed up conventional color-based video summarization techniques, or rapidly generate a key-frame based summary by itself. The basic hypothesis of the work is that the intensity of motion activity of a video segment is a direct indication of its ‘‘summarizability,’’ which we experimentally verify using the MPEG-7 [MPEG-7 Visual Committee Draft URL: http://www.cselt.it/mpeg/working documents. htm official MPEG site] motion activity descriptor and the fidelity measure proposed in H. S. Chang, S. Sull, and S. U. Lee, ‘‘Efficient video indexing scheme for content-based retrieval,’’ IEEE Trans. Circuits Syst. Video Technol. 9(8), (1999). Note that the compressed domain extraction of motion activity intensity is much simpler than the color-based calculations. We are thus able to quickly identify easy to summarize segments of a video sequence since they have a low intensity of motion activity. We are able to easily summarize these segments by simply choosing their first frames. We can then apply conventional color-based summarization techniques to the remaining segments. We thus speed up color-based summarization by reducing the number of segments processed. Our results also motivate a simple and novel key-frame extraction technique that relies on a motion activity based nonuniform sampling of the frames. Our results indicate that it can either be used by itself or to speed up color-based techniques as explained earlier.

©(2001) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Ajay Divakaran, Regunathan Radhakrishnan, and Kadir A. Peker "Video summarization using descriptors of motion activity: a motion activity based approach to key-frame extraction from video shots," Journal of Electronic Imaging 10(4), (1 October 2001). https://doi.org/10.1117/1.1406507

Published: 1 October 2001

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available