Inpainting for videos with dynamic objects using texture and structure reconstruction

V. V. Voronin; V. I. Marchuk; N. V. Gapon; A. V. Zhuravlev; S. Maslennikov; S. Stradanchenko

doi:10.1117/12.2076509

21 May 2015 Inpainting for videos with dynamic objects using texture and structure reconstruction

V. V. Voronin, V. I. Marchuk, N. V. Gapon, A. V. Zhuravlev, S. Maslennikov, S. Stradanchenko

Proceedings Volume 9497, Mobile Multimedia/Image Processing, Security, and Applications 2015; 94970Y (2015) https://doi.org/10.1117/12.2076509
Event: SPIE Sensing Technology + Applications, 2015, Baltimore, MD, United States

Abstract

This paper describes a novel inpainting approach for removing marked dynamic objects from videos captured with a camera, so long as the objects occlude parts of the scene with a static background. Proposed approach allow to remove objects or restore missing or tainted regions present in a video sequence by utilizing spatial and temporal information from neighboring scenes. The algorithm iteratively performs following operations: achieve frame; update the scene model; update positions of moving objects; replace parts of the frame occupied by the objects marked for remove with use of a background model. In this paper, we extend an image inpainting algorithm based texture and structure reconstruction by incorporating an improved strategy for video. An image inpainting approach based on the construction of a composite curve for the restoration of the edges of objects in a frame using the concepts of parametric and geometric continuity is presented. It is shown that this approach allows to restore the curved edges and provide more flexibility for curve design in damaged frame by interpolating the boundaries of objects by cubic splines. After edge restoration stage, a texture reconstruction using patch-based method is carried out. We demonstrate the performance of a new approach via several examples, showing the effectiveness of our algorithm and compared with state-of-the-art video inpainting methods.

Citation Download Citation

V. V. Voronin, V. I. Marchuk, N. V. Gapon, A. V. Zhuravlev, S. Maslennikov, and S. Stradanchenko "Inpainting for videos with dynamic objects using texture and structure reconstruction", Proc. SPIE 9497, Mobile Multimedia/Image Processing, Security, and Applications 2015, 94970Y (21 May 2015); https://doi.org/10.1117/12.2076509

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available