Real-time video mosaicking robust to dynamic scenes

Nan Jiang; Glen Abousleman; Jennie Si

doi:10.1117/12.665880

5 May 2006 Real-time video mosaicking robust to dynamic scenes

Nan Jiang, Glen Abousleman, Jennie Si

Proceedings Volume 6209, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III; 620907 (2006) https://doi.org/10.1117/12.665880
Event: Defense and Security Symposium, 2006, Orlando (Kissimmee), Florida, United States

Abstract

This paper presents a system for creating a mosaic image from a sequence of images with moving objects present in the scene. This system first uses SIFT-based image registration on the entire image to obtain the initial global projection matrix. After image segmentation, the global motion model is applied to each region for evaluation. The transformation matrix is refined for best projection in each region, and a more precise global transformation matrix is calculated based upon local projections on majority of coherent regions. As a consequence this method is robust to disturbances to the projection model induced by moving objects and motion parallax. In the image blending stage, pixels in coherent regions are weighted by their distances from the overlapping edges to achieve a seamless panorama, while heterogeneous regions are cut and pasted to avoid ghosting or blurring. The most recent information regarding location, shape, and size of the moving foreground objects is therefore reflected in the panorama. Constructed mosaics are presented to demonstrate the performance and robustness of the proposed algorithm.

Citation Download Citation

Nan Jiang, Glen Abousleman, and Jennie Si "Real-time video mosaicking robust to dynamic scenes", Proc. SPIE 6209, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III, 620907 (5 May 2006); https://doi.org/10.1117/12.665880

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available