Inertial sensor aided multi-image nonuniform motion blur removal based on motion decomposition

Ruiwen Zhen; Robert Stevenson

doi:10.1117/1.JEI.27.5.053026

4 October 2018 Inertial sensor aided multi-image nonuniform motion blur removal based on motion decomposition

Ruiwen Zhen, Robert Stevenson

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 5, 053026 (October 2018). https://doi.org/10.1117/1.JEI.27.5.053026

Abstract

Many factors lead to spatially varying blur kernels in a blurred image, such as camera shake, moving objects, and scene depth variation. The traditional camera shake removal methods either ignore the influence of varying depth values or object motion in dynamic scenes, while the methods not limited to removing camera shake always make simple assumptions about camera motion trajectory. We consider these factors in a unified framework, with the aid of an alternate-exposure capture strategy and simultaneously recorded inertial sensor readings. The inertial measurements relate the long-exposed blurred image to preceding and succeeding short-exposed noisy images. The special exposure arrangement effectively addresses the problem inherent in reconstructing camera motion from inertial measurements. In addition, the noisy image pair bracketing the blurred image is used for motion detection and initial depth map estimation, making the proposed method free of user interaction and additional expensive devices. Contrary to previous methods that individually parametrize the motion blur of the moving foreground layer and the static background layer, we exploit the fact that camera shake has a global influence to decompose the motion of the foreground layer such that a more tight constraint between the motion of layers is established. Given the motion and image data, we propose a single-energy model and minimize it using alternating optimization to estimate the spatially varying motion blur and the latent sharp image. Comparative experimental results demonstrate that our method outperforms conventional camera motion deblurring and object deblurring methods on both synthetic and real scenes.

Citation Download Citation

Ruiwen Zhen and Robert Stevenson "Inertial sensor aided multi-image nonuniform motion blur removal based on motion decomposition," Journal of Electronic Imaging 27(5), 053026 (4 October 2018). https://doi.org/10.1117/1.JEI.27.5.053026

Received: 29 March 2018; Accepted: 11 September 2018; Published: 4 October 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available