Multiframe super resolution based on block motion vector processing and kernel constrained convex set projection

Miao Liu; Yuzhong Shen

doi:10.1117/12.805742

19 January 2009 Multiframe super resolution based on block motion vector processing and kernel constrained convex set projection

Miao Liu, Yuzhong Shen

Author Affiliations +

Proceedings Volume 7257, Visual Communications and Image Processing 2009; 72571J (2009) https://doi.org/10.1117/12.805742
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

Even though substantial progress has been made in super resolution research, many issues regarding robust sub-pixel estimation and fast implementation of feature preserving restoration still exist. To obtain more reliable sub-pixel information, we proposed to correct mis-aligned sub-pixels by motion vector (MV) processing based on hierarchical block partition and weighted vector median filtering (WVMF). Two indices - relative displaced frame difference and motion vector similarity degree - are computed and compared with trained thresholds to classify the motion blocks into reliable and unreliable groups. Then the unreliable blocks are divided into four sub-blocks with their motion vector processed by WVMF based on the reliability information of their neighborhood blocks. To preserve the local features such as edge direction, strength as well as its spread region, anisotropic kernels are learned from local gradient fields to represent edge information. Finally, a kernel constrained projection is established for restoring high resolution frames. The experimental results show that the proposed algorithm preserves important features in the images and outperforms the traditional POCS method.

Citation Download Citation

Miao Liu and Yuzhong Shen "Multiframe super resolution based on block motion vector processing and kernel constrained convex set projection", Proc. SPIE 7257, Visual Communications and Image Processing 2009, 72571J (19 January 2009); https://doi.org/10.1117/12.805742

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available