Improved video image by pixel-based learning for super-resolution

Kenji Kamimura; Norimichi Tsumura; Toshiya Nakaguchi; Hideto Motomura; Yoichi Miyake

doi:10.1117/12.810462

19 January 2009 Improved video image by pixel-based learning for super-resolution

Kenji Kamimura, Norimichi Tsumura, Toshiya Nakaguchi, Hideto Motomura, Yoichi Miyake

Proceedings Volume 7242, Image Quality and System Performance VI; 724217 (2009) https://doi.org/10.1117/12.810462
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

In recent years, the resolution of display devices has been extremely increased. The resolution of video camera (except very expensive one), however, is quite lower than that of display since it is difficult to achieve high spatial resolution with specific frame rate (e.g. 30 frames per second) due to the limited bandwidth. The resolution of image can be increased by interpolation, such as bi-cubic interpolation, but in this method it is known that the edges of image are blurred. To create plausible high-frequency details in the blurred image, super-resolution technique has been studied for a long time. In this paper, we proose a new algorithm for video super-resolution by considering multi-sensor camera system. The multi-sensor camera can capture two types video sequence as follow; (a) high-resolution with low frame rate luminance sequence, (b) low-resolution with high frame rate color sequences. The training pairs for super-resolution are obtained from these two sequences. The relationships between the high- and low-resolution frames are trained using pixel-based feature named "texton" and stored in the database with their spatial distribution. The low-resolution sequences are then represented with texton and each texton is substituted by searching the trained database to create high-resolution features in output sequences. The experimental results showed that the proposed method can well reproduce both the detail regions and sharp edges of the scene. It was also shown that the PSNR of the image obtained by proposed method is improved compared to the image by bi-cubic interpolation method.

Citation Download Citation

Kenji Kamimura, Norimichi Tsumura, Toshiya Nakaguchi, Hideto Motomura, and Yoichi Miyake "Improved video image by pixel-based learning for super-resolution", Proc. SPIE 7242, Image Quality and System Performance VI, 724217 (19 January 2009); https://doi.org/10.1117/12.810462

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Super resolution

Video

Cameras

Image resolution

Sensors

Stationary wavelet transform

Image quality

Show All Keywords

Keywords/Phrases

Search In:

Publication Years