Regular Articles

Prioritized image and video colorization based on Gaussian pyramid of gradient images

[+] Author Affiliations
Dae-Young Hyun

Seoul National University, School of Electrical Engineering and Computer Science, 1 Gwanak-ro, Gwanak-guSeoul 151-742 Korea

Jun-Hee Heu

Samsung SDS, 318, Teheran-ro, Gangnam-gu, Seoul 135-918 Korea

Chang-Su Kim

Korea University, School of Electrical Engineering, 145, Anam-ro, Seongbuk-gu, Seoul 136-701 Korea

Sang-Uk Lee

Seoul National University, School of Electrical Engineering and Computer Science, 1 Gwanak-ro, Gwanak-gu, Seoul 151-742 Korea

J. Electron. Imaging. 21(2), 023027 (Jun 27, 2012). doi:10.1117/1.JEI.21.2.023027
History: Received May 18, 2011; Revised April 29, 2012; Accepted May 9, 2012
Text Size: A A A

Abstract.  We propose a colorization algorithm for grayscale images and videos that demands simple user scribbles on a selected set of source pixels. The proposed algorithm colorizes non source pixels by propagating the colors of source pixels. To achieve reliable colorization results, we adopt a prioritization approach, which colorizes large smooth regions first and small detailed regions later using a Gaussian pyramid of gradient images. At each level of the pyramid, we determine the priority of each non source pixel using the luminance similarities to neighboring pixels and the geometric proximities to source pixels. Then we repeatedly colorize the pixel with the highest priority by interpolating the colors of neighboring source pixels. Also, for video colorization, the proposed algorithm transfers the colors of the first frame to subsequent frames based on optical flow estimation. To correct incorrectly transferred colors, the accuracies of transferred colors are calculated, and inaccurate colors are refined using neighboring colors. Simulation results show that the proposed algorithm provides accurate and reliable colorization results. We also demonstrate that the proposed algorithm can be used for color restoration and recolorization.

© 2012 SPIE and IS&T

Citation

Dae-Young Hyun ; Jun-Hee Heu ; Chang-Su Kim and Sang-Uk Lee
"Prioritized image and video colorization based on Gaussian pyramid of gradient images", J. Electron. Imaging. 21(2), 023027 (Jun 27, 2012). ; http://dx.doi.org/10.1117/1.JEI.21.2.023027


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.