A semi-automatic 2D-to-3D video conversion with adaptive key-frame selection

Kuanyu Ju; Hongkai Xiong

doi:10.1117/12.2071947

4 November 2014 A semi-automatic 2D-to-3D video conversion with adaptive key-frame selection

Kuanyu Ju, Hongkai Xiong

Proceedings Volume 9273, Optoelectronic Imaging and Multimedia Technology III; 92730M (2014) https://doi.org/10.1117/12.2071947
Event: SPIE/COS Photonics Asia, 2014, Beijing, China

Abstract

To compensate the deficit of 3D content, 2D to 3D video conversion (2D-to-3D) has recently attracted more attention from both industrial and academic communities. The semi-automatic 2D-to-3D conversion which estimates corresponding depth of non-key-frames through key-frames is more desirable owing to its advantage of balancing labor cost and 3D effects. The location of key-frames plays a role on quality of depth propagation. This paper proposes a semi-automatic 2D-to-3D scheme with adaptive key-frame selection to keep temporal continuity more reliable and reduce the depth propagation errors caused by occlusion. The potential key-frames would be localized in terms of clustered color variation and motion intensity. The distance of key-frame interval is also taken into account to keep the accumulated propagation errors under control and guarantee minimal user interaction. Once their depth maps are aligned with user interaction, the non-key-frames depth maps would be automatically propagated by shifted bilateral filtering. Considering that depth of objects may change due to the objects motion or camera zoom in/out effect, a bi-directional depth propagation scheme is adopted where a non-key frame is interpolated from two adjacent key frames. The experimental results show that the proposed scheme has better performance than existing 2D-to-3D scheme with fixed key-frame interval.

Citation Download Citation

Kuanyu Ju and Hongkai Xiong "A semi-automatic 2D-to-3D video conversion with adaptive key-frame selection", Proc. SPIE 9273, Optoelectronic Imaging and Multimedia Technology III, 92730M (4 November 2014); https://doi.org/10.1117/12.2071947

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available