Refocusing from a plenoptic camera within seconds on a mobile phone

Óscar Gómez-Cárdenes; José G. Marichal-Hernández; Fernando L. Rosa; Jonas P. Lüke; Juan José Fernández-Valdivia; José M. Rodríguez-Ramos

doi:10.1117/12.2053186

15 May 2014 Refocusing from a plenoptic camera within seconds on a mobile phone

Óscar Gómez-Cárdenes, José G. Marichal-Hernández, Fernando L. Rosa, Jonas P. Lüke, Juan José Fernández-Valdivia, José M. Rodríguez-Ramos

Author Affiliations +

Proceedings Volume 9139, Real-Time Image and Video Processing 2014; 913907 (2014) https://doi.org/10.1117/12.2053186
Event: SPIE Photonics Europe, 2014, Brussels, Belgium

Abstract

Refocusing a plenoptic image by digital means and after the exposure has been thoroughly studied in the last years, but few efforts have been made in the direction of real time implementation in a constrained environment such as that provided by current mobile phones and tablets. In this work we address the aforementioned challenge demonstrating that a complete focal stack, comprising 31 refocused planes from a (256ff16)²plenoptic image, can be achieved within seconds by a current SoC mobile phone platform. The election of an appropriate algorithm is the key to success. In a previous work we developed an algorithm, the fast approximate 4D:3D discrete Radon transform, that performs this task with linear time complexity where others obtain quadratic or linearithmic time complexity. Moreover, that algorithm does not requires complex number transforms, trigonometric calculus nor even multiplications nor oat numbers. Our algorithm has been ported to a multi core ARM chip on an off-the-shelf tablet running Android. A careful implementation exploiting parallelism at several levels has been necessary. The final implementation takes advantage of multi-threading in native code and NEON SIMD instructions. As a result our current implementation completes the refocusing task within seconds for a 16 megapixels image, much faster than previous attempts running on powerful PC platforms or dedicated hardware. The times consumed by the different stages of the digital refocusing are given and the strategies to achieve this result are discussed. Time results are given for a variety of environments within Android ecosystem, from the weaker/cheaper SoCs to the top of the line for 2013.

Citation Download Citation

Óscar Gómez-Cárdenes, José G. Marichal-Hernández, Fernando L. Rosa, Jonas P. Lüke, Juan José Fernández-Valdivia, and José M. Rodríguez-Ramos "Refocusing from a plenoptic camera within seconds on a mobile phone", Proc. SPIE 9139, Real-Time Image and Video Processing 2014, 913907 (15 May 2014); https://doi.org/10.1117/12.2053186

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Neon

Tablets

Cameras

Cell phones

Galactic astronomy

Optimization (mathematics)

Transform theory

Show All Keywords

Keywords/Phrases

Search In:

Publication Years