High-resolution 3D fusion method for optical-resolution photoacoustic microscopy using deep learning

Sihang Li; Zhuangzhuang Wang; Bofang Chen; Chenghao Gu; Ziming Yu; Zihao Li; Xianlin Song

doi:10.1117/12.2612466

14 November 2021 High-resolution 3D fusion method for optical-resolution photoacoustic microscopy using deep learning

Sihang Li, Zhuangzhuang Wang, Bofang Chen, Chenghao Gu, Ziming Yu, Zihao Li, Xianlin Song

Proceedings Volume 11914, SPIE Future Sensing Technologies 2021; 119140O (2021) https://doi.org/10.1117/12.2612466
Event: SPIE Future Sensing Technologies, 2021, Online Only

Abstract

Photoacoustic microscopy suffers from limited depth-of-field due to the strong focus of laser beam, which implies that only some part of the imaging result is clear. Such shortage limitsthe further application of this powerful imaging technique, which is the problem we hope to address. In this work, we consider to solve the target problem through information fusion method. By fusing multi-focus 3D photoacoustic images, a large volumetric and high resolution photoacoustic microscopy can be obtained. However, the task of fusing photoacoustic signal is different from general 2-D multi-focus image fusion problem. The core challenge for our work is the fusion of different 3D photoacoustic volumes. We simplify the task as 2D problem, which is achieved by slicing the 3D data to 2D and reconstruction of the 2D slices. We propose a 3D fusion method which involves proper data preprocessing, slicing of the 3D data, fusion of slices and 3D reconstruction. Experiment results verify that the fused data shows larger depth of field and contains more useful information, which supports our thought of extending depth-of-field through information fusion method. To further demonstrate the superior of deep-learning (DL) method, a few non-DL 2D algorithms are selected for a comparison study based on objective assessments to show the generalization ability of convolutional neural network based image fusion algorithm.

Conference Presentation

Citation Download Citation

Sihang Li, Zhuangzhuang Wang, Bofang Chen, Chenghao Gu, Ziming Yu, Zihao Li, and Xianlin Song "High-resolution 3D fusion method for optical-resolution photoacoustic microscopy using deep learning", Proc. SPIE 11914, SPIE Future Sensing Technologies 2021, 119140O (14 November 2021); https://doi.org/10.1117/12.2612466

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available