Deep learning assisted Fourier ptychography for cells and tissue analysis

Vittorio Bianco; Marika Valentino; Jaromir Behal; Daniele Pirone; Francesco Bardozzo; Pasquale Memmolo; Lisa Miccio; Roberto Tagliaferri; Pietro Ferraro

doi:10.1117/12.2674881

11 August 2023 Deep learning assisted Fourier ptychography for cells and tissue analysis

Vittorio Bianco, Marika Valentino, Jaromir Behal, Daniele Pirone, Francesco Bardozzo, Pasquale Memmolo, Lisa Miccio, Roberto Tagliaferri, Pietro Ferraro

Author Affiliations +

Proceedings Volume 12622, Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI; 126220D (2023) https://doi.org/10.1117/12.2674881
Event: SPIE Optical Metrology, 2023, Munich, Germany

Abstract

Fourier Ptychography (FP) is a quantitative phase imaging technique that overcomes the trade-off between lateral resolution and field of view. Typically, low Numerical Aperture (NA) microscope objectives are used, and super-resolution is obtained by illuminating specimens at different angles, thus generating a larger synthetic NA. These features are pivotal in both cells and tissue slide analysis. FP provides phase contrast images by applying phase retrieval algorithms and the quantitative information can be used to describe and characterize stain-free cells and tissues. To make FP microscopy viable for clinical practice, the issues arising from misalignments of the optical system or the presence of scattering structures to be imaged should be considered though. These non-ideal recording conditions result in phase artefacts in the recovered high-resolution FP reconstruction. To tackle this problem, we propose a blind multi-look FP (ML-FP) algorithm that directly minimizes the artefacts while ensuring correct phase retrieval and can be used by unskilled operators in clinical practice. Here, we show how ML-FP allows the analysis of cells seeded onto micropatterned substrates (for mechanobiology applications) and tissues (for physiology and diagnostic applications). In order to improve robustness in the presence of misalignments, we use the ML-FP outcome as a ground truth and train a GAN architecture to emulate the phase retrieval process. The GAN receives as input the complex amplitude at the first iteration of the FP phase retrieval algorithm and returns in real-time the high-resolution FP complex amplitude.

Conference Presentation

Citation Download Citation

Vittorio Bianco, Marika Valentino, Jaromir Behal, Daniele Pirone, Francesco Bardozzo, Pasquale Memmolo, Lisa Miccio, Roberto Tagliaferri, and Pietro Ferraro "Deep learning assisted Fourier ptychography for cells and tissue analysis", Proc. SPIE 12622, Optical Methods for Inspection, Characterization, and Imaging of Biomaterials VI, 126220D (11 August 2023); https://doi.org/10.1117/12.2674881

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available