Open Access
1 March 2010 Micromirror-scanned dual-axis confocal microscope utilizing a gradient-index relay lens for image guidance during brain surgery
Author Affiliations +
Abstract
A fluorescence confocal microscope incorporating a 1.8-mm-diam gradient-index relay lens is developed for in vivo histological guidance during resection of brain tumors. The microscope utilizes a dual-axis confocal architecture to efficiently reject out-of-focus light for high-contrast optical sectioning. A biaxial microelectromechanical system (MEMS) scanning mirror is actuated at resonance along each axis to achieve a large field of view with low-voltage waveforms. The unstable Lissajous scan, which results from actuating the orthogonal axes of the MEMS mirror at highly disparate resonance frequencies, is optimized to fully sample 500×500 pixels at two frames per second. Optically sectioned fluorescence images of brain tissues are obtained in living mice to demonstrate the utility of this microscope for image-guided resections.

Surgical resection is a major component in the standard of care for the treatment of brain cancers, where clinical studies have demonstrated that improved outcomes correlate with more complete resections, especially in conjunction with adjuvant therapies such as radiochemotherapy.1, 2 Histological guidance provided by a miniaturized microscope could be used to improve the accuracy of resection at selected sites where tumor margins are difficult to identify, thereby improving survival and reducing neurological damage. We have been developing dual-axis confocal (DAC) microscopes for in vivo imaging with cellular resolution.3, 4 Unfortunately, the 10-mm -diam form factor of our current microscopes greatly exceeds their field of view (FOV) of less than 0.5mm . The size of these instruments also surpasses that of conventional tools for tumor resection, which are typically 1to2mm in diameter, rendering such a device inconvenient for guiding surgical procedures.

Here we demonstrate that the incorporation of a gradient-index (GRIN) lens at the tip of a microelectromechanical system (MEMS)-scanned DAC allows the image plane to be relayed forward by 3cm through a 1.8-mm -diam optic (see Fig. 1 ). This form factor is designed to enable convenient microscopy in a clinical setting for optical biopsy and image-guided resection of questionable tumor-margin locations using fluorescent contrast agents. Previously, GRIN relay lenses have been utilized for conventional single-axis confocal5 and nonlinear microscopes.6 Here we show that two low-NA beams, with a crossing angle of 45deg , can also be relayed and scanned through such an optical element with minimal aberrations.

Fig. 1

The GRIN-relayed DAC. (a) A schematic of the optical circuit of the microscope. (b) A close-up view of the parabolic focusing optic and the MEMS scanning mirror. (c) The microscope scan head and relay lens. (d) A photograph of the microscope exterior. (e) Ray-trace and spot diagrams of the dual-axis illumination (blue) and collection (green) beam paths within a GRIN relay lens. (f) Ray-trace and spot diagrams of a single large-NA GRIN-relayed beam. (Color online only.)

026029_1_065002jbo1.jpg

Studies have demonstrated the ability of a DAC to effectively reject out-of-focus scattered light for high-contrast optical sectioning in turbid media.7, 8, 9 The DAC utilizes low-power diode lasers along with simple low-NA optics to achieve deep tissue imaging. The long working distance afforded by the low-NA focused beams allows for postobjective beam scanning with a biaxial MEMS scanner.3, 4 This eliminates the need for compound lenses to mitigate the off-axis aberrations that result from scanning a beam through a focusing objective.

Our MEMS scanning device contains a total of four electrostatic actuators: a pair of actuators for each axis of the mirror to achieve tilt in opposing directions (pull-pull configuration).10 We have previously achieved raster-scanned imaging with these MEMS-scanned microscopes by actuating one axis of the mirror at its resonance frequency (1to3kHz) and actuating the orthogonal axis with a slow sawtooth waveform at a frame rate of 4to30Hz . The fast axis, because it is driven at resonance, can achieve large deflection angles ( ±3deg or more) with relatively low-voltage waveforms (20V) . Furthermore, only one actuator is necessary to drive an axis at its natural resonance frequency. On the other hand, relatively large voltages (100to120V) are applied to two actuators to achieve modest deflection angles (±13deg) at off-resonance frequencies. Therefore, the ability to drive both axes of the mirror at resonance, in a Lissajous scanning pattern,11 enables large deflection angles to be achieved with fewer wired connections and lower voltages.

Previous implementations of Lissajous scanning have generally utilized stable scan patterns that self-repeat at a frame rate determined by the frequency ratio of the driving waveforms along each axis.12, 13 However, with arbitrary resonance frequencies, it is difficult to achieve a stable Lissajous scan pattern that repeats a rate of 1to10Hz and also provides coverage over a large FOV of 500×500pixels . Here we demonstrate a general method to utilize an unstable (nonrepeating) “sliding” Lissajous pattern to fully sample 500×500pixels at a frame rate of 2Hz . A similar strategy utilizing an unstable Lissajous scan of a MEMS mirror was demonstrated previously for two-photon microscopy.14 In that work, high frame rates of up to 10Hz were achieved with a FOV of 256×256pixels . In our particular implementation, the scan frequencies are tuned to yield a Lissajous pattern that predictably slides at an optimized rate to ensure that each pixel is sampled. This eliminates the need for filtering or averaging to account for unsampled pixels.

Figure 1 illustrates the optical circuit of our microscope. This diagram includes a ray-trace simulation (Zemax, Bellevue, Washington) depicting the beam paths of the DAC as they are relayed through a nonmagnifying (1:1) GRIN triplet relay assembly consisting of a pair of 14 -pitch, 4.25-mm -long, high-NA (0.51) GRIN lenses on either side of a 12 -pitch, 21.85-mm -long, low-NA (0.19) GRIN lens. Figures 1 and 1 are design drawings of the basic components of the microscope. The parabolic reflector (AgilTek) insures that the two collimated beams intersect and focus to the same point, which defines the focal volume of the microscope. A pair of 0.1-deg wedged alignment (Risley) prisms, shown in Fig. 1, are rotated to bring the collimated beams into parallel alignment with each other. Figure 1 is a photograph of a fully packaged microscope, including the piezoelectric actuator at the proximal end that translates the MEMS mirror in the axial direction for adjusting the focal depth.

The single-mode fiber-pigtailed collimators (GRINTECH Gmbh, Jena, Germany, focal length=4.5mm ) used in our microscope yield a 1e2 beam diameter of 0.9mm . As a result of the parabolic reflector having a 6-mm focal length and the collimators being spaced apart by 4.7mm , the focusing half angle of each beam (1e2) and the intersection half angle between the beams, respectively, are α=0.075rad and θ=22.2deg [see Fig. 1]. If the Gaussian illumination and collection beams are truncated (apodized) to allow 99% power transmission, diffraction theory predicts a full-width at half-maximum (FWHM) spatial resolution (in micrometers) of:7

Eq. 1

Δxd=0.466λn(π/2α)cosθ=2.1,Δyd=0.466λn(π/2α)=1.9,Δzd=0.466λn(π/2α)sinθ=5.1,
where θ=22.2deg ; α=0.075rad , n=1 (air), and λ=488nm . The experimentally measured FWHM resolution of our microscope is: Δxd=3.7μm , Δyd=3.6μm , and Δzd=8.0μm . The degradation in resolution is due to aberrations from the GRIN collimation and relay lenses, as well as alignment imperfections and diffraction noise introduced by imperfections in the MEMS mirror (beam clipping and hinge structures within the mirror surface). The spatial resolution of the GRIN-relayed DAC is degraded by less than 10% compared to the resolution measured without the GRIN relay lens (data not shown). A ray-trace simulation was performed to roughly compare the effects of aberrations due to the GRIN relay lens on our dual-axis beams versus a single large-NA beam used for conventional confocal or multiphoton microscopy. The DAC simulation reveals minimal aberrations [Fig. 1], with various rays converging to a region well within the 3.2-μm theoretical spot size ( 1e2 diameter) of a diffraction-limited Gaussian beam with NA=0.075 (1e2) at 488nm in air. In Fig. 1, a ray trace simulation is shown for a single on-axis Gaussian beam that fills the collection NA of the GRIN relay lens (99% power transmission NA=0.5 ; 1e2 NA=0.32 ). The spread in the spot diagram extends beyond the 0.77-μm theoretical spot size ( 1e2 diameter) of a diffraction-limited Gaussian beam with NA=0.32 (1e2) at 488nm in air. Evidently, since the DAC utilizes low-NA beam paths through the GRIN relay lens, rather than relying on the full NA of the lens, the effects of aberrations are minimized. A complete diffraction analysis, which is not presented in this work, is required to fully characterize the tradeoffs between GRIN-relayed versions of the DAC and single-axis confocal microscopes.

As mentioned previously, an unstable Lissajous scan pattern is achieved by driving our MEMS mirror at resonance along both axes, enabling large-FOV imaging with relatively low-voltage waveforms. The resulting scan pattern is described by the following parametric equations as a function of time:

Eq. 2

x=Asin(2πat+ϕx)+A,

Eq. 3

y=Bsin(2πbt+ϕy)+B,
where ϕx and ϕy are phase shift constants (in radians), a and b are the slow and fast frequencies, respectively, in cycles/sec (Hz), and the FOV of the scan extends from 0 to 2A in the x direction and 0 to 2B in the y direction (in this case, A=B=250 ). The resonant frequencies of the two axes of our MEMS mirror are 985±10Hz and 2220±10Hz (FWHM bandwidth 20Hz ).

Figure 2 depicts the trajectory of a Lissajous scan pattern between t=0 and 4ms (assuming ϕx=ϕy=0 ). If the frequency ratio of the fast- and slow-axis waveforms is exactly 94 , then a stable Lissajous pattern results, repeating once for every four cycles of the slow axis or every nine cycles of the fast axis ( 4a or 9bsec ). If the ratio between the frequencies is slightly different than 94 , an unstable Lissajous pattern is generated that appears to slide in time in the horizontal direction [Fig. 2]. The sliding speed, determined by the frequency ratio, is optimally chosen such that the Lissajous pattern shifts by a distance of less than 1pixel for every nearly repeated cycle ( 4a or 9bsec ), ensuring that no pixels are missed over time. Figures 2 and 2 illustrate how an entire image is sampled over time by the sliding Lissajous pattern. Taking the derivative of Eq. 3 with respect to time reveals that the maximum velocity of the fast-axis scan is given by 2πbB3.5(10)6pixelssec . Thus, a data acquisition rate of 4MHz is chosen to obviate dead (unsampled) pixels along the trajectory of the Lissajous scan.

Fig. 2

Calculated Lissajous scan patterns. Fast-axis frequency=2219Hz . Slow-axis frequency=986Hz . (a) 0to4ms , where the pattern nearly repeats itself. (b) A comparison of two Lissajous patterns 20ms apart, showing how the pattern shifts over time. (c) 0to85ms , showing partial coverage over the FOV. (d) 0to330ms , showing nearly full coverage over the FOV.

026029_1_065002jbo2.jpg

Sinusoidal waveforms are generated with National Instruments (Austin, Texas) boards programmed in LabVIEW and sent through a voltage amplifier (Agiloptics, Albuquerque, New Mexico) to drive our biaxial MEMS mirror. A National Instruments digitizer board is used to record signals from a PMT detector at a rate of 4MHz . All processes are synchronized for phase-locked operation, and the phase shifts ϕx and ϕy are determined via calibration. In our implementation, a=986.0Hz and b=2219.0Hz . For each detector value sampled at time t , Eqs. 2, 3 are used to calculate the exact coordinates x and y of the Lissajous scan. These coordinates are rounded to the nearest integer to locate the most appropriate pixel for data entry within the 500×500pixel bitmap image (programmed in LabVIEW). Image degradation due to rounding errors is minimal due to the fact that we oversample the image. The spatial dimension of our target FOV is approximately 500×500μm . Therefore, with a pixel density of 500×500 , and a lateral resolution of 4μm , our sampling (1pixelμm) exceeds the Nyquist criterion by a factor of 2. Two million points are collected per image, resulting in a frame rate of 2Hz . Redundantly sampled pixels contain an average of the sampled values at that pixel location.

Example images acquired with our GRIN-relayed DAC are shown in Figs. 3, 3, 3, 3, 3, 3 . Figure 3 is a reflectance image of a United States Air Force (USAF) bar target (group 7), in which the width of the smallest set of lines is 2.2μm per line. Due to the field curvature of the microscope, only the center of the FOV is in focus for this flat reflective target. In practice, field curvature is not a major concern, since our device is designed to image at least ten microns beneath the surface of a thick tissue, rather than imaging a flat surface. Figure 3 is a depth projection (FOV=400×400μm) of 10-μm -diam fluorescent beads embedded in Matrigel. The color map encodes depths from 0to250μm . Figure 3 is an in vivo image at a depth of 50μm (FOV=325×325μm) of vasculature within the cerebrum of a mouse after a portion of the skull has been surgically removed (five-frame average). To highlight the vasculature in this image, fluorescein-dextran (MW=70,000) was injected into the retro-orbital capillary plexus at a dose of 1mg ( 40-mgkg body weight) in a 200-μL volume. Figure 3 is of the same tissue as Fig. 3, except that it was acquired at a depth of 100μm (five-frame average). Figure 3 is an ex vivo image at a depth of 25μm (FOV=350×350μm) of cerebellum from a transgenic mouse ( 10days of age) that expresses green fluorescent protein (GFP) under the Math1 promoter.15 After weaning, expression of this promoter is repressed in the cerebellum, except in medulloblastomas, a cerebellar brain tumor that spontaneously develops in this gene knock-out mouse ( Ptc+p53 Math1-GFP). In Fig. 3, in vivo imaging of the tumor is performed after surgical removal of a portion of the skull. This image ( FOV=350×350μm ; depth=30μm ) reveals the GFP-expressing tumor in contrast to the dark normal brain tissue, and indicates that this instrument would have utility in detecting tumor margins when used in conjunction with appropriate exogenously applied fluorescent molecular probes. Figures 3 and 3 are single frames that have been filtered with a smoothing algorithm that replaces each pixel with an average of its adjacent pixels. Spatial resolution is minimally affected, since the image is oversampled.

Fig. 3

Images taken by the GRIN-relayed DAC. All scale bars are 50μm . Illumination intensity=1mW . (a) Reflectance image of a USAF bar target (group 7). (b) Depth projection of 10-μm -diam fluorescent beads embedded in a Matrigel matrix, imaged between 0 and 250μm deep. The color map encodes depth. (c) In vivo image of mouse cerebrum vasculature after retro-orbital injection of fluorescein-dextran (MW=70,000) . Depth=50μm . Average of five frames. (d) Same as (c), but imaged at a depth of 100μm . (e) Ex vivo image of cerebellum from a Math1-GFP mouse ( 10days old). Depth=25μm . (f) In vivo image of GFP-expressing medulloblastoma in a mouse. Depth=30μm . (Color online only.)

026029_1_065002jbo3.jpg

We have presented the design and demonstration of a miniature DAC outfitted with a 1.8-mm -diam GRIN relay lens for convenient macroscopic positioning of the device at surgical sites. Our previous designs implemented raster-scanned MEMS mirrors, which were limited in their FOV because of the modest scan range attained by the nonresonant slow axis of the MEMS device. In addition, the raster-scanned MEMS mirrors required higher operating voltages that may not be preferred in clinical applications. Here we have described the use of resonant scanning along both axes of the MEMS mirror to achieve a large FOV with low actuation voltages and reduced numbers of actuators. We have developed the calibrated and synchronized instrumentation to decode the nonrepeating Lissajous pattern that results, and have demonstrated in vivo imaging of normal brain and tumor in living mice. Our goal is to use the GRIN-relayed DAC technology, along with exogenous fluorescent contrast agents, for spatially precise and molecularly specific resection of brain tumors

Acknowledgments

This work was funded, in part, by grants from the National Institutes of Health, including U54 CA105296 and U54 CA136465 (NCI). These studies were also supported by the Stanford Center for Children’s Brain Tumors (CCBT) at the Lucile Packard Children’s Hospital. Liu was supported, in part, by a Canary Foundation/American Cancer Society postdoctoral fellowship for early cancer detection, and by an NIH Pathway to Independence Award, K99 EB008557 (NIBIB). We thank Ellis Garai for technical support, and Helen Rayburn and Matthew Scott for providing breeders for our medulloblastoma mouse colonies.

References

1. 

M. J. Van den Bent, R. Stupp, W. Mason, “Impact of the extent of resection on overall survival in newly-diagnosed glioblastoma after chemo-irradiation with temozolamide: further analysis of EORTC study 26981,” Eur. J. Cancer Suppl., 3 134 (2005). Google Scholar

2. 

L. Riffaud, S. Saikali, E. Leray, A. Hamlat, C. Haegelen, E. Vauleon, and T. Lesimple, “Survival and prognostic factors in a series of adults with medulloblastomas,” J. Neurosurg., 111 478 –487 (2009). https://doi.org/10.3171/2009.1.JNS081004 0022-3085 Google Scholar

3. 

J. T. C. Liu, M. J. Mandella, H. Ra, L. K. Wong, O. Solgaard, G. S. Kino, W. Piyawattanametha, C. H. Contag, and T. D. Wang, “Miniature near-infrared dual-axes confocal microscope utilizing a two-dimensional microelectromechanical systems scanner,” Opt. Lett., 32 256 (2007). https://doi.org/10.1364/OL.32.000256 0146-9592 Google Scholar

4. 

H. Ra, W. Piyawattanametha, M. J. Mandella, P. Hsiung, J. Hardy, T. D. Wang, C. H. Contag, G. S. Kino, and O. Solgaard, “Three-dimensional in vivo imaging by a handheld dual-axes confocal microscope,” Opt. Express, 16 7224 (2008). https://doi.org/10.1364/OE.16.007224 1094-4087 Google Scholar

5. 

J. Knittel, L. Schnieder, G. Buess, B. Messerschmidt, and T. Possner, “Endoscope-compatible confocal microscope using a gradient index-lens system,” Opt. Commun., 188 267 (2001). https://doi.org/10.1016/S0030-4018(00)01164-0 0030-4018 Google Scholar

6. 

J. C. Jung, A. D. Mehta, E. Aksay, R. Stepnoski, and M. J. Schnitzer, “In vivo mammalian brain imaging using one-and two-photon fluorescence microendoscopy,” J. Neurophysiol., 92 3121 (2004). https://doi.org/10.1152/jn.00234.2004 0022-3077 Google Scholar

7. 

J. T. C. Liu, M. J. Mandella, S. Friedland, R. Soetikno, J. H. Crawford, C. H. Contag, G. S. Kino, and T. D. Wang, “Dual-axes confocal reflectance microscope for distinguishing colonic neoplasia,” J. Biomed. Opt., 11 054019 (2006). https://doi.org/10.1117/1.2363363 1083-3668 Google Scholar

8. 

L. K. Wong, T. D. Wang, M. J. Mandella, and G. S. Kino, “Improved rejection of multiply-scattered photons in confocal microscopy using dual-axes architecture,” Opt. Lett., 32 1674 (2007). https://doi.org/10.1364/OL.32.001674 0146-9592 Google Scholar

9. 

J. T. C. Liu, M. J. Mandella, J. H. Crawford, C. H. Contag, T. D. Wang, and G. S. Kino, “Efficient rejection of scattered light enables deep optical sectioning in turbid media with low-NA optics in a dual-axis confocal architecture,” J. Biomed. Opt., 13 034020 (2008). https://doi.org/10.1117/1.2939428 1083-3668 Google Scholar

10. 

H. Ra, W. Piyawattanametha, Y. Taguchi, D. Lee, M. J. Mandella, and O. Solgaard, “Two-dimensional MEMS scanner for dual-axes confocal in vivo microscopy,” J. Microelectromech. Syst., 16 969 (2007). https://doi.org/10.1109/JMEMS.2007.892900 1057-7157 Google Scholar

11. 

J. A. Lissajous, “Note sur une méthode nouvelle applicable à l’étude des mouvements vibratoires,” Comptes Rendus Séances l’Academie Sci., 41 814 –817 (1855). Google Scholar

12. 

P. M. Delaney and M. R. Harris, “Fiberoptics in confocal microscopy,” The Handbook of Biological Confocal Microscopy, 515 –523 Plenum Press, NY (1995). Google Scholar

13. 

F. Helmchen, M. Fee, D. Tank, and W. Denk, “A miniature head-mounted two-photon microscope: high-resolution brain imaging in freely moving animals,” Neuron, 31 903 –912 (2001). https://doi.org/10.1016/S0896-6273(01)00421-4 0896-6273 Google Scholar

14. 

C. L. Hoy, N. J. Durr, P. Chen, W. Piyawattanametha, H. Ra, O. Solgaard, and A. Ben-Yakar, “Miniaturized probe for femtosecond laser microsurgery and two-photon imaging,” Opt. Express, 16 9996 –10005 (2008). https://doi.org/10.1364/OE.16.009996 1094-4087 Google Scholar

15. 

C. Wetmore, D. E. Eberhart, and T. Curran, “Loss of p53 but not ARF accelerates medulloblastoma in mice heterozygous for patched,” Cancer Res., 61 513 –516 (2001). 0008-5472 Google Scholar
©(2010) Society of Photo-Optical Instrumentation Engineers (SPIE)
Jonathan T. Liu, Michael J. Mandella, Nathan O. Loewke, Henry Haeberle, Hyejun Ra, Wibool Piyawattanametha, Olav D. Solgaard, Gordon S. Kino, and Christopher H. Contag "Micromirror-scanned dual-axis confocal microscope utilizing a gradient-index relay lens for image guidance during brain surgery," Journal of Biomedical Optics 15(2), 026029 (1 March 2010). https://doi.org/10.1117/1.3386055
Published: 1 March 2010
Lens.org Logo
CITATIONS
Cited by 68 scholarly publications and 2 patents.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Microscopes

Microelectromechanical systems

Relays

Mirrors

Confocal microscopy

GRIN lenses

Actuators

Back to Top