Speed and enhancement are the two most important metrics for anti-scattering light focusing by wavefront shaping (WS), which requires a spatial light modulator with a large number of modulation modes and a fast speed of response. Among the commercial modulators, the digital-micromirror device (DMD) is the sole solution providing millions of modulation modes and a pattern rate higher than 20 kHz. Thus, it has the potential to accelerate the process of anti-scattering light focusing with a high enhancement. Nevertheless, modulating light in a binary mode by the DMD restricts both the speed and enhancement seriously. Here, we propose a multi-pixel encoded DMD-based WS method by combining multiple micromirrors into a single modulation unit to overcome the drawbacks of binary modulation. In addition, to efficiently optimize the wavefront, we adopted separable natural evolution strategies (SNES), which could carry out a global search against a noisy environment. Compared with the state-of-the-art DMD-based WS method, the proposed method increased the speed of optimization and enhancement of focus by a factor of 179 and 16, respectively. In our demonstration, we achieved 10 foci with homogeneous brightness at a high speed and formed W- and S-shape patterns against the scattering medium. The experimental results suggest that the proposed method will pave a new avenue for WS in the applications of biomedical imaging, photon therapy, optogenetics, dynamic holographic display, etc.
Spatial frequency domain imaging (SFDI) is an emerging technology that enables label-free, non-contact, and wide-field mapping of tissue chromophore contents, such as oxy- and deoxy-hemoglobin concentrations. It has been shown that the use of more than two spatial frequencies (multi-fx) can vastly improve measurement accuracy and reduce chromophore estimation uncertainties, but real-time multi-fx SFDI for chromophore monitoring has been limited in practice due to the slow speed of available chromophore inversion algorithms. Existing inversion algorithms have to first convert the multi-fx diffuse reflectance to optical absorptions, and then solve a set of linear equations to estimate chromophore concentrations. In this work, we present a deep learning framework, noted as a deep residual network (DRN), that is able to directly map from diffuse reflectance to chromophore concentrations. The proposed DRN is over 10x faster than the state-of-the-art method for chromophore inversion and enables 25x improvement on the frame rate for in vivo real-time oxygenation mapping. The proposed deep learning model will help enable real-time and highly accurate chromophore monitoring with multi-fx SFDI.
Focusing light through a scattering medium is a longstanding challenge in biomedical optics, to which wavefront shaping is a powerful solution. The state-of-the-art feedback-based approach is the widely used genetic algorithm method. However, it can only achieve relatively low enhancement of the focus, and the genetic algorithm is known to be time-consuming. To tackle those issues, we propose a gradient-assisted strategy for wavefront shaping. The proposed method conducts optimization in the function distribution space. Specifically, when optimizing the parameters along each iteration, the consequent function distribution changes within a distance as measured by the Kullback–Leibler divergence. Taking advantage of the gradient information, the proposed method is over faster to obtain the same peak-to-background ratio (PBR) level. Compared with the genetic algorithm that is able to optimize a number of phase segments, the proposed gradient strategy is able to optimize phase segments, and gives higher focus enhancement as quantified by the PBR.
The ability to quantify optical properties (i.e., absorption and scattering) of strongly turbid media has major implications on the characterization of biological tissues, fluid fields, and many others. However, there are few methods that can provide wide-field quantification of optical properties, and none is able to perform quantitative optical property imaging with high-speed (e.g., kilohertz) capabilities. Here we develop a new imaging modality termed halftone spatial frequency domain imaging (halftone-SFDI), which is approximately two orders of magnitude faster than the state-of-the-art, and provides kilohertz high-speed, label-free, non-contact, wide-field quantification for the optical properties of strongly turbid media. This method utilizes halftone binary patterned illumination to target the spatial frequency response of turbid media, which is then mapped to optical properties using model-based analysis. We validate the halftone-SFDI on an array of phantoms with a wide range of optical properties as well as in vivo human tissue. We demonstrate with an in vivo rat brain cortex imaging study, and show that halftone-SFDI can longitudinally monitor the absolute concentration as well as spatial distribution of functional chromophores in tissue. We also show that halftone-SFDI can spatially map dual-wavelength optical properties of a highly dynamic flow field at kilohertz speed. Together, these results highlight the potential of halftone-SFDI to enable new capabilities in fundamental research and translational studies including brain science and fluid dynamics.
SignificanceCurrent photoacoustic (PA) imaging modalities typically require either serial detection with a single-element transducer or parallel detections with an ultrasonic array, indicating a dilemma between system cost and imaging throughput. PA topography through ergodic relay (PATER) was recently developed to address this bottleneck. However, PATER requires object-specific calibration due to varied boundary condition and must be recalibrated through pointwise scanning for each object before measurements, which is time-consuming and severely limits practical application.AimWe aim to develop a new single-shot PA imaging technique that only requires a one-time calibration for imaging different objects using a single-element transducer.ApproachWe develop an imaging method, PA imaging through a spatiotemporal encoder (PAISE), to address the above issue. The spatial information is effectively coded into unique temporal features by the spatiotemporal encoder, which allows for compressive image reconstruction. An ultrasonic waveguide is proposed as a critical element to guide the PA waves from the object into the prism, which effectively accounts for the varied boundary condition of different objects. We further add irregular-shaped edges on the prism to introduce randomized internal reflections and further facilitate the scrambling of acoustic waves.ResultsThe proposed technique is validated through comprehensive numerical simulations and experiments, and it is demonstrated that PAISE can successfully overcome the changed boundary condition and can image different samples given a single calibration.ConclusionsThe proposed PAISE technique is capable of single-shot widefield PA imaging with a single-element transducer and does not require sample-specific calibration, which successfully overcomes the major limitation of previous PATER technology.
Fluorescence quantum yield (QY) indicates the efficiency of the fluorescence process. The QY of many fluorophores is sensitive to local tissue environments, highlighting the possibility of using QY as an indicator of important parameters such as pH or temperature. QY is commonly measured by comparison to a well-known standard in nonscattering media. We propose a new imaging method, called quantum yield imaging (QYI), to spatially map the QY of a fluorophore within an optically diffusive media. QYI utilizes the wide-field diffuse optical technique spatial frequency domain imaging (SFDI) as well as planar fluorescence imaging. SFDI is used to measure the optical properties of the background media and the absorption contributed by the fluorophore. The unknown QY is then calculated by combining information from both modalities. A fluorescent sample with known QY is used to account for instrument response. To demonstrate QYI, rhodamine B and SNARF-5 were imaged in liquid phantoms with different background optical properties. The methanol:water ratio and pH were changed for rhodamine B and SNARF-5 solvents, respectively, altering the QY of each through a wide range. QY was determined with an agreement of 0.021 and 0.012 for rhodamine B and SNARF-5, respectively.