We present a lensless snapshot hyperspectral camera that is capable of hyperspectral imaging over a broad spectrum using a compact and low-cost hardware configuration. We leverage the multiplexing capability of a lensless camera, a novel type of computational imaging device that replaces the lens with a thin mask. Our device utilizes a linear variable filter and a phase mask to encode spectral information onto a monochromatic image sensor, enabling recovery of hyperspectral image stacks from a single measurement by utilizing spectral information encoded in different parts of the 2D point spread function. We perform spectral calibration using a reference color chart and verify the prototype device’s spectral and spatial resolution, as well as its imaging field of view. We report on the design and construction of the device, the image reconstruction algorithm, and spectral calibration methods and present hyperspectral images ranging from 410 to 800 nm obtained with our prototype device.
Histological stains, such as hematoxylin and eosin, tend to fade over time, compromising subsequent analysis accuracy. Traditional methods of restoring stain color in faded samples involve physical re-staining, which is time-consuming and expensive and may damage tissue samples. In addition, digital post-processing techniques, such as color normalization, face limitations when dealing with highly faded slides. To address this, we propose the non-invasive phase-to-color “virtual re-staining” framework. This approach utilizes a trained generative adversarial network with label-free quantitative phase imaging, capturing the intrinsic physiochemical properties of histological samples. It employs multi-channel Fourier ptychographic microscopy to generate pixel-wise paired phase and color images in a high-throughput manner. To streamline data generation, near-infrared illumination is used to mitigate the impact of absorption variations in faded and stained samples, eliminating the need for repetitive data acquisition and potential physical alterations in samples. Our trained network yields comparable or better results to other digitally staining methods, successfully demonstrating the re-staining of approximately decade-old faded slides archived in hospital storage.
Fourier ptychography (FP) is widely adopted for label-free, high-resolution quantitative phase imaging (QPI) of biological samples. However, its imaging speed is limited by the need for multiple acquisitions. In this work, we propose a single-shot FP technique that uses linear polarizers to encode multiple illumination wavevectors and a polarization camera to capture multiple sets of information simultaneously. A multiplexed FP algorithm, utilizing both the bright-field and dark-field information, reconstructs a high-resolution quantitative phase image from the single-shot intensity image. Verified with resolution targets and a histological sample, our method achieved a resolution improvement of 2.5 times the diffraction limit of the objective lens and provided QPI over a large field-of-view. Additionally, we demonstrated high-speed FP at 75 frames per second, limited only by the sensor's readout speed, enabling QPI of fast-moving microorganisms.
26 February 2024 in Optics and Lasers in Engineering
Virtual staining techniques enable the digital transformation of label-free images into clinically standardized stained images. However, the high costs and time involved in generating labeled datasets for training, combined with the absence of accelerated inference pipelines for high-throughput histopathology workflows remain major challenges to their widespread adoption in clinical practice. To overcome these limitations, we present a hardware-software co-designed system that integrates high-speed Fourier ptychographic microscopy with learned illumination, supported by a semi-supervised learning framework. Our end-to-end approach employs a learned multiplexed illumination strategy that significantly reduces acquisition time while maintaining high spatial resolution across a wide field of view. On the algorithmic side, a multi-stage neural network decouples phase reconstruction from colorization, and a contrastive learning framework further generalize the virtual staining by encouraging the network to focus on intrinsic tissue features rather than absorption-induced variations. Extensive experimental results confirm the effectiveness of our method, demonstrating accurate virtual staining of label-free images while providing a scalable and cost-effective alternative to traditional histochemical staining.
We propose a technique for using a display screen as a light source for Fourier Ptychographic Microscopy (FPM). This method easily modulates multiple patterns to cover the entire sensor and build a compact optical system.