Coded aperture 3D imaging techniques have been rapidly evolving in recent years. The two main directions of evolution are in aperture engineering to generate the optimal optical field and in the development of a computational reconstruction method to reconstruct the object’s image from the intensity distribution with minimal noise. The goal is to find the ideal aperture–reconstruction method pair, and if not that, to optimize one to match the other for designing an imaging system with the required 3D imaging characteristics. The Lucy–Richardson–Rosen algorithm (LR2A), a recently developed computational reconstruction method, was found to perform better than its predecessors, such as matched filter, inverse filter, phase-only filter, Lucy–Richardson algorithm, and non-linear reconstruction (NLR), for certain apertures when the point spread function (PSF) is a real and symmetric function. For other cases of PSF, NLR performed better than the rest of the methods. In this tutorial, LR2A has been presented as a generalized approach for any optical field when the PSF is known along with MATLAB codes for reconstruction. The common problems and pitfalls in using LR2A have been discussed. Simulation and experimental studies for common optical fields such as spherical, Bessel, vortex beams, and exotic optical fields such as Airy, scattered, and self-rotating beams have been presented. From this study, it can be seen that it is possible to transfer the 3D imaging characteristics from non-imaging-type exotic fields to indirect imaging systems faithfully using LR2A. The application of LR2A to medical images such as colonoscopy images and cone beam computed tomography images with synthetic PSF has been demonstrated. We believe that the tutorial will provide a deeper understanding of computational reconstruction using LR2A.
Pattern recognition techniques form the heart of most, if not all, incoherent linear shift-invariant systems. When an object is recorded using a camera, the object information is sampled by the point spread function (PSF) of the system, replacing every object point with the PSF in the sensor. The PSF is a sharp Kronecker Delta-like function when the numerical aperture (NA) is large with no aberrations. When the NA is small, and the system has aberrations, the PSF appears blurred. In the case of aberrations, if the PSF is known, then the blurred object image can be deblurred by scanning the PSF over the recorded object intensity pattern and looking for pattern matching conditions through a mathematical process called correlation. Deep learning-based image classification for computer vision applications gained attention in recent years. The classification probability is highly dependent on the quality of images as even a minor blur can significantly alter the image classification results. In this study, a recently developed deblurring method, the Lucy-Richardson-Rosen algorithm (LR2A), was implemented to computationally refocus images recorded in the presence of spatio-spectral aberrations. The performance of LR2A was compared against the parent techniques: Lucy-Richardson algorithm and non-linear reconstruction. LR2A exhibited a superior deblurring capability even in extreme cases of spatio-spectral aberrations. Experimental results of deblurring a picture recorded using high-resolution smartphone cameras are presented. LR2A was implemented to significantly improve the performances of the widely used deep convolutional neural networks for image classification.
Axial resolution is one of the most important characteristics of a microscope. In all microscopes, a high axial resolution is desired in order to discriminate information efficiently along the longitudinal direction. However, when studying thick samples that do not contain laterally overlapping information, a low axial resolution is desirable, as information from multiple planes can be recorded simultaneously from a single camera shot instead of plane-by-plane mechanical refocusing. In this study, we increased the focal depth of an infrared microscope non-invasively by introducing a binary axicon fabricated on a barium fluoride substrate close to the sample. Preliminary results of imaging the thick and sparse silk fibers showed an improved focal depth with a slight decrease in lateral resolution and an increase in background noise.
Optical endoscopy is a widely used minimally invasive diagnostic tool for imaging internal organs. The imaging resolution is defined by the numerical aperture of the objective lens. In this study, we proposed and demonstrated a Super-resolution Correlating OPtical Endoscopy (SCOPE) system. In SCOPE, modified recording and reconstruction methods are introduced with the existing built-in endoscopy lens. Instead of recording a single image, multiple images of the object are recorded by scanning the tip of the endoscope around the object. The recorded low-resolution images of the object are arranged as sub-matrices in a 2D matrix. Another similar 2D matrix with either recorded or synthesized point spread functions (PSFs) is created. The 2D matrices of the object and the PSF were processed using a deconvolution algorithm to reconstruct a super-resolution image of the object. Both simulation and proof-of-concept experimental studies have been presented. SCOPE neither requires any additional optical element nor any changes in the endoscopy system itself; therefore, it can be easily implemented in commercial endoscopy systems.
Coded aperture 3D imaging techniques have been rapidly evolving in the recent years. The two main directions of evolution are in aperture engineering to generate the optimal optical field and in development of computational reconstruction to reconstruct the object’s image from the intensity distribution with a minimal noise. The goal is to find the ideal aperture-reconstruction method pair and if not, to optimize one to match the other for designing an imaging system with required 3D imaging characteristics. Lucy-Richardson-Rosen algorithm (LR2A), a recently developed computational reconstruction method was found to perform better than its predecessors such as matched filter, Weiner filter, phase-only filter, Lucy-Richardson algorithm and non-linear reconstruction (NLR) for certain apertures when the point spread function (PSF) is a real and symmetric function. For other cases of PSF, NLR performed better than the rest of the methods. In this tutorial, LR2A has been presented as a generalized approach for any optical field along with MATLAB codes for reconstruction of any image when the PSF is known. The common problems and pitfalls in using LR2A has been discussed. Simulation and experimental studies for common optical fields such as spherical, Bessel, vortex beams and exotic optical fields such as Airy, scattered and self-rotating beams have been presented. From this study, it can be seen that it is possible to transfer the 3D imaging characteristics from non-imaging type exotic fields to indirect imaging systems faithfully using LR2A. The application of LR2A to medical images such as colonoscopy images and cone beam computed tomography images with synthetic PSF has been demonstrated. We believe that the tutorial will provide a deeper understanding of computational reconstruction using LR2A.
Axial resolution is one of the most important characteristics of a microscope. In all microscopes, a high axial resolution is desired in order to discriminate information efficiently along the longitudinal direction. However, when studying thick samples that do not contain laterally overlapping information, a low axial resolution is desirable as information from multiple planes can be recorded simultaneously from a single camera shot instead of plane-by-plane mechanical refocusing. In this study, we increased the focal depth of an infrared microscope non-invasively by introducing a binary axicon fabricated on barium fluoride substrate close to the sample. Preliminary results of imaging thick and sparse silk fibers showed an improved focal depth with a slight decrease in lateral resolution and increase in background noise.