23 September 2020 in Optics Express
The obstacle of imaging through multimode fibers (MMFs) is encountered due to the fact that the inherent mode dispersion and mode coupling lead the output of the MMF to be scattered and bring about image distortions. As a result, only noise-like speckle patterns can be formed on the distal end of the MMF. We propose a deep learning model exploited for computational imaging through an MMF, which contains an autoencoder (AE) for feature extraction and image reconstruction and self-normalizing neural networks (SNNs) sandwiched and employed for high-order feature representation. It was demonstrated both in simulations and in experiments that the proposed AE-SNN combined deep learning model could reconstruct image information from various binary amplitude-only targets going through a 5-meter-long MMF. Simulations indicate that our model works effectively even in the presence of system noise, and the experimental results prove that the method is valid for image reconstruction through the MMF. Enabled by the spatial variability and the self-normalizing properties, our model can be generalized to solve varieties of other computational imaging problems.
13 August 2021 in Applied Physics Express
25 May 2023 in Journal of Physics D: Applied Physics
To our knowledge, optical 4f systems have been widely used as a convolutional layer to perform convolutional computation in free-space optical neural networks (ONNs), which makes ONNs too bulky to be easily applied to miniaturized smart systems. Hence, we propose a compact lensless optoelectronic convolutional neural network (LOE-CNN) architecture in which a single optimized diffractive phase mask acts as an analog convolution processor to perform convolutional operation without a Fourier lens or lenslet array. We demonstrate that this LOE-CNN can be functionally comparable to existing electronic counterparts in classification performance, achieving a classification accuracy of 98.07% and 95% over the Modified National Institute of Standards and Technology dataset in simulation and experiment, respectively, which not only opens new application prospects for free-space ONNs based on a compact single-chip convolution processor, but also facilitates the development of ONN-based smart devices.