29 October 2021 in Optics Letters
In traditional imaging system design, the optical lens is often optimized toward the artificial optimization target like modulation transfer function and field-of-view (FoV). This usually leads to complex stacks of lenses. In order to reduce the complexity, we propose an end-to-end single lens imaging system design method. First, the imaging and processing model is established, whose input end is the ground truth image, and the output end is the restored image by Res-Unet. Then, with the optimization target of minimizing the difference between the restored image and the ground truth image, the parameters of the lens surface and the parameters of the restoration algorithm are optimized simultaneously by deep learning. In order to realize the end-to-end design, the imaging model is required to be differentiable to the lens parameters, so a fast differentiable ray tracing model is proposed. A single lens imaging system with high-quality large FoV (47°) has been designed by the end-to-end method. This method will have a wide application prospects in the design of light and small optoelectronic imaging systems.
17 January 2023 in Optics Letters
End-to-end single-lens imaging system design is a method to optimize both optical system and reconstruction algorithm. Most end-to-end single lens systems use convolutional neural networks (CNN) for image restoration, which fit the transformation relationship between the aberrated image and the ground truth image in the training set. Based on the principle of optical imaging, we realize non-blind image restoration through Wiener deconvolution. Wiener deconvolution is improved with the powerful fitting ability of depth learning so that the noise parameters and the blur kernel in Wiener deconvolution can be simultaneously optimized with the optical parameters in the lens. Extensive comparative tests have been conducted to demonstrate the single-lens imaging system obtained by our method has more stable imaging quality and a 40 times greater imaging speed than the method using CNN restoration algorithm.
13 October 2023 in Optics Letters
The restoration algorithm can reduce the aberration blur in the single-lens computational imaging system. The single lens and the restoration algorithm should be co-designed to improve the imaging performance of the whole computational imaging system. By investigating the influence of aberrations on computational imaging quality, we find there are aberrations that cannot be removed by restoration algorithm, which cause the loss of high-resolution information. However, such aberrations are not constrained in existing co-design methods. To solve this problem, we propose the generalized aberration regularization (GAR), which mainly constrains the aberrations that reduce the modulation transfer function (MTF) at the high frequency. Experimental results demonstrate that our approach can significantly improve the quality of high-resolution information in the recovery image compared with the existing co-design methods.
14 October 2025 in Optica
Traditional optical design (TOD) achieves high-resolution imaging through complex stacks of lenses. Simplifying the lens while ensuring high-resolution capability has been a difficult challenge. In TOD, high resolution means small spot size, so all lens surface areas (LSAs) are constrained to synergistically converge the rays. Here, we mimic the selective attention ability in the human cognitive system and propose the optical attention (OA) mechanism. Compared to TOD, OA selectively attends on LSAs that are conducive to high-frequency information transmission (HFIT), rather than treating all LSAs equally. OA can fully utilize the HFIT capability of simple lens by dynamically distributing local regularization on LSAs, and then the influence of residual aberrations is removed by image restoration, thereby achieving high-resolution computational imaging. Simulation and real-world experiments demonstrate that OA has a wide range of applicable scenarios. On the one hand, it can simplify the complex lens, reducing the number of lenses by 33% and the total track length (TTL) by 18.5% while ensuring the same high-resolution imaging performance. On the other hand, it can improve the imaging performance of the single lens. Compared with existing computational imaging methods, it can increase the contrast of high spatial frequencies (100 lp/mm) by more than 55%. Therefore, the proposed OA significantly simplifies the lens while ensuring high-resolution capability, which expands and diversifies the optical design methods and paves the way for high-performance imaging with lighter and smaller devices.
21 April 2026 in Optics & Laser Technology
8 May 2025 in Optics and Lasers in Engineering