This paper proposes a supervised deep neural network model for accomplishing highly efficient image quality assessment (IQA) for adaptive optics (AO) images. The AO imaging systems based on ground-based telescopes suffer from residual atmospheric turbulence, tracking error, and photoelectric noise, which can lead to varying degrees of image degradation, making image processing challenging. Currently, assessing the quality and selecting frames of AO images depend on either traditional IQA methods or manual evaluation by experienced researchers, neither of which is entirely reliable. The proposed network is trained by leveraging the similarity between the point spread function (PSF) of the degraded image and the Airy spot as its supervised training instead of relying on the features of the degraded image itself as a quality label. This approach is reflective of the relationship between the degradation factors of the AO imaging process and the image quality and does not require the analysis of the image’s specific feature or degradation model. The simulation test data show a Spearman’s rank correlation coefficient (SRCC) of 0.97, and our method was also validated using actual acquired AO images. The experimental results indicate that our method is more accurate in evaluating AO image quality compared to traditional IQA methods.
Traditional plenoptic wavefront sensors (PWFS) suffer from the obvious step change of the slope response, leading to poor wavefront detection performance. In order to solve this problem, in this paper, a deep learning model is proposed to restore phase maps directly from slope measurements of PWFS. Numerical simulations are employed to demonstrate our approach, and the statistical residual wavefront root mean square error (RMSE) of our method is 0.0810 ± 0.0258λ, which is much superior to those of modal algorithm (0.2511 ± 0.0587λ) and zonal approach (0.3584 ± 0.0487λ). The internal driving force of PWFS-ResUnet is investigated, and the slope response differences between sub-apertures and directions are considered as a probably key role to help our model to accurately restore the phase map. Additionally, the robustness of our model to turbulence strength and signal-to-noise ratio (SNR) level is also tested. The proposed method provides a new direction to solve the nonlinear problem of traditional PWFS.
Traditional plenoptic wavefront sensors (PWS) suffer from the obvious step change of the slope response which leads to the poor performance of phase retrieval. In this paper, a neural network model combining the transformer architecture with the U-Net model is utilized to restore wavefront directly from the plenoptic image of PWS. The simulation results show that the averaged root mean square error (RMSE) of residual wavefront is less than 1/14λ (Marechal criterion), proving the proposed method successfully breaks through the non-linear problem existed in PWS wavefront sensing. In addition, our model performs better than the recently developed deep learning models and traditional modal approach. Furthermore, the robustness of our model to turbulence strength and signal level is also tested, proving the good generalizability of our model. To the best of our knowledge, it is the first time to perform direct wavefront detection with a deep-learning-based method in PWS-based applications and achieve the state-of-the-art performance.
Retina images acquired by an adaptive optics confocal scanning laser ophthalmoscope (AOSLO) usually need to remove image warp to improve image quality. The most significant task of AOSLO image dewarping is image registration. Most traditional feature-based registration algorithms used for AOSLO images are based on Gaussian scale space. However, the homogeneous Gaussian blurring reduces localization accuracy of feature points and the distinctiveness of feature descriptors. In this paper, the accelerated KAZE (AKAZE) feature based on nonlinear scale space was utilized to register AOSLO retinal images for the first time, and an efficient strategy based on matched feature points for frame selection was proposed to automatically accomplish AOSLO retinal image dewarping. Moreover, a flexible method based on power spectra analysis is proposed to study the minimum number of frames needed to accomplish image dewarping. Extensive experiments demonstrated that the AKAZE method is more suitable for AOSLO image dewarping, benefitted with a better accuracy, robustness and rapidity, compared to several traditional registration methods based on Gaussian scale space.
The Shack–Hartmann wavefront sensor (SHWFS) is widely utilized for ocular aberration measurement. However, large ocular aberrations caused by individual differences can easily make the spot move out of the range of the corresponding sub-aperture in SHWFS, rendering the traditional centroiding method ineffective. This study applied a novel convolutional neural network (CNN) model to wavefront sensing for large dynamic ocular aberration measurement. The simulation results demonstrate that, compared to the modal method, the dynamic range of our method for main low-order aberrations in ocular system is increased by 1.86 to 43.88 times in variety. Meanwhile, the proposed method also has the best measurement accuracy, and the statistical root mean square (RMS) of the residual wavefronts is 0.0082 ± 0.0185 (mean ± standard deviation). The proposed method generally has a higher accuracy while having a similar or even better dynamic range as compared to traditional large-dynamic schemes. On the other hand, compared with recently developed deep learning methods, the proposed method has a much larger dynamic range and better measurement accuracy.