Super-resolution (SR) technology plays a crucial role in improving the spatial resolution of remote sensing images so as to overcome the physical limitations of spaceborne imaging systems. Although deep convolutional neural networks have achieved promising results, most of them overlook the advantage of self-similarity information across different scales and high-dimensional features after the upsampling layers. To address the problem, we propose a hybrid-scale hierarchical transformer network (HSTNet) to achieve faithful remote sensing image SR. Specifically, we propose a hybrid-scale feature exploitation module to leverage the internal recursive information in single and cross scales within the images. To fully leverage the high-dimensional features and enhance discrimination, we designed a cross-scale enhancement transformer to capture long-range dependencies and efficiently calculate the relevance between high-dimension and low-dimension features. The proposed HSTNet achieves the best result in PSNR and SSIM with the UCMecred dataset and AID dataset. Comparative experiments demonstrate the effectiveness of the proposed methods and prove that the HSTNet outperforms the state-of-the-art competitors both in quantitative and qualitative evaluations.
There is a strong correlation between the geometry of the weld pool surface and the degree of penetration in arc welding. To measure the geometry of the weld pool surface robustly, many structured light laser line based monitoring systems have been proposed in recent years. The geometry of the specular weld pool could be computed from the reflected laser lines based on different principles. The prerequisite of accurate computation of the weld pool surface is to segment the reflected laser lines robustly and efficiently. To find the most effective segmentation solutions for the images captured with different welding parameters, different image processing algorithms are combined to form eight approaches and these approaches are compared both qualitatively and quantitatively in this paper. In particular, the gradient detection filter, the difference method and the GLCM (grey level co-occurrence matrix) are used to remove the uneven background. The spline fitting enhancement method is used to remove the fuzziness. The slope difference distribution-based threshold selection method is used to segment the laser lines from the background. Both qualitative and quantitative experiments are conducted to evaluate the accuracy and the efficiency of the proposed approaches extensively.
Images captured in a low-light environment are strongly influenced by noise and low contrast, which is detrimental to tasks such as image recognition and object detection. Retinex-based approaches have been continuously explored for low-light enhancement. Nevertheless, Retinex decomposition is a highly ill-posed problem. The estimation of the decomposed components should be combined with proper constraints. Meanwhile, the noise mixed in the low-light image causes unpleasant visual effects. To address these problems, we propose a Constraint Low-Rank Approximation Retinex model (CLAR). In this model, two exponential relative total variation constraints were imposed to ensure that the illumination is piece-wise smooth and that the reflectance component is piece-wise continuous. In addition, the low-rank prior was introduced to suppress the noise in the reflectance component. With a tailored separated alternating direction method of multipliers (ADMM) algorithm, the illumination and reflectance components were updated accurately. Experimental results on several public datasets verify the effectiveness of the proposed model subjectively and objectively.
A point spread function evaluation method for a microscope on the object plane that is perpendicular to the optical axis is proposed. The measurement of the incident beam direction from the dual position-sensitive-detector (PSD)-based units, the determination of the object plane perpendicularity and the paraxial region, and evaluation methods for the point spread function (PSF) are presented and integrated into the proposed method. The experimental verification demonstrates that the proposed method can achieve a 3D PSF on the perpendicular object plane, as well as magnification, paraxial region evaluation, and confirmation for any microscopic system.
The optimisation of measurement matrix that is within the compressive sensing framework is considered in this study. Based on the fact that an information factor with smaller mutual coherence performs better, the gradient measurement matrix optimisation method is improved by an orthogonal search direction revision factor. This algorithm updates the approximation of ideal Gram matrix of information operator and the measurement matrix alternatingly. Using measurement matrix and sparse basis to represent the Gram matrix, the measurement matrix is optimised by the gradient algorithm, in which an orthogonal gradient search direction revision factor is proposed and utilised to further improve the performance of measurement matrix. This orthogonal factor is computed by the Cayley transform of a real skew symmetric matrix that is related to the gradient and the measurement matrix. Results of several experiments show that compared with the initial random matrix, the optimised measurement matrix can lead to better signal reconstruction quality.
A self-calibrating variable magnification three-dimensional (3D) tracking system for single fluorescent nanoparticles is proposed. The system was based on astigmatic micro-imaging and has a simple configuration incorporating a dual-spot position detection unit ray transfer matrix. By analyzing this matrix and utilizing the beam vector measurement of a dual-spot position detection unit, it was demonstrated that the proposed tracking system had the self-calibration functions of coaxiality and magnification; thus, it could accurately track the adopted fluorescent nanoparticles through zoom microscopical measurements in 3D. The available measurements of the proposed system and accuracy were experimentally validated.