Infrared images often carry obvious streak noises due to the non-uniformity of the infrared detector and the readout circuit. These streak noises greatly affect the image quality, adding difficulty to subsequent image processing. Compared with current elimination algorithms for infrared stripe noises, our approach fully utilizes the difference between the stripe noise components and the actual information components, takes the gradient sparsity along the stripe direction and the global sparsity of the stripe noises as regular terms, and treats the sparsity of the components across the stripe direction as a fidelity term. On this basis, an adaptive edge-preserving operator (AEPO) based on edge contrast was proposed to protect the image edge and, thus, prevent the loss of edge details. The final solution was obtained by the alternating direction method of multipliers (ADMM). To verify the effectiveness of our approach, many real experiments were carried out to compare it with state-of-the-art methods in two aspects: subjective judgment and objective indices. Experimental results demonstrate the superiority of our approach.
30 May 2022 in Computational Intelligence and Neuroscience
The non-uniformity present in the infrared detector and readout circuit leads to significant stripe noises in the infrared images. The effect of these stripe noises on infrared images brings trouble to the subsequent research. The currently available algorithms for removing infrared streak noises cannot effectively protect the non-stripe information while removing the stripe noise. Compared with these algorithms, our algorithm uses a multi-scale wavelet transform to concentrate the streak noise by frequency into vertical components of different scale levels. Then, our algorithm analyzes the unique properties of the streak noise compared to the ideal vertical component. The denoising model of the vertical component at each level is established with its multinomial sparsity, and the streak noise is removed by the alternating direction method of multipliers (ADMM) algorithm for optimal calculation. To prove the usefulness of our algorithm, we carried out a large series of real experiments, comparing it with the most advanced algorithms in terms of both subjective determination and objective indices. The experimental results fully demonstrate the superiority and effectiveness of our algorithm.
Shadows in very high-resolution multispectral remote sensing images hinder many applications, such as change detection, target recognition, and image classification. Though a wide variety of significant research has explored shadow detection, shadow pixels are still more or less omitted and are wrongly confused with vegetation pixels in some cases. In this study, to further manage the problems of shadow omission and vegetation misclassification, a mixed property-based shadow index is developed for detecting shadows in very high-resolution multispectral remote sensing images based on the difference of the hue component and the intensity component between shadows and nonshadows, and the difference of the reflectivity of the red band and the near infrared band between shadows and vegetation cover in nonshadows. Then, the final shadow mask is achieved, with an optimal threshold automatically obtained from the index image histogram. To validate the effectiveness of our approach for shadow detection, three test images are selected from the multispectral WorldView-3 images of Rio de Janeiro, Brazil, and are tested with our method. When compared with other investigated standard shadow detection methods, the resulting images produced by our method deliver a higher average overall accuracy (95.02%) and a better visual sense. The highly accurate data show the efficacy and stability of the proposed approach in appropriately detecting shadows and correctly classifying shadow pixels against the vegetation pixels for very high-resolution multispectral remote sensing images.
The non-uniformity of infrared detectors’ readout circuits can lead to stripe noise in infrared images, which affects their effective information and poses challenges for subsequent applications. Traditional denoising algorithms have limited effectiveness in maintaining effective information. This paper proposes a multi-level image decomposition method based on an improved LatLRR (MIDILatLRR). By utilizing the global low-rank structural characteristics of stripe noise, the noise and smooth information are decomposed into low-rank part images, and texture information is adaptively decomposed into several salient part images, thereby better preserving texture edge information in the image. Sparse terms are constructed according to the smoothness of the effective information in the final low-rank part of the image and the sparsity of the stripe noise direction. The modeling of stripe noise is achieved using multi-sparse constraint representation (MSCR), and the Alternating Direction Method of Multipliers (ADMM) is used for calculation. Extensive experiments demonstrated the proposed algorithm’s effectiveness and compared it with state-of-the-art algorithms in subjective judgments and objective indicators. The experimental results fully demonstrate the proposed algorithm’s superiority and efficacy.
Low-light images are prevalent in intelligent monitoring and many other applications, with low brightness hindering further processing. Although low-light image enhancement can reduce the influence of such problems, current methods often involve a complex network structure or many iterations, which are not conducive to their efficiency. This paper proposes a Zero-Reference Camera Response Network using a camera response model to achieve efficient enhancement for arbitrary low-light images. A double-layer parameter-generating network with a streamlined structure is established to extract the exposure ratio from the radiation map, which is obtained by inverting the input through a camera response function. Then, is used as the parameter of a brightness transformation function for one transformation on the low-light image to realize enhancement. In addition, a contrast-preserving brightness loss and an edge-preserving smoothness loss are designed without the requirement for references from the dataset. Both can further retain some key information in the inputs to improve precision. The enhancement is simplified and can reach more than twice the speed of similar methods. Extensive experiments on several LLIE datasets and the DARK FACE face detection dataset fully demonstrate our method’s advantages, both subjectively and objectively.
Infrared remote sensing images are often degraded by blur and stripe noise caused by satellite attitude variations, optical distortions, and electronic interference, which significantly compromise image quality and target detection performance. Existing joint deblurring and destriping methods tend to over-smooth image edges and textures, failing to effectively preserve high-frequency details and sometimes misclassifying ringing artifacts as stripes. This paper proposes a variational framework for simultaneous deblurring and destriping of infrared remote sensing images. By leveraging an adaptive structure tensor model, the method exploits the sparsity and directionality of stripe noise, thereby enhancing edge and detail preservation. During blur kernel estimation, a fidelity term orthogonal to the stripe direction is introduced to suppress noise and residual stripes. In the image restoration stage, a WCOB (Non-blind restoration based on Wiener-Cosine composite filtering) model is proposed to effectively mitigate ringing artifacts and visual distortions. The overall optimization problem is efficiently solved using the alternating direction method of multipliers (ADMM). Extensive experiments on real infrared remote sensing datasets demonstrate that the proposed method achieves superior denoising and restoration performance, exhibiting strong robustness and practical applicability.