Hyperspectral anomaly detection (HAD) is an important application of hyperspectral images (HSI) that can distinguish anomalies from background in an unsupervised manner. As a common unsupervised network in deep learning, autoencoders (AE) have been widely used in HAD and can highlight anomalies by reconstructing the background. This study proposed a novel spatial–spectral joint HAD method based on a two-branch 3D convolutional autoencoder and spatial filtering. We used the two-branch 3D convolutional autoencoder to fully extract the spatial–spectral joint features and spectral interband features of HSI. In addition, we used a morphological filter and a total variance curvature filter for spatial detection. Currently, most of the datasets used to validate the performance of HAD methods are airborne HSI, and there are few available satellite-borne HSI. For this reason, we constructed a dataset of satellite-borne HSI based on the GF-5 satellite for experimental validation of our anomaly detection method. The experimental results for the airborne and satellite-borne HSI demonstrated the superior performance of the proposed method compared with six state-of-the-art methods. The area under the curve (AUC) values of our proposed method on different HSI reached above 0.9, which is higher than those of the other methods.
Hyperspectral imaging often suffers from various types of noise, including sensor non-uniformity and atmospheric disturbances. Removing multiple types of complex noise in hyperspectral images (HSIs) while preserving high fidelity in spectral dimensions is a challenging task in hyperspectral data processing. Existing methods typically focus on specific types of noise, resulting in limited applicability and an inadequate ability to handle complex noise scenarios. This paper proposes a denoising method based on a network that considers both the spatial structure and spectral differences of noise in an image data cube. The proposed network takes into account the DN value of the current band, as well as the horizontal, vertical, and spectral gradients as inputs. A multi-resolution convolutional module is employed to accurately extract spatial and spectral noise features, which are then aggregated through residual connections at different levels. Finally, the residual mixed noise is approximated. Both simulated and real case studies confirm the effectiveness of the proposed denoising method. In the simulation experiment, the average PSNR value of the denoised results reached 31.47 at a signal-to-noise ratio of 8 dB, and the experimental results on the real data set Indian Pines show that the classification accuracy of the denoised hyperspectral image (HSI) is improved by 16.31% compared to the original noisy version.
The images captured by a plane-array type infrared detector, formed by integrating a large-scale probe array and readout circuits via interconnection, is distorted by two types of superimposed nonuniform noises caused by the probe and readout circuitry. These nonuniform noises arise from the detector's constituent materials, fabrication processes, and other defects. In addition, the output response of an infrared detector is limited by the dynamic range of the circuit, the low and high ends of the output signal exhibit strong nonlinearities. To overcome the impact of detector response nonlinearity and achieve simultaneous correction for two different types of nonuniformities in infrared images, in this study, we proposed a novel correction method. First, the pixel points of all images are reordered according to their pixel values to provide a uniform reorganisation data. Then, the linear correlated region based on the recombined data is extracted using a judgment algorithm that processes the linear correlations of multiple regions to simulate the detector's response curve and find the nonuniformity correction coefficient of each pixel. Experiments on simulated noisy and real images show that our method accurately eliminates nonuniform IR noise without causing blurring and provides optimal peak signal-to-noise ratio and structural similarity.
17 January 2023 in International Journal of Remote Sensing
Infrared small target detection is critical in remote sensing, military, and other fields. However, the low resolution of most infrared images and the lack of texture and detailed information could cause the target to be lost in a relatively noisy background. Therefore, in recent years, researchers have paid particular attention to the problem of small infrared target detection. In this paper, we propose a double-layer feature fusion convolutional neural network for infrared small target detection (DLFF), consisting of a simultaneous upsampling two-layer network module and a ‘T’-type fusion structure. First, the upsampling double-layer network module shares detection information while synchronizing detection, suppressing the background noise and enhancing the detection of the target. In addition, for the small target detection task, since the direct fusion of shallow spatial information and deep semantic information may lose only some small target features, we propose a ‘T’-type fusion structure to solve this problem. Furthermore, we collate an infrared small target dataset (MDFA_SIRIST) and design a pre-processing method for pre-detection images. The experimental results show that our network outperforms the other six state-of-the-art methods in combined evaluation metrics ( -score) and mean intersection ratio (mIou).
The performance of long-wave infrared (LWIR) quantum well (QWIP) detection systems is seriously affected by the dark current of the detectors. Tiny variations in the focal-plane temperature of the devices cause fluctuations in the dark current, which in turn generate temporal noise. It is difficult to measure the dark current accurately after the detector assembly is packaged. To address the above problems, a QWIP dark current measurement method based on focal-plane temperature is proposed, as well as a method to reduce dark current noise. First, the response model of the LWIR QWIP detection system was established, and the dark current model was introduced. Then, the detection system components were introduced, chiller calibration experiments were carried out, and the dark current values of the QWIP at different temperatures were measured by combining the system design and parameters. Next, the dark current noise correction method was proposed, the target data were collected, and experiments were carried out to correct them. Finally, after the calculation, the temporal noise was reduced by 57.69% after the correction, which is proof of a significant effect. This method can obtain the real-time dark current value by collecting the focal-plane temperature data, and reduce the dark current temporal noise (difficult to eliminate using conventional methods), which is beneficial for promoting the application of QWIPs in LWIR remote sensing detection.
In infrared detectors, the readout circuits usually cause horizontal or vertical streak noise, whereas the infrared focal plane arrays experience triangular nonuniform fixed-pattern noise. In addition, imaging devices suffer from optically relevant fixed-pattern noise owing to the temperature. When the infrared camera is in orbit, it is affected by the photon effect, temperature change, and time drift. This makes the nonuniformity correction coefficients pertaining to the ground no longer applicable, resulting in the degradation of the nonuniformity correction effect. The existing methods are not fully applicable to triangular fixed-pattern noise or the fixed-pattern noise caused by detector optics. To address this situation, this paper proposes a nonuniformity correction method, namely infrared image sequences based on the optimization of group sparsity in the spatiotemporal domain. We established a nonuniformity correction model of differential operators in the spatiotemporal domain for infrared image sequences by applying the time-domain differential operator constraints to the images to denoise the image. This enables the adaptive correction of the nonuniformity of the above types of noise. We demonstrate that the proposed method is effective for triangular nonuniform and optically induced fixed-pattern noises. The proposed method was extensively evaluated using publicly available datasets and datasets containing image sequences of different scenes captured by a high-resolution infrared camera of the Qilu-2 satellite. The method has high robustness and good processing results with effective ghost suppression and significant reduction of nonuniform noise.