10 November 2023 in ACM Computing Surveys
The rain removal task is to restore a clean image from the contaminated image by separating the background. Since the rise of deep learning in 2016, the task of image deraining has also stepped into the era of deep learning. Numerous researchers have devoted themselves to the field of computer vision and pattern recognition. However, there is still a lack of comprehensive review papers focused on using deep learning to perform rain removal tasks. In this paper, we present a comprehensive review of single image deraining based on deep learning over the past ten years. Two categories of deraining methods are discussed: the data-driven approach and the data-model-based approach. For the first type, we compare the existing network structures and loss functions. For the second type, we analyze the combination of different deraining models with deep learning, and each branch method is introduced in detail. Additionally, we quantitatively investigate the performances of the existing state-of-the-art methods on both publicly synthetic and real datasets. The trend of image deraining is also discussed.
26 November 2021 in IEEE Transactions on Cognitive and Developmental Systems
Single image rain removal (SIRR) based on deep learning has long been a problem of great interest in lowlevel vision systems. However, traditional convolutional neural network (CNN) based approaches fail to capture long-range location dependencies effectively and may cause the image background blurred. In this paper, we propose a knowledge distilling deraining network (KDRN) to address the SIRR problem. In the proposed network, the teacher regards rain streaks as a linear combination of many residual networks. It is used for image reconstruction at different resolutions. With the aid of teacher network, the proposed deraining network performs better. A spatial channel aggregation residual attention block (SCARAB) is designed to remove the rain streaks. The block not only concentrates on the rain streak features but also captures the spatial-channel information of the image. For the network structure, we used an end-to-end approach to design the teacher and student networks separately. The proposed KDRN obtains the predicted residual image by a combination of the stage-wise results and original input image. Extensive experiments show that the proposed KDRN obtains better subjective quality than most of the compared methods, on both heavy and light rain datasets.
15 April 2024 in Optics Communications
17 April 2023 in IEEE Sensors Journal
Terahertz (THz) has been widely used in radar, remote sensing, atmospheric and environmental monitoring, real-time biological information extraction, and medical diagnosis. However, the long-wavelength property of THz leads to low imaging resolution. Due to the expensive nature of experimental equipment and the difficulty of obtaining terahertz sources, most scientific institutions have difficulty in obtaining large amounts of terahertz dataset. In addition, it is difficult for convolution neural networks to recover low-resolution complex images because of the phase information contained in the images. In this paper, we build a terahertz imaging system and propose a Progressive Multi-scale Augmented Neural Network (PMANN) to address this problem. PMANN integrates self-attention and channel-attention for image contextual feature extraction by the proposed progressive network. Compared with the Complex convolution Neural Network (CCNN) in private cartoon datasets, PMANN improves the quantitative metrics on PSNR by about 18.6%. It also obtains better visual quality than CCNN. Moreover, we publicly and synthesize the first grayscale image MinistTHz dataset. Compared to SwinTransformer, PMANN improves the PSNR by 28.2%. The experimental results on the THz dataset demonstrate that the proposed model achieves better performances than the state-of-the-art models. Our synthetic THz dataset is open at https://github.com/szpxmu/PMANN.
26 March 2026 in IEEE Geoscience and Remote Sensing Letters
Satellite imagery is indispensable for military reconnaissance and environmental monitoring, yet haze pollution severely degrades image quality and target recognition accuracy. Existing methods relying solely on the RGB color space often lead to suboptimal dehazing results with residual haze artifacts. To overcome this limitation, we propose a YCbCr and Depth-guided Collaborative Network (YDCNet) by integrating depth estimation and YCbCr features. First, a multi-stage architecture incorporating a frequency-domain attention-guided module (SWATT) is constructed to strengthen feature representation in both spatial and frequency domains. Second, a dilated shiftwise attention convolution module is designed to extract haze features with a large receptive field. Finally, a hybrid YCbCr feature constraint strategy is introduced, which suppresses color distortion through joint optimization and coordination of the depth estimation network and the pyramid network. Experiments show that YDCNet can achieve significant improvements in terms of PSNR and SSIM metrics, effectively improving visual quality.
18 August 2025 in Image and Vision Computing