11 April 2019 in Applied Optics
The aim of infrared and visible image fusion is to obtain an integrated image that contains obvious object information and high spatial resolution background information. The integrated image is more conductive for a human or a machine to understand and mine the information contained in the image. To attain this purpose, a fusion algorithm based on multi-level Gaussian curvature filtering (MLGCF) image decomposition is proposed. First, a MLGCF is presented and employed to decompose the input source images into three different layers: small-scale, large-scale, and base layers. Then, three fusion strategies—max-value, integrated, and energy-based—are applied to combine the three types of layers, which are based on the different properties of the three types of layers. Finally, the fusion image is reconstructed by summing the three types of fused layers. Six groups of experiments demonstrate that the proposed algorithm performs effectively in most cases by subjective and objective evaluations and even exceeds many high-level fusion algorithms.
26 June 2020 in IEEE Access
Most CNN-based super-resolution networks require a large number of samples for model training, which may cause overfitting when trained on a specific set, and the internal self-similarity of the test image in this way has also been discarded. To resolve this problem, this paper proposes a novel zero-shot learning (ZSL) network for super resolution. In this model, the training samples are cropped from the input image, which means no extra dataset is required for model training, the overfitting problem in this way can be well avoided. Besides, since all the training samples are cropped from the input itself, the nonlocal self-similarity attributes of the test image can be fully utilized. Moreover, the efficient spatial pyramid of dilated convolutions network with bottleneck (ESP-BNet) is applied in the model as an efficient computational structure to enhance the feature representation. Comparison experiments show that the proposed approach achieves PSNR/SSIM of 31.13dB/87.9% on Set5 dataset and PSNR/SSIM of 27.62dB/78.1% on Set14 dataset, which is around 3dB better than the traditional method and about 1dB higher than those of the state-of-art method.
9 November 2024 in Nonlinear Dynamics
20 May 2020 in IEEE Access
Single image reflection removal is of great practical importance for various computer vision tasks. Most non-learning methods try to solve this problem through the model-optimization scheme, which fails to produce promising results due to the shortage of suitable priors to model the difference between the reflection layer and the transmission layer. This paper presents an improved generative adversarial network to resolve this problem. First, we suggest that reflection removal is not only a channel-wise separation problem, but also a spatial variational occlusion removal task, which is sensitive to both spatial and channel-wise features. To this end, we integrate the CBAM module into the generator to enhance both spatial and channel-wise feature representation. Second, we consider the reflection layer as a spatial mask with space-relevant reflection intensity information, which can be used to elevate the performance of the discriminator. We then design a novel SNGAN structure with utilize the predicted reflection as a guidance to achieve better adversarial supervision. Specifically, our new generative network has an encoder-decoder structure with skip-connections, where the attention enhancement block is integrated into each skip-connection of the encoder-decoder subnet, and followed by an eight-layer fully convolutional subnet. Furthermore, the SNGAN loss is combined with L2 pixel loss and L1 VGG19 perceptual loss for training. The experimental results with benchmark datasets indicate that our method outperforms several state-of-the-art networks.