10 November 2022 in IEEE Transactions on Instrumentation and Measurement
In general, the goal of existing infrared and visible image fusion (IVIF) methods is to make the fused image contain both the high-contrast regions of the infrared image and the texture details of the visible image. However, this definition would lead the fusion image losing information from the visible image in high-contrast areas. For this problem, this paper proposed a decoupling network-based IVIF method (DNFusion), which utilizes the decoupled maps to design additional constraints on the network to force the network to retain the saliency information of the source image effectively. The current definition of image fusion is satisfied while effectively maintaining the saliency objective of the source images. Specifically, the feature interaction module inside effectively facilitates the information exchange within the encoder and improves the utilization of complementary information. Also, a hybrid loss function constructed with weight fidelity loss, gradient loss, and decoupling loss which ensures the fusion image to be generated to effectively preserves the source image’s texture details and luminance information. The qualitative and quantitative comparison of extensive experiments demonstrates that our model can generate a fused image containing saliency objects and clear details of the source images, and the method we proposed has a better performance than other state-of-the-art methods.
9 November 2021 in IEEE Transactions on Cognitive and Developmental Systems
Multi-focus image fusion (MFIF) is to produce an all-in-focus fused image by integrating a pair of multi-focus images with the same scene. In this paper, an effective focus detection method is proposed for MFIF, by a Generative Adversarial Net-work (GAN) with preference learning. Benefit from more obvious focus characteristics from the luminance channel in HSV, we take this luminance as the input of our GAN to carry out the easier fo-cus detection, instead of the gray-scale images in existing methods. On the other hand, to train our GAN more effectively, we utilize ℓ norm to construct a focus fidelity loss with structural group sparseness, to regularize the generator loss, pledging a more accu-rate focus confidence map. More importantly, a novel learning strategy termed preference learning is further developed to en-hance model training. Functionally, it assigns a larger learning weight to a sample more difficult to be learned. Extensive experi-ments demonstrate that our proposed method is superior to other state-of-the-art methods.