Infrared and visible image match is an important research topic in the field of multi-modality image processing. Due to the difference of image contents like pixel intensities and gradients caused by disparate spectrums, it is a great challenge for infrared and visible image match in terms of the detection repeatability and the matching accuracy. To improve the matching performance, a feature detection and description method based on consistent edge structures of images (DDCE) is proposed in this paper. First, consistent edge structures are detected to obtain similar contents of infrared and visible images. Second, common feature points of infrared and visible images are extracted based on the consistent edge structures. Third, feature descriptions are established according to the edge structure attributes including edge length and edge orientation. Lastly, feature correspondences are calculated according to the distance of feature descriptions. Due to the utilization of consistent edge structures of infrared and visible images, the proposed DDCE method can improve the detection repeatability and the matching accuracy. DDCE is evaluated on two public datasets and are compared with several state-of-the-art methods. Experimental results demonstrate that DDCE can achieve superior performance against other methods for infrared and visible image match.
To effectively separate low-contrast weak drone objects from complex backgrounds, the IRWT-YOLO model is proposed, in which image segmentation algorithms are leveraged to reduce background interference. The model integrates object detection and image segmentation, with segmentation utilized to extract additional image information. Furthermore, to address the challenges of limited receptive fields and weak contextual communication in infrared weak object detection, the DCPPA and RCSCAA modules are introduced. The DCPPA module employs dual convolutions to expand the receptive field and enhance feature extraction for weak drone objects. The RCSCAA module incorporates a contextual attention mechanism to capture long-range dependencies and extract multi-scale texture features. Extensive experiments on three datasets demonstrate the superiority of IRWT-YOLO, with a precision improvement of 15.5% on the SIRSTv2 dataset, a recall improvement of 14.5% on the IRSTD-1k dataset, and a 21.0% improvement in on the 3rd Anti-UAV dataset compared to YOLOv8. These results highlight the model’s robustness and effectiveness in detecting weak objects under complex infrared conditions.
28 December 2023 in Neural Computing and Applications