Drones have been widely used in a variety of applications, e.g., aerial photography and military security, because of their high maneuverability and broad views compared with fixed cameras. Multi-drone tracking systems can provide rich information about targets by collecting complementary video clips from different views, especially when targets are occluded or disappear in some views. However, it is challenging to handle cross-drone information interaction and multi-drone information fusion in multi-drone visual tracking. Recently, Transformer has shown significant advantages in automatically modeling the correlation between templates and search regions for visual tracking. To leverage its potential in multi-drone tracking, we propose a novel cross-drone Transformer network (TransMDOT) for visual object tracking tasks. The self-attention mechanism is used to automatically capture the correlation between multiple templates and the corresponding search region to achieve multi-drone feature fusion. During the tracking process, a cross-drone mapping mechanism is proposed by using the surrounding information of the drone with promising tracking status as reference, assisting drones that lost targets to re-calibrate, which implements real-time cross-drone information interaction. As the existing multi-drone evaluation metrics only consider spatial information while ignore temporal information, we further present a system perception index (SPFI) that combines both temporal and spatial information to evaluate the tracking status of multiple drones. Experiments on the MDOT dataset prove that TransMDOT greatly surpasses the state-of-the-art methods in both single-drone performance and multi-drone system fusion performance. Our code will be available on https://github.com/cgjacklin/transmdot.
30 April 2025 in IEEE Transactions on Geoscience and Remote Sensing
Very-High-Resolution (VHR) remote sensing images are characterized by extremely high spatial resolution, incorporating higher pixel density and larger image sizes, which pose challenges for existing methods to extract complex texture features. Furthermore, due to the wide-area and high-resolution imaging strategy, VHR change detection images suffer from a severe imbalance between change pixels and non-change pixels, increasing the difficulty of handling change detection tasks. To address these challenges, we introduced the Omnidirectional Selective Scan Module (OSSM), which has the capability to process long sequences. By integrating it with the lightweight Siamese Feature Pyramid Network (SFPN), we designed a hybrid CNN-Mamba backbone, referred to as SPMamba. This backbone captures both global and local information within bitemporal feature maps at each stage, enhancing the precision of texture feature extraction. Additionally, to integrate the semantic features from each branch in SPMamba and reduce noise interference from non-target change areas, we developed a Hybrid Fusion Module (HFM). The HFM consists of two fusion modules: the High-Low Channel Fusion Module (HLM) and the Bilateral Channel Fusion Module (BCM), which facilitates both feature-level and channel-level integration, enhancing the sensitivity of the model to subtle changes. Extensive experimental results demonstrate that SPMNet achieves the highest F1-score of 91.80%, 90.99%, and 96.04% on the WHU-CD, LEVIR-CD, and CDD-CD datasets, respectively, outperforming eleven state-of- the-art methods. Moreover, the effects of varying image sizes on model training are thoroughly analyzed.
Deep learning has allowed great progress to be made in obtaining more accurate prediction results for brain tumor segmentation. The current mainstream research approaches obtain segmentation accuracy improvements by modifying deep-learning model architectures, while ignoring the computational and storage efficiency issues of segmentation. In this paper, we proposed an improved knowledge distillation method: coordinate distillation (CD), which integrates channel and space information and completes brain tumor segmentation by training the student network with the teacher network without changing the original network architecture. Experimental results showed that the method was effective and that it could enhance the segmentation accuracy of brain tumors without changing the segmentation efficiency.
6 April 2023 in International Journal of Computer Assisted Radiology and Surgery
High-quality images are difficult to obtain in complex environments, such as underground or underwater. The low performance of images that are captured under low-light conditions significantly restricts the development of various engineering applications. However, existing algorithms exhibit color distortion or under/overexposure when addressing non-uniform illumination images. Furthermore, they introduce high-level noise when processing extremely dark images. In this paper, we propose a novel generative adversarial network (GAN) structure to generate high-quality enhanced images, which is called anti-attention block (AAB)-based generative adversarial networks (AABGAN). Specifically, we propose AAB to suppress undesired chromatic aberrations and establish a mapping relationship between different channels. The deep aggregation pyramid pooling module guides the network when combining multi-scale context information. Furthermore, we design a new multiple loss function to adjust images to the most suitable range for human vision. The results of extensive experiments show that our method outperforms state-of-the-art unsupervised image enhancement methods in terms of noise reduction and has a well-perceived result.