13 December 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Accurate detection of small objects plays an important role in the application of unmanned aerial vehicles (UAV). However, current works mainly extract comprehensive features from unimodal images, which can obtain very limited distinguishable features for objects, especially those with small sizes. To address this issue, we propose a dynamic cascade cross-modal co-assisted network(DCCCNet), which integrates multimodal images fusion and fine-grained feature learning to generate powerful object semantic representations. Specifically, we design a multimodal high-order interaction module (MHl) to achieve collaborative interaction of spatial details and channel dependencies between modalities, thereby enhancing object discrimination. To preserve multimodal fine-grained details, we devise a scale-adaptive dynamic feature prompt (SADFP) module, which dynamically motivate the backbone network to capture feature degradation clues. Meanwhile, to maintain the spatial correlation of multi-modal cross-scale features and improve the quality of feature fusion, we derive an global collaborative enhancement (GCE) module into feature pyramid network(FPN) for enhancing the detection accuracy across multiple scales. Extensive experimental results on multimodal datasets have shown that our method achieves favorable performance, surpassing other state-of-the-art methods.