Knowledge distillation has been one of the most effective methods for enhancing the performance of lightweight detectors, crucial for remote sensing edge intelligence models. However, many mainstream distillation methods that are centered around the paradigm of distilling positive sample show weak exploitation of the student’s potential. This arises due to these methods overlooking the core teacher-student difference in remote sensing scenarios with vast and object-similar background. In this article, from the point of distillation sample and knowledge hierarchy, we design a negative-core sample knowledge distillation (NSD) method for improving the performance of the lightweight object detection model. Specifically, a negative-core sample (NCS) is innovatively employed to transfer effective background discrimination knowledge for bridging the core difference. Knowledge distillation for NCS across four levels—pixel, logit, box, and angle are customized to fully leverage the teacher’s insights. Category direction estimation(CE) is incorporated into the angle knowledge distillation to more effectively convey NCS oriented knowledge in a discrete manner. Extensive experiments conducted on multiple remote sensing datasets achieve state-of-the-art performance, demonstrating the effectiveness of the proposed NSD. Codes are available at https://github.com/Changan00/NSD.
Trajectory prediction has become increasingly critical in various applications such as autonomous driving and robotic navigation. However, due to the significant variations in trajectory patterns across different scenarios, models trained in known environments often falter in unseen ones. To learn a generalized model that can directly handle unseen domains without requiring any model updating, we propose a novel tailored meta-learning-based trajectory prediction model called DTM. Our approach integrates a dual trajectory transformer (Dual_TT) equipped with an agent-consistency loss, facilitating a comprehensive exploration of both individual intentions and group dynamics across diverse scenarios. Building on this, we propose a tailored meta-learning framework (TMG) to simulate the generalization process between source and target domains during the training phase. In the task construction phase, we employ multi-dimensional labels to precisely define and distinguish between different domains. During the dual-phase parameter update, we partially fix crucial attention mechanism parameters and apply an attention alignment loss to harmonize domain-invariant and specific features. We also incorporate a Serial and Parallel Training (SPT) strategy to significantly enhance task processing and the model’s adaptability to domain shifts. Extensive testing across various domains demonstrates that our DTM model not only outperforms existing top-performing baselines on real-world datasets but also validates the effectiveness of our design through ablation studies.