Remote sensing super-resolution (RSSR) aims to improve remote sensing (RS) image resolution while providing finer spatial details, which is of great significance for high-quality RS image interpretation. The traditional RSSR is based on the optimization method, which pays insufficient attention to small targets and lacks the ability of model understanding and detail supplement. To alleviate the above problems, we propose the generative Diffusion Model with Detail Complement (DMDC) for RS super-resolution. Firstly, unlike traditional optimization models with insufficient image understanding, we introduce the diffusion model as a generation model into RSSR tasks and regard low-resolution images as condition information to guide image generation. Next, considering that generative models may not be able to accurately recover specific small objects and complex scenes, we propose the detail supplement task to improve the recovery ability of DMDC. Finally, the strong diversity of the diffusion model makes it possibly inappropriate in RSSR, for this purpose, we come up with joint pixel constraint loss and denoise loss to optimize the direction of inverse diffusion. The extensive qualitative and quantitative experiments demonstrate the superiority of our method in RSSR with small and dense targets. Moreover, the results from direct transfer to different datasets also prove the superior generalization ability of DMDC.
Semantic localization (SeLo) refers to locating the most relevant position in the Remote Sensing (RS) image based on the semantic information contained in the retrieved text, which is an emerging task based on cross-modal retrieval. SeLo achieves pixel-level semantic retrieval through caption-level annotations, which plays an important role in RS image-text retrieval. Although there are some researches on SeLo tasks at present, the current SeLo framework is still quite violent, which consumes a lot of resources. In this paper, based on the existing work, we conduct a more in-depth exploration and propose SeLo v2, which greatly improves the speed and accuracy of the SeLo task. First, based on the characteristics of regional consistency of remote sensing images, a multilevel likelihood expansion (MLE) is proposed to reduce the number of cross-modal similarity calculations, and the speed of SeLo task is greatly improved by combining single-scale clipping with multi-point multi-scale expansion. Next, to enhance the accuracy, we come up with the chaotic self-feeding mechanism (CSM), which performs semantic frequency enhancement to fully extract the semantic information contained in the caption, making the generated SeLo map more detailed and accurate. Compared with the initial SeLo framework, SeLo v2 has better semantic localization performance with only half the time consumed, which shows the great advantages of SeLo v2 in terms of time and accuracy. The proposed SeLo v2 is available at Link.
1 January 2024 in IEEE Transactions on Intelligent Transportation Systems
Accurate detection of objects from LiDAR point clouds is crucial for autonomous driving and environment modeling. However, uncertainties in ground truth labels due to occlusions, sparsity, and truncation can hinder model training and performance. This paper introduces two strategies to address these issues: 1) Soft Regression Loss (SoRL) and 2) Discrete Quantization Sampling (DQS). SoRL utilizes Gaussian distributions for object predictions, measuring uncertainty based on the probability of ground truth labels within these distributions. This method effectively accounts for deviations in object location and orientation. Meanwhile, DQS introduces uncertainty scores for dynamic sample selection, aiming to refine the quality of positive samples for regression. Based on the proposed modules, we design a lightweight multi-stage object detection framework. Notably, these modules can enhance existing 3D object detection methods without affecting significantly inference speeds. Experiments over benchmark datasets show the effectiveness of our method, especially for cars in sparse point clouds.
14 November 2022 in IEEE Transactions on Neural Networks and Learning Systems
Unsupervised domain adaptation is intended to construct a reliable model for the unlabeled target samples using the well-labeled but differently distributed source samples. To tackle the domain shift issue, learning domain-invariant feature representations across domains is important, and most of the existing methods have concentrated on this goal. However, these methods rarely take into consideration the group discriminability of the feature representation, which is detrimental to the final recognition. Therefore, this article proposes a novel unsupervised domain adaptation method, named marginal subspace learning with group low-rank (MSL-GLR), to extract both domain-invariant and discriminative feature representations. Specifically, MSL-GLR uses the retargeting strategy to relax the regression matrix, such that the regression values would be forced to satisfy a margin maximization criterion for the requirement of correct classification. Moreover, MSL-GLR imposes a class-induced low-rank constraint, which enables the samples of each class to be located in their respective subspace. In this way, the distance between samples from the same class can be decreased and the discriminant ability of the projection is greatly improved. Furthermore, with the help of alternating direction method of multipliers (ADMM), an efficient algorithm is presented to solve the resulting optimization problem. Finally, the effectiveness of the proposed MSL-GLR is demonstrated by comprehensive evaluations on multiple domain adaptation benchmark datasets.