23 March 2020 in IEEE Transactions on Geoscience and Remote Sensing
Through the use of video technology, satellites can detect dynamic targets and analyze their motion characteristics. Target tracking can extract dynamic information about key ground targets for target monitoring and trajectory prediction by satellite video. Tracking algorithms are affected by target motion characteristics, such as velocity and direction, as well as background characteristics, such as illumination changes, occlusion, and background similarities with the target. However, these problems are seldom studied with satellite video cameras. Current algorithms are unsuitable for satellite video because of the poor texture and color features of the target in satellite video. Therefore, in this article, we enhance target tracking for satellite video technology using two aspects: 1) sample training strategy and 2) sample characterization. We establish a filter training mechanism for the target and background to improve the discrimination ability of the tracking algorithm. We then build a target feature model using a Gabor filter to enhance the contrast between the target and background. Moreover, we propose a tracking state evaluation index to avoid tracking drift. Tracking experiments using nine sets of Jilin-1 satellite videos show that the proposed approach can accurately locate a target under weak feature attributes. Therefore, this article contributes to more robust tracking using satellite video technology.
4 August 2022 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Accurate registration between synthetic aperture radar (SAR) images is the basis for high-precision geometric correction of SAR images. The feature points extracted by conventional feature extraction methods are unsatisfactory, which are affected by imaging geometric characteristics and speckle noise of SAR images. This article innovatively proposes a spaceborne SAR image feature learning framework to realize automatic sample generation and model training. It mainly includes two modules: The feature sample generation module based on the initial geometric information of spaceborne SAR. The initial rational polynomial coefficient (RPC) parameters of the spaceborne SAR are adopted to realize the initial positioning of the SAR image, and a variety of feature extraction operators are used to match the overlapping areas to obtain high-precision matching points, which are employed as training samples for image pairs; pseudo-Siamese feature learning network SARPointNet for SAR image feature learning. The pseudo-Siamese network is used to extract the feature points and descriptors of the sample image pairs. The feature optimization process is realized through the descriptor constraints between image pairs, which promotes the network to improve the accuracy of feature extraction. The proposed method has been tested in mountain, hilly, flatland, and urban scenarios, respectively. The results demonstrate that the correspondence points extracted by SARPointNet are evenly distributed, are in large quantities (at least ten times that of other methods), and achieve high precision (the root mean square error is less than 1 pixels), which shows great advantages over other methods.
8 January 2021 in IEEE Transactions on Geoscience and Remote Sensing
Synthetic aperture radar (SAR) images reveal severe geometric distortions especially in the mountain area, such as layover, which is caused by imaging characteristics of SAR itself and terrain undulations. The layover phenomenon greatly limits the application of SAR images. This article proposes a layover compensation method for regional spaceborne SAR imagery without ground control points (GCPs), which is mainly improved from two aspects. First, a method based on rational function model (RFM) to determine the layover range is proposed. Second, based on geometric calibration and block adjustment, the processing flow is optimized to generate digital orthophoto map (DOM) which greatly eliminated the influence of layover. The proposed method was applied to Chinese Gaofen-3 (GF-3) SAR regional images, including the ascending and descending track stacks. The result showed that 84.5% of the layover pixels on the regional DOM were compensated, which verified the effectiveness and feasibility of the method.
8 November 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Remote sensing sensor platforms are typically located at a significant distance from the ground, ranging from several hundred meters to hundreds of kilometers. This means that, compared to natural images, remote sensing images (RSI) have larger coverage areas and more complex information. The larger size and data volume of RSI presents challenges for computer vision matching algorithms (MAs), making it difficult to apply them directly to RSI matching. Moreover, a matching framework for multi-source remote sensing images capable of large-scale processing by integrating multiple MAs with the entire RSI as input is presently lacking. This study proposes a Tie Points (TPs) Matching Framework of Multi-Source Remote Sensing Images (MSRSI-TPMF) based on the geometric and radiation characteristics of RSI. First, RSI is divided into different grids and undergo local geometry correction. Next, matching between slice images are performed by MAs. Finally, TPs are generated by mapping matched points in multiple slice images to the whole RSI using a geometric processing model. Six representative MAs including artificial feature matching algorithms and deep learning algorithms are integrated into the framework to match TPs from different RSI. Results demonstrate the extraction of TPs for multi-source RSI, validating the framework's efficacy. In addition, a large-scale TPs matching test for deep learning matching algorithm is performed by using 13 synthetic aperture radar (SAR) images (10m resolution) with TPs root mean square error (RMSE) of 0.368 pixels, further confirming the framework's reliability. Our framework is available at https://github.com/TobyChengV1/MSRSI-TPMF .