Satellite video single object tracking has attracted wide attention. The development of remote sensing platforms for earth observation technologies makes it increasingly convenient to acquire high-resolution satellite videos, which greatly accelerates ground target tracking. However, overlarge images with small object size, high similarity among multiple moving targets, and poor distinguishability between the objects and the background make this task most challenging. To solve these problems, a deep Siamese network (DSN) incorporating an interframe difference centroid inertia motion (ID-CIM) model is proposed in this paper. In object tracking tasks, the DSN inherently includes a template branch and a search branch; it extracts the features from these two branches and employs a Siamese region proposal network to obtain the position of the target in the search branch. The ID-CIM mechanism was proposed to alleviate model drift. These two modules build the ID-DSN framework and mutually reinforce the final tracking results. In addition, we also adopted existing object detection datasets for remotely sensed images to generate training datasets suitable for satellite video single object tracking. Ablation experiments were performed on six high-resolution satellite videos acquired from the International Space Station and “Jilin-1” satellites. We compared the proposed ID-DSN results with other 11 state-of-the-art trackers, including different networks and backbones. The comparison results show that our ID-DSN obtained a precision criterion of 0.927 and a success criterion of 0.694 with a frames per second (FPS) value of 32.117 implemented on a single NVIDIA GTX1070Ti GPU.
On-orbit geometric calibration is key to improving the geometric positioning accuracy of high-resolution optical remote sensing satellite data. Grouped calibration with geometric consistency (GCGC) is proposed in this paper for the Jilin1-KF01B satellite, which is the world’s first satellite capable of providing 150-km swath width and 0.5-m resolution data. To ensure the geometric accuracy of high-resolution image data, the GCGC method conducts grouped calibration of the time delay integration charge-coupled device (TDI CCD). Each group independently calibrates the exterior orientation elements to address the multi-time synchronization issues between imaging processing system (IPS). An additional inter-chip geometric positioning consistency constraint is used to enhance geometric positioning consistency in the overlapping areas between adjacent CCDs. By combining image simulation techniques associated with spectral bands, the calibrated panchromatic data are used to generate simulated multispectral reference band image as control data, thereby enhancing the geometric alignment consistency between panchromatic and multispectral data. Experimental results show that the average seamless stitching accuracy of the basic products after calibration is better than 0.6 pixels, the positioning accuracy without ground control points(GCPs) is better than 20 m, the band-to-band registration accuracy is better than 0.3 pixels, the average geometric alignment consistency between panchromatic and multispectral data are better than 0.25 multispectral pixels, the geometric accuracy with GCPs is better than 2.1 m, and the geometric alignment consistency accuracy of multi-temporal data are better than 2 m. The GCGC method significantly improves the quality of image data from the Jilin1-KF01B satellite and provide important references and practical experience for the geometric calibration of other large-swath high-resolution remote sensing satellites.
Tree precise classification and identification of forest species is a core issue of forestry resource monitoring and ecological effect assessment. In this paper, an independent tree species classification method based on fractal features of terrestrial laser point cloud is proposed. Firstly, the terrestrial laser point cloud data of an independent tree is preprocessed to obtain terrestrial point clouds of independent tree canopy. Secondly, the multi-scale box-counting dimension calculation algorithm of independent tree canopy dense terrestrial laser point cloud is proposed. Furthermore, a robust box-counting algorithm is proposed to improve the stability and accuracy of fractal dimension expression of independent tree point cloud, which implementing gross error elimination based on Random Sample Consensus. Finally, the fractal dimension of a dense terrestrial laser point cloud of independent trees is used to classify different types of independent tree species. Experiments on nine independent trees of three types show that the fractal dimension can be stabilized under large density variations, proving that the fractal features of terrestrial laser point cloud can stably express tree species characteristics, and can be used for accurate classification and recognition of forest species.
The optical remote sensors carried by the Jilin-1 KF02 series satellites have an imaging resolution better than 0.5 m and a width of 150 km. There are radiometric problems, such as stripe noise, vignetting, and inter-slice chromatic aberration, in their raw images. In this paper, a relative radiometric correction method based on temperature normalization is proposed for the response characteristics of sensors and the structural characteristics of optical splicing of Jilin-1 KF02 series satellites cameras. Firstly, a model of temperature effect on sensor output is established to correct the variation of sensor response output digital number (DN) caused by temperature variation during imaging process, and the image is normalized to a uniform temperature reference. Then, the horizontal stripe noise of the image is eliminated by using the sensor scan line and dark pixel information, and the vertical stripe noise of the image is eliminated by using the method of on-orbit histogram statistics. Finally, the method of superposition compensation is used to correct the vignetting area at the edge of the image due to the lack of energy information received by the sensor so as to ensure the consistency of the image in color and image quality. The proposed method is verified by Jilin-1 KF02A on-orbit images. Experimental results show that the image response is uniform, the color is consistent, the average Streak Metrics (SM) is better than 0.1%, Root-Mean-Square Deviation of the Mean Line (RA) and Generalized Noise (GN) are better than 2%, Relative Average Spectral Error (RASE) and Relative Average Spectral Error (ERGAS) are greatly improved, which are better than 5% and 13, respectively, and the relative radiation quality is obviously improved after relative radiation correction.
On-orbit absolute radiometric calibration tracks sensor radiometric degradation and ensures accuracy for quantitative applications. Low-cost commercial satellites lack expensive on-board calibration systems, and traditional alternative methods cannot achieve automated, reliable calibration for large sensor fleets with low resource consumption. Pseudo-invariant calibration sites require no ground instruments, but commercial satellites’ heavy imaging schedules hinder frequent PICS observations. The Jilin-1 constellation is a large commercial constellation composed of satellites carrying multispectral imagers with resolution better than 1 m, and it has no on-board calibration system. Thus, an automated calibration method applicable to numerous imagers is needed, one that requires widely available clear-sky ground targets. Using MCD43A2 and MCD12Q1 products, we generate calibration region vectors to transfer the MODIS radiometric reference to Jilin-1. A look-up table (LUT) is constructed for the input parameters of the MODTRAN model. Calibration pixels and model input parameters are then extracted from Jilin-1 imagery using the region vectors, the LUT is interpolated to obtain the at-aperture radiance for each pixel and band, and on-orbit absolute radiometric calibration coefficients are calculated. The proposed method requires no ground-based synchronous experiments, achieves a high level of automation, and does not consume commercial imaging resources. The site calibration validation based on RadCalNet for the JL1GF02F PMS1 sensor shows that the maximum relative difference in the method across all bands is less than 4%.