28 March 2022 in Journal of Geophysical Research: Planets
The Chinese Mars rover Zhurong onboard the Tianwen‐1 probe successfully landed on Mars in May 2021. Here, we report our efforts in selecting a landing site for Zhurong within a pre‐identified landing region in southern Utopia Planitia. Using the high‐resolution images collected by a camera onboard the Tianwen‐1 orbiter, the landing region was analyzed in detail in terms of surface slopes, crater densities and rock abundances, which enabled the optimized determination of a landing ellipse (56 × 22 km for the major and minor axes) with minimum hazards and assisted the successful landing of the Zhurong rover. We also characterized the landing site and region after landing. Surface images captured by a camera onboard the Zhurong rover revealed a low rock abundance of approximately 4% at the landing site, similar to the rock measurements from orbital data before landing. Images of the surface features and a hole excavated by the pulsed retrorockets beneath the lander suggested a shallow regolith structure with a surficial layer of dust and sand over a layer of duricrust, and brecciated/fragmented rocks and bedrocks beneath. Crater size‐frequency distribution analysis indicated that the landing region might have experienced multiple episodes of resurfacing.
16 June 2021 in Earth and Space Science
This paper presents our efforts to characterize the candidate landing region (109°–133°E, 23°–30°N) for Tianwen‐1, China's first mission to Mars, in terms of engineering safety and scientific significance. Topographic analysis reveals that the region has a low elevation around −4,230 m, and 98% of the region have slopes smaller than 8°. The geomorphological mapping and analysis show that the region has an average crater density of about 28 craters (≥200 m in diameter) per 100 square kilometers, with several clusters of high crater densities distributed around the center of the region. There are also pitted cones distributed mainly in the southern part of the region, with a density of approximately 6.6 cones per 100 square kilometers in specific local areas. The region has rock abundances ranging from 1% to 23%, with local clusters of low and high rock abundances. The region comprises four main geological units, including a lowland unit formed in the Late Hesperian and a volcanic unit formed in the Amazonian and Hesperian period. Their specific surface ages are estimated through the analysis of crater size‐frequency distribution. Combining the engineering constraints on surface slopes, crater density, cone density, and rock abundance, a hazard map of the candidate landing region is generated for landing site evaluation and safety assessment. Based on the results, we further discuss the potential scientific outcomes from the exploration in this region. The findings will be helpful for the mission planning and maximization of the scientific return from Tianwen‐1, and complement existing Martian scientific research.
26 July 2022 in IEEE Transactions on Geoscience and Remote Sensing
The high-resolution imaging camera (HiRIC) onboard China’s Tianwen-1 Mars probe aims to acquire detailed imagery of the Martian surface to comprehensively investigate its topography and geomorphology. The HiRIC is a pushbroom camera comprising three CCDs to simultaneously achieve submeter resolution and a large swath. However, processing HiRIC images using the conventional photogrammetric workflow is difficult due to the large shifts and narrow overlapping among the CCD lines. This article presents a novel approach for photogrammetric processing of HiRIC images for precision topographic mapping that incorporates: 1) the fitting of the initial rational polynomial coefficients (RPCs) of images from the HiRIC position and pointing data; 2) a deep-learning-based method for tie-point matching between adjacent CCD images and cross-orbit images; 3) the bundle adjustment of multiple CCD images for tripled-epipolar image generation to ensure inner orbit consistency; 4) the block adjustment of multiple orbit images to ensure cross-orbit consistency; and 5) dense image matching and space intersection based on the refined RPCs to generate digital elevation models (DEMs). Experimental analyses were conducted using HiRIC images covering the landing region of the Zhurong rover. The results revealed that subpixel accuracy was achieved for image residuals among multiple-CCD or multiple-orbit images. Comparison with the reference data (HiRISE and MOLA DEMs) revealed a mean deviation of less than 7 m in terms of the geometric accuracy and the subtle topographic details of the HiRIC DEM. The presented approach offers a reliable solution for using the new dataset of HiRIC imagery for Mars topographic mapping.
2 May 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
This article tackles the visual localization of unmanned aerial vehicles (UAVs) in the presence of multisource and cross-view images are involved. We present a lightweight end-to-end scene graph encoding and matching network that finds the best matches for the airborne camera views from the reference image maps. The scene graph addresses the challenges of encoding the semantic scene by aggregating the image convolutional features into global and structured semiglobal descriptors. The principal contributions of this article are as follows: First, we develop a new network architecture that embeds a nonlocal block and a modified vector of locally aggregated descriptors network (NetVLAD) into a backbone convolutional neural network. The main component of the modified NetVLAD is a cluster similarity masking graph (CSMG) encoder, which is proposed to replace the feature-cluster residuals computing in NetVLAD with cluster consensus feature aggregation and structure-aware scene graph extraction. In addition, a global descriptor is extracted by a nonlocal block to label each image with a discriminative global feature descriptor. Second, we develop a new triplet loss for the network training procedure to learn the features at different semantic levels. The proposed global descriptor and CSMG encoder are trained together according to a weighted sum of cosine triplet losses. Third, the global descriptor from the nonlocal block and semiglobal descriptor from the CSMG encoder work hierarchically for coarse-to-fine image retrieval and can achieve real-time efficiency and favorable accuracy of image searching and matching from the reference image map. We train and test the model on two challenging benchmark datasets. We also test the pretrained model on a dataset collected by a fixed-wing UAV to further evaluate the model's generalizability. The benchmark evaluations and ablation experiments show that the developed method outperforms state-of-the-art methods and achieves superior performance in the real-time matching of UAV images and reference image maps for UAV visual localization. Open-source code is available on GitHub.
1 May 2021 in Photogrammetric Engineering & Remote Sensing
Real-time acquisition and analysis of three-dimensional (3D) human body kinematics are essential in many applications. In this paper, we present a real-time photogrammetric system consisting of a stereo pair of red-green-blue (RGB) cameras. The system incorporates a multi-threaded and graphics processing unit (GPU)-accelerated solution for real-time extraction of 3D human kinematics. A deep learning approach is adopted to automatically extract two-dimensional (2D) human body features, which are then converted to 3D features based on photogrammetric processing, including dense image matching and triangulation. The multi-threading scheme and GPU-acceleration enable real-time acquisition and monitoring of 3D human body kinematics. Experimental analysis verified that the system processing rate reached ∼18 frames per second. The effective detection distance reached 15 m, with a geometric accuracy of better than 1% of the distance within a range of 12 m. The real-time measurement accuracy for human body kinematics ranged from 0.8% to 7.5%. The results suggest that the proposed system is capable of real-time acquisition and monitoring of 3D human kinematics with favorable performance, showing great potential for various applications.