The Mars exploration mission of China named Tianwen-1 is being carried out as scheduled. The Navigation and Terrain Cameras (NaTeCam) equipped on the Zhurong Rover play an essential role in obstacle recognition. The main obstacles on the Martian surface are rocks of different sizes, which influence the path planning of Zhurong Rover in scientific exploration. Most existing semantic segmentation methods are based on the U-Net architecture with ResNet or other backbones, and features extracted by these methods lack of the long-range dependencies. To fully exploit the context information, we propose the MarsNet framework for Mars image, which combines Transformers with the convolutional neural network as the backbone, and hybrid dilated convolution (HDC) is also employed to the decoder path to help detect the huge rocks. Besides, since there are few open-source datasets for rock segmentation for Mars, we establish a segmentation dataset from Martian surface image, named TWMARS, captured by NaTeCam. Extensive experiments are conducted on TWMARS dataset, and the experimental results demonstrate that MarsNet achieves accurate rock segmentation and outperforms state-of-the-art methods. The source code is available at: https://github.com/BUPT-ANT-1007/MarsNet.
Rocks, prominent features on the surface of Mars, are a primary focus of Mars exploration missions. The accuracy of recognizing rock information, including size and position, deeply affects the path planning for rovers on Mars and the geological exploration of Mars. In this paper, we present a rock measurement method for the Mars surface based on a Rover Attitude and Camera Parameter (RACP). We analyze the imaging process of the Navigation and Terrain Camera (NaTeCam) on the Zhurong rover, which involves utilizing a semi-spherical model (SSM) to characterize the camera’s attitude, a projection model (PM) to connect the image data with the three-dimensional (3D) environment, and then estimating the distance and size of rocks. We conduct a test on NaTeCam images and find that the method is effective in measuring the distance and size to Martian rocks and identifying rocks at specific locations. Furthermore, an analysis of the impact of uncertain factors is conducted. The proposed RACP method offers a reliable solution for automatically analyzing the rocks on Mars, which provides a possible solution for the route planning in similar tasks.
16 May 2022 in IEEE Geoscience and Remote Sensing Letters
In China’s Tianwen-1 mission for Mars exploration, Zhurong rover carries the Navigation and Terrain Camera (NaTeCam) and collects a lot of terrains and topographic data. For the scientific popularization of Mars, a virtual reality roaming based on panoramic stitching presents the Martian surface in detail and provides an immersive experience for users. However, the current Mars roaming systems focus on global information instead of details, and the traditional panoramic stitching methods are not suitable for Mars images. This letter proposes a panoramic stitching method and develops a 3DoF+ Mars roaming system. The proposed stitching-combines-features-and-projection (SCFP) jointly considers the extracted features of images and projection based on intrinsic camera parameters, which improves the matching effect and execution efficiency. Experimental results indicate that the SCFP reduces the computational time and improves stitching results than state-of-the-art methods. Furthermore, we design and deploy the 3DoF+ roaming system based on panoramic stitching with datasets obtained from the Tianwen-1 mission.