Zhong Wang

Zhong Wang

Auto-generated profile, based on publicly available information

Zhong Wang

School of Software Engineering, Tongji University, Shanghai, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 April 2022 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
ZWZhong Wang
Zhong Wang
LZLin Zhang
Lin Zhang
YSYing Shen
Ying Shen
YZYicong Zhou
Yicong Zhou
Simultaneous localization and mapping via LiDAR-Inertial fusion is a crucial technology in many automation-related applications. Recently, a number of approaches based on geometric features have evolved, yielding impressive results via tightly-coupled estimation. This sort of feature-based techniques, however, are inextricably linked to the scanning mechanism of the LiDAR, relying on stable feature detection, and thus are difficult to adapt to multi-LiDAR systems. A few direct solutions, on the other hand, register the raw point cloud with the built probability map, which is more computationally efficient and easy to be extended. But, the existing direct approaches are all loosely-coupled, lacking correction of the IMU biases, and thus only work well in 2D cases. To this end, we present D-LIOM, a tightly-coupled Direct LiDAR-Inertial Odometry and Mapping framework. In D-LIOM, a scan is directly registered to a probability submap, and the LiDAR odometry, the IMU pre-integration, and the gravity constraint are integrated to build a local factor graph in the submap's time window, allowing the system to perform real-time high-precision pose estimation. Furthermore, to eliminate accumulated errors in time, we detect loops and adjust the sparse pose graph based on mutual matching of projected 2D submaps, allowing D-LIOM to run stably in large-scale scenes. In addition, to improve its flexibility to varied sensor combinations, D-LIOM supports multi-LiDAR inputs and facilitates the initialization with a common 6-axis IMU. Extensive experiments demonstrate that D-LIOM largely outperforms the existing state-of-the-art counterparts in mapping effect and localization accuracy as well as with high time efficiency. Lastly, to ensure that our results are entirely reproducible, all necessary data and codes are made open-source available. One introduction video can also be found on the online website.

28 October 2024
Verified
Conference Paper
Open access
LLLinfei Li
Linfei Li
LZLin Zhang
Lin Zhang
ZWZhong Wang
Zhong Wang
YSYing Shen
Ying Shen
Recently, the multi-modal fusion of RGB, depth, and semantics has shown great potential in the domain of dense Simultaneous Localization and Mapping (SLAM), as known as dense semantic SLAM. Yet a prerequisite for generating consistent and continuous semantic maps is the availability of dense, efficient, and scalable scene representations. To date, existing semantic SLAM systems based on explicit scene representations (points/meshes/surfels) are limited by their resolutions and inabilities to predict unknown areas, thus failing to generate dense maps. Contrarily, a few implicit scene representations (Neural Radiance Fields) to deal with these problems rely on time-consuming ray tracing-based volume rendering technique, which cannot meet the real-time rendering requirements of SLAM. Fortunately, the Gaussian Splatting scene representation has recently emerged, which inherits the efficiency and scalability of point/surfel representations while smoothly represents geometric structures in a continuous manner, showing promise in addressing the aforementioned challenges. To this end, we propose GS3LAM, a Gaussian Semantic Splatting SLAM framework, which takes multimodal data as input and can render consistent, continuous dense semantic maps in real-time. To fuse multimodal data, GS3LAM models the scene as a Semantic Gaussian Field (SG-Field), and jointly optimizes camera poses and the field by establishing error constraints between observed and predicted data. Furthermore, a Depth-adaptive Scale Regularization (DSR) scheme is proposed to tackle the problem of misalignment between scale-invariant Gaussians and geometric surfaces within the SG-Field. To mitigate the forgetting phenomenon, we propose an effective Random Sampling-based Keyframe Mapping (RSKM) strategy, which exhibits notable superiority over local covisibility optimization strategies commonly utilized in 3DGS-based SLAM systems. Extensive experiments conducted on the benchmark datasets reveal that compared with state-of-the-art competitors, GS3 LAM demonstrates increased tracking robustness, superior real-time rendering quality, and enhanced semantic reconstruction precision. To make the results reproducible, the source code is available at https://github.com/lif314/GS3LAM.

2 September 2020 in IEEE Sensors Journal
Verified
Journal Article
Closed access
ZWZhong Wang
Zhong Wang
LZLin Zhang
Lin Zhang
Shengjie ZhaoShengjie Zhao
Shengjie Zhao
SZShaoming Zhang
Shaoming Zhang
Global localization is a key problem that needs to be solved for single-line LiDAR based robot navigation since it will directly affect the estimation accuracy of the robot's initial pose and the success rate of recovering the robot's state when it loses its local pose. Existing studies to deal with this problem usually extract feature points from laser beams and then resort to fast retrieval and registration methods to further determine the robot's pose. Although these methods have achieved good results in specific scenes, they often fail to perform well when the robot is far away from the map-building trajectory. It is therefore highly desirable to develop more robust techniques for this problem. In this work, we propose a novel solution which is based on “Dense 2D Signature and 1D Registration”, D2S1R for short. By establishing a dense signature database for 2D locations and combining with the fast retrieval technology, the 2D search space is extremely compressed. Furthermore, fast yaw angle determination is achieved by converting scan points to 1D space and measuring the difference of scan contours based on relative entropy. Experimental results on several complex indoor scenes show that D2S1R can complete global localization within 0.03s on an ordinary CPU in an area of nearly 4,000m 2 . Besides, on the premise of achieving a location accuracy of 0.08±0.04m and an orientation accuracy of 0.72±0.60°, it can achieve an average success rate of 95% on all test datasets.

23 November 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
ZWZhong Wang
Zhong Wang
LZLin Zhang
Lin Zhang
Shengjie ZhaoShengjie Zhao
Shengjie Zhao
YZYicong Zhou
Yicong Zhou
Owing to the inherent complementarity among LiDAR, camera, and IMU, a growing effort has been paid to laser-visual-inertial SLAM recently. The existing approaches, however, are limited in two aspects. First, at the front-end, they usually employ a discrete-time representation that requires high-precision hardware/software synchronization and are based on geometric laser features, leading to low robustness and scalability. Second, at the backend, visual loop constraints suffer from scale ambiguity and the sparseness of the point cloud deteriorates the scan-to-scan loop detection. To solve these problems, for the front-end, we propose a continuous-time laser-visual-inertial odometry which formulates the carrier trajectory in continuous time, organizes point clouds in probabilistic submaps, and jointly optimizes the loss terms of laser anchors, visual reprojections, and IMU readings, achieving accurate pose estimation even with fast motion or in unstructured scenes where it is difficult to extract meaningful geometric features. At the backend, we propose building 5-DoF laser constraints by matching projected 2D submaps and 6-DoF visual constraints via laser-aided visual relocalization, ensuring mapping consistency in large-scale scenes. Results show that our framework achieves high-precision estimation and is more robust than its counterparts when the carrier works in large scenes or with fast motion. The relevant codes and data are open-sourced at https://cslinzhang.github.io/Ct-LVI/Ct-LVI.html.

10 October 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
ZWZhong Wang
Zhong Wang
LZLin Zhang
Lin Zhang
Shengjie ZhaoShengjie Zhao
Shengjie Zhao
YZYicong Zhou
Yicong Zhou
For autonomous ground vehicles, global localization with 3D LiDAR is an indispensable part of tasks such as navigation. Usually, global localization using LiDAR is subdivided into two sub-problems, place recognition and global registration. For place recognition, the recent emerging schemes based on deep learning either rely on 3D convolution with high complexity or need to learn features from various forward perspectives. To mitigate this, we propose a model with roll-pitch-yaw invariance that represents point clouds as probabilistic voxels and generates occupancy grids from a bird’s-eye view, fulfilling robust place recognition by learning aggregated embeddings from a fixed perspective. For low-overlap global registration, the traditional handcraft feature-based methods are mostly limited to dense object-level point clouds, while the state-of-the-art learning-based approaches often rely on complex 3D convolution and additional feature association learning. To fill this gap to some extent, we propose to estimate the relative roll-pitch angles and vertical translation by fitting and aligning the ground plane of the point clouds and to determine the horizontal translations and yaw angle by matching their projected occupancy grids. Extensive experiments corroborate the superior recall and generalization ability of our place recognition model, as well as the advanced success rate and accuracy of our 3D registration approach. Especially in the recognition and registration of hard samples, our results far exceed those of our counterparts by large margins. To ensure full reproducibility, the relevant codes and data are made available online.

23 October 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
YTYan Tang
Yan Tang
SZShaoming Zhang
Shaoming Zhang
WLWeijia Liu
Weijia Liu
ZWZhong Wang
Zhong Wang
JWJianmei Wang
Jianmei Wang
In the realm of intelligent transportation systems, Automatic License Plate Recognition (ALPR) is integral, yet is often hindered by heavy computational loads and massive memory footprints. Existing methods either enhance recognition accuracy through complex models or minimize resource requirements by utilizing low-performance models and low-resolution inputs, both of which pose challenges in real-world applications. To address these issues, this paper introduces a novel ultra-lightweight ALPR system specifically designed for deployment on microcontrollers, offering a cost-effective and energy-efficient solution for large-scale applications. We simplify the process by decoupling ALPR into three sub-tasks: detection, localization, and recognition. For each sub-task, specific improvement strategies such as Residual Log-likelihood Estimation (RLE)-based keypoint localization, adaptive data augmentation, and multi-voting recognition mechanism are designed. Our proposed system naturally mitigates the issues of large perspective transformations frequently encountered in real-world settings. As a supplementary contribution, we introduce and release the TJLP dataset. Practical application and superior performance of our method have been demonstrated on resource-limited devices like RV1106 (ARM Cortex-A7 with a 0.5 TOPS NPU), achieving an inference speed of 22 FPS with a power consumption of 629 mW. Notably, our fully optimized model exhibits a recognition accuracy of 99.23% in real-world environments.