Jian Liu

Dr. Jian Liu

School of Artificial Intelligence and Robotic, Hunan University, Changsha, Guangdong, China
orcid

Research Focus & Metrics

Academic Career Length

25Years (2002-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 February 2023 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
JLJian Liu
Jian Liu
WSwei sun
wei sun
CLChongpei Liu
Chongpei Liu
XZXing Zhang
Xing Zhang
QFQiang Fu
Qiang Fu
Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6 $\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

22 January 2026 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
JLJian Liu
Jian Liu
WSwei sun
wei sun
HYHui Yang
Hui Yang
ZZZhiwen Zeng
Zhiwen Zeng
CLChongpei Liu
Chongpei Liu
AMAjmal Mian
Ajmal Mian

9 June 2022 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
JLJian Liu
Jian Liu
WSwei sun
wei sun
CLChongpei Liu
Chongpei Liu
XZXing Zhang
Xing Zhang
SFShimeng Fan
Shimeng Fan
WWWei Wu
Wei Wu
Tracking the 6-degree-of-freedom (6D) object pose in video sequences is gaining attention because it has a wide application in multimedia and robotic manipulation. However, current methods often perform poorly in challenging scenes, such as incorrect initial pose, sudden re-orientation, and severe occlusion. In contrast, we present a robust 6D object pose tracking method with a novel hierarchical feature fusion network, refer it as HFF6D, which aims to predict the object’s relative pose between adjacent frames. Instead of extracting features from adjacent frames separately, HFF6D establishes sufficient spatial-temporal information interaction between adjacent frames. In addition, we propose a novel subtraction feature fusion (SFF) module with attention mechanism to leverage feature subtraction during feature fusion. It explicitly highlights the feature differences between adjacent frames, thus improving the robustness of relative pose estimation in challenging scenes. Besides, we leverage data augmentation technology to make HFF6D be used more effectively in the real world by training only with synthetic data, thereby reducing manual effort in data annotation. We evaluate HFF6D on the well-known YCB-Video and YCBInEOAT datasets. Quantitative and qualitative results demonstrate that HFF6D outperforms state-of-the-art (SOTA) methods in both accuracy and efficiency. Moreover, it is also proved to achieve high-robustness tracking under the above-mentioned challenging scenes.

29 January 2024 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
XZXing Zhang
Xing Zhang
WSwei sun
wei sun
JZJin Zheng
Jin Zheng
LALin Anping
Lin Anping
JLJian Liu
Jian Liu
SGShuzhi Ge
Shuzhi Ge
The rise of the Internet of Things has spurred the growth of wireless applications, particularly Wi-Fi-based indoor localization, which is gaining prominence owing to its cost-effectiveness. Nevertheless, the accuracy of Wi-Fi-based indoor localization is hindered by signal instability. To address this limitation, we introduce an interval random analysis approach for uncertain Wi-Fi-based indoor localization. Specifically, this approach employs an interval random parameter lognormal shadowing model for radio map enhancement and adaptive Bayesian comprehensive learning (IRPLS-ABCL) particle swarm optimization (PSO) for location estimation accuracy enhancement. The process comprises two stages: offline training and online localization. During the offline phase, we establish the interval random parameter lognormal shadowing model, considering the parameters as interval random variables, rather than precise values, in a sparse reference point scenario. In the online phase, we use a double-panel fingerprint homogeneity model to assess fingerprint similarity and apply the adaptive Bayesian comprehensive learning PSO algorithm to enhance localization precision. The experimental results show that the proposed algorithm can achieve the best performance in terms of localization accuracy based on the predicted average received signal strength (RSS), reaching 1.89 m.

13 February 2024 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
JLJian Liu
Jian Liu
WSwei sun
wei sun
CLChongpei Liu
Chongpei Liu
HYHui Yang
Hui Yang
XZXing Zhang
Xing Zhang
AMAjmal Mian
Ajmal Mian
Six-degree-of-freedom (6DoF) object pose estimation is a crucial task for virtual reality and accurate robotic manipulation. Category-level 6DoF pose estimation has recently become popular as it improves generalization to a complete category of objects. However, current methods focus on data-driven differential learning, which makes them highly dependent on the quality of the real-world labeled data and limits their ability to generalize to unseen objects. To address this problem, we propose multi-hypothesis (MH) consistency learning (MH6D) for category-level 6-D object pose estimation without using real-world training data. MH6D uses a parallel consistency learning structure, alleviating the uncertainty problem of single-shot feature extraction and promoting self-adaptation of domain to reduce the synthetic-to-real domain gap. Specifically, three randomly sampled pose transformations are first performed in parallel on the input point cloud. An attention-guided category-level 6-D pose estimation network with channel attention (CA) and global feature cross-attention (GFCA) modules is then proposed to estimate the three hypothesized 6-D object poses by extracting and fusing the global and local features effectively. Finally, we propose a novel loss function that considers both the process and the final result information allowing MH6D to perform robust consistency learning. We conduct experiments under two different training data settings (i.e., only synthetic data and synthetic and real-world data) to verify the generalization ability of MH6D. Extensive experiments on benchmark datasets demonstrate that MH6D achieves state-of-the-art (SOTA) performance, outperforming most data-driven methods even without using any real-world data. The code is available at https://github.com/CNJianLiu/MH6D.

18 March 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
JLJian Liu
Jian Liu
WSwei sun
wei sun
HYHui Yang
Hui Yang
PDPengchao Deng
Pengchao Deng
CLChongpei Liu
Chongpei Liu
AMAjmal Mian
Ajmal Mian
Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance.