Yuanpeng Liu

Yuanpeng Liu

Auto-generated profile, based on publicly available information

Yuanpeng Liu

College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 August 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
YLYuanpeng Liu
Yuanpeng Liu
JDJingxuan Dong
Jingxuan Dong
YLYida Li
Yida Li
XGXiaoxi Gong
Xiaoxi Gong
JWJun Wang
Jun Wang
In the field of aircraft maintenance, regular inspection of fuselage surface during the aircraft life cycle is a vital task to ensure the aircraft quality and flight safety. Currently, the inspection task is generally carried out manually in an indoor hangar, which is with low efficiency and reliability. In this article, a novel system based on the unmanned aerial vehicle (UAV) is presented to achieve automated aircraft surface inspection efficiently. The hardware is established with a lightweight and low-cost flight platform, on which a sensor containing an inertial measurement unit (IMU) and a camera is equipped for UAV localization. A high-resolution camera is equipped to collect images of fuselage for defect detection. Our inspection framework is mainly composed of two modules: the UAV localization module and the defect detection module. The localization module is designed to estimate the relative pose between the UAV and the aircraft, providing the foundation for image positioning on the aircraft surface. The existing visual–inertial odometry (VIO) approach is adopted to implement the pose estimation. To reduce the large drifts caused by the VIO approach, a novel method is proposed to deploy precalibrated ArUco markers around the aircraft, which serve as external constraints for the VIO objective to realize joint optimization of the camera pose. In addition, an adaptive weighting method is proposed, which takes into consideration the recognition effect of markers to balance the external constraints. The defect detection module aims to detect defects on the fuselage surface from images captured by the high-resolution camera, which is implemented based on deep learning. To address the issue of detection on a few training samples, the transfer learning strategy is exploited to first pretrain the model on a public defect dataset and then fine-tune it on our collected aircraft defect dataset. After detecting the defects, the defective region is reflected on the fuselage surface through the UAV pose on the corresponding frame provided by the localization module, realizing the accurate defect localization. Experiments on both the simulation environment and real data demonstrate the superiority of our proposed external localization module and the effectiveness of the crack detection module.

1 January 2022 in Measurement
Verified
Journal Article
Closed access
YLYuanpeng Liu
Yuanpeng Liu
JZJun Zhou
Jun Zhou
YLYida Li
Yida Li
YZYuqi Zhang
Yuqi Zhang
YHYongqiang He
Yongqiang He
JWJun Wang
Jun Wang

10 February 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
YZYuqi Zhang
Yuqi Zhang
YLYuanpeng Liu
Yuanpeng Liu
QWQiaoyun Wu
Qiaoyun Wu
JZJun Zhou
Jun Zhou
XGXiaoxi Gong
Xiaoxi Gong
JWJun Wang
Jun Wang
The 6-D pose estimation is a crucial task in vision-based measurement for robotic manipulation. It becomes a challenging task because of the variety of lighting conditions, cluttered background, occlusion, and texture-less objects. The various lighting conditions and texture-less objects lead to dramatic changes for imaging. In this article, we propose an edge-attention 6-D pose estimation network (EANet) for texture-less objects that achieve the autonomous perception of the edge, which is invariant when the lighting conditions change and objects are texture-less. To achieve this, EANet adopts a multitask learning strategy that introduces edge cues into the pixelwise dense fusion framework. We design a shared-weight edge extractor serving for edge reconstruction and pose estimation simultaneously. The purpose of edge reconstruction is to guide the network to pay more attention to edges, so as to enhance the performance of pose estimation implicitly. The edge cues can further improve the performance of pose refinement. Furthermore, we apply a skip-connection scheme to the edge extractor, merging feature maps of the deep and shallow layers. Due to the lightweight design, EANet obtains an inference time of 20 frames per second (FPS) on a desktop PC with an RTX 2070 GPU, which satisfies the requirement of most real-time applications. Experiments show that our network has a significant effect on texture-less objects and approaches the state-of-the-art performance on both the LINEMOD and the YCB-Video datasets. Finally, we present a PARTS dataset to test real-world performance and apply EANet to bin-picking vision measurement, which demonstrates that our method can provide a complete and robust solution for vision-based pose measurement.

9 February 2021 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
HCHONGHUA Chen
HONGHUA Chen
YHYaoran Huang
Yaoran Huang
QXQian Xie
Qian Xie
YLYuanpeng Liu
Yuanpeng Liu
YZYuan Zhang
Yuan Zhang
JWJun Wang
Jun Wang
Recent 3-D scanning techniques can produce various kinds of digitized 3-D data. Most of these scanned data are in a format of unstructured point clouds. Such low-level representation of 3-D data usually contains only geometric properties (point positions), while lacking higher level structure cues, for example, feature lines. Feature lines can be defined as a visually prominent characteristic of the shape, including edges, ridges, and valley lines in multiple scales, which can support a lot of downstream applications, such as shape reconstruction and analysis. We present a two-phase algorithm for extracting line-type features on point clouds. To extract both large-scale and shallow feature lines, we first define a statistical metric to detect all potential feature points while immune to the noise to some extent. Then, for correctly reconstructing the feature lines from these identified coarse feature points, we introduce an anisotropic contracting scheme to force feature points lying on the underlying real feature lines. To illustrate the reliability of our method, various experiments have been conducted on both synthetic and raw data. Both visual and quantitative comparisons show that our method is robust to noise and can correctly extract multiscale feature lines. In addition, our method is generally applicable to robotic picking. Note to Practitioners —This article was motivated by the problem of the feature line extraction for real scanned point clouds. Feature lines, as one kind of the most important structure information, depict the basic shape of the real object in our life. Extracting this kind of shape features from the unstructured point clouds can facilitate a variety of downstream practical applications, such as product design, workpiece manufacturing, and robotic grasping. Existing approaches to detect features either heavily rely on differential quantities, which are sensitive to the noise, or need an elaborately designed local descriptor but fail to recognize small-scale features. These challenges motivate us to design a new approach aiming at extracting multiscale feature lines while keeping robustness to heavy noise. The technique developed in this work can produce high-quality feature points and feature lines, which would serve as higher level structural information and facilitate many applications. Additional applications in 6-degree-of-freedom (6-DoF) pose estimation demonstrate the potential of our method for robotic picking.

25 April 2019 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
YLYuanpeng Liu
Yuanpeng Liu
LZLaishui Zhou
Laishui Zhou
HZHua Zong
Hua Zong
XGXiaoxi Gong
Xiaoxi Gong
QWQiaoyun Wu
Qiaoyun Wu
JWJun Wang
Jun Wang
3D pose estimation for texture-less objects remains a challenging problem. Previous works either focus on a template matching method to find the nearest template as a candidate, or construct a Hough Forest, which utilizes the offset of patches to vote for the object location and pose. By contrast, in this paper, we propose a comprehensive framework to directly regress 3D poses for the candidates, in which a CNN-based triplet network is trained to extract discriminated features from the binary images. To make the features suitable for the regression task, a pose-guided method and a regression constraint are employed to the constructed triplet network. We show that the constraint reaches the goal of creating the correlation between the features and 3D poses. Once the expected features are obtained, the object pose could be efficiently regressed by training a regression network with a simple structure. For symmetric objects, depth images are treated as an additional channel to feed the triplet network. Experiments on the LineMOD and our own datasets demonstrate our method with high regression precision and efficiency.

1 July 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
YWYan Wang
Yan Wang
YLYuanpeng Liu
Yuanpeng Liu
HCHONGHUA Chen
HONGHUA Chen
QXQian Xie
Qian Xie
KZKaijun Zhang
Kaijun Zhang
JWJun Wang
Jun Wang
In the field of aircraft manufacturing, the demand for high aerodynamic performance and long fatigue life is growing. This makes the high-precision assembly of large components and assembly coordination increasingly important. This is particularly prominent for wing-fuselage joining due to the large size, measurement difficulty, and multiconstraint coordination. In this article, we propose a novel optimization method for the wing-fuselage assembly coordination problem, as well as an assembly gap measurement approach. First, a gap measurement framework combining a laser tracker, 3-D scanner, and photogrammetry is adopted to solve the occlusion problem that makes measurement difficult in traditional methods. Compatible tooling is utilized to transform the scanned point cloud data in the local coordinate system to the global aircraft assembly coordinate system. Based on this, a comprehensive wing-fuselage pose coordination model is then established, which takes engineering constraints into account to realize assembly gap redistribution for wing-fuselage joining. The transformation parameters of pose adjustment are solved by the proposed multiconstraint optimization algorithm based on the Gauss–Newton method. Finally, experiments on synthetic data and actual data have verified the effectiveness of the coordination method. Results show that our method significantly optimizes the gap distribution within the given tolerance and outperforms traditional methods in both accuracy and efficiency. With advantages of high efficiency and accuracy, our method can be well applied to the wing-fuselage joining and satisfy the requirement of the large component assembly.