Tiantian Hao

Tiantian Hao

Auto-generated profile, based on publicly available information

Tiantian Hao

CAS Engineering Laboratory for Intelligent Industrial Vision, Institute of Automation, Chinese Academy of Sciences, Beijing, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 June 2023 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
THTiantian Hao
Tiantian Hao
DXDe Xu
De Xu
FQFangbo Qin
Fangbo Qin
Image-based visual servoing methods have been widely used in many areas including the position alignment for assembly. However, the parallel vision system suffers from low sensitivity to motion along the optical axis due to the camera’s perspective characteristics, which can lead to a larger alignment error along the optical axis of the camera and affect subsequent tasks. To address this issue, an innovative binocular Eye-to-Hand (ETH) vision system with two cameras whose optical axes are approximate orthogonal is designed. By deriving and analyzing the interaction matrix of point feature for the proposed system, its ability is demonstrated to improve sensitivity for motion along the optical axis. Furthermore, an image-based visual servoing control method with the proposed ETH vision system is developed for position alignment in a screw grasping experiment. A calibration method for the image Jacobian matrix is developed based on active motions of the robot’s end-effector. Finally, the experimental results verify the effectiveness of the proposed methods. The position alignment errors in the experiments with the proposed vision system and method are less than 0.5 mm. The results indicate that the proposed method holds great potential for industrial applications in the area of small components assembly.

2 November 2023 in The International Journal of Advanced Manufacturing Technology
Verified
Journal Article
Closed access
PDF file
THTiantian Hao
Tiantian Hao
DXDe Xu
De Xu

7 July 2022 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
FQFangbo Qin
Fangbo Qin
DXDe Xu
De Xu
BHBlake Hannaford
Blake Hannaford
THTiantian Hao
Tiantian Hao
Vision measurement is important for intelligent systems to obtain the precise structural and spatial information of objects. Beyond the object-specific vision measurement developed for fixed object type, it is appealing to explore the object-agnostic vision measurement, which can be efficiently reconfigured and adapted to various novel objects. This article proposes a framework to mimic the human’s versatile visual measurement behavior: extract a set of contour primitives of interest (CPIs) from an image, then utilize the CPIs to calculate the key geometric information. First, a deep convolutional neural network (CNN) CPieNet+ is proposed under the one-shot learning scheme, aiming to extract the pixel-level object CPI from a raw query image, given an annotated support image. The fine-grained CPI prototypes are formed by sampling multiple points on the feature map of the support image. To leverage the explicit geometric knowledge in the CNN inference, the annotation map is encoded as a shape descriptor to guide the feature channel attention, and the geometric attribute awareness is realized by supervising the model to predict the direction and size of CPI. Second, the measurement behavior tree (BT) is designed to model the hierarchical geometric calculation procedure, which is flexibly configurable for different measurement requirements and is interpretable for nonexpert users. After the execution of the measurement BT, the pixel-level CPIs are converted to the required key geometric data. The effectiveness of the proposed methods is validated by a series of experiments.

17 October 2024 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
THTiantian Hao
Tiantian Hao
DXDe Xu
De Xu
In an automatic control system, multiple peg-in-hole (MPIH) assembly of a relay and its socket is often required. However, the existing hybrid position/force control (HPFC) methods cannot meet the requirement for MPIH assembly because of its great complexity. A reinforcement learning (RL)–based HPFC method is presented for the assembly of a relay and its socket, whose controller's parameters are adjusted to adapt to the complexity. First, the socket is modeled as a spring based on its internal structural characteristics. The force in assembly simulation is computed with this model by combining it with their relative positions. Second, the proposed RL-based HPFC method segregates the assembly motion control into a force control branch and a position control branch. In the force control branch, a proportional-derivative controller regulates radial motion to obtain compliance. In the position control branch, a proportional controller manages the axial motion, which is further constrained by the radial force to ensure safety. Finally, a parameter adjustment method for the controller based on RL is further developed. The sliding window state collection is used for training. A series of comparative experiments in both simulation and real assembly environments are conducted. The experimental results validate the effectiveness of the proposed method.

7 November 2024 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
SYShaohua Yan
Shaohua Yan
Xian TaoXian Tao
Xian Tao
XMXumiao Ma
Xumiao Ma
THTiantian Hao
Tiantian Hao
DXDe Xu
De Xu
The generalization model for multicategory peg-in-hole assembly (MPHA) skills is hard to acquire. An adaptive meta policy learning (AMPL) algorithm with virtual model set is proposed to deal with the difficulties of low learning efficiency and low adaptability for the multicategory assembly skill learning. First, the AMPL framework incorporates meta-reinforcement learning and can obtain generalization model of multicategory assembly skills. It has higher learning efficiency compared to single-category skill learning algorithms. Second, the AMPL algorithm introduces a similarity function constructed from the demonstration learning algorithm in the state value function. It has stronger adaptability compared to the multicategory skills learning algorithms. Finally, a simulation environment set for MPHA is constructed, consisting of the mathematical force contact models and the physical simulation models. The simulations and experiments are well conducted with the proposed algorithm. The results demonstrate the efficacy of the proposed algorithm.

8 April 2024 in International Journal of Control, Automation, and Systems
Verified
Journal Article
Closed access
PDF file
THTiantian Hao
Tiantian Hao
DXDe Xu
De Xu
SYShaohua Yan
Shaohua Yan