Xian Guo

Dr. Xian Guo


Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 September 2021 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
WZWei Zhu
Wei Zhu
XGXian Guo
Xian Guo
DODai Owaki
Dai Owaki
KKKyo Kutsuzawa
Kyo Kutsuzawa
MHMitsuhiro Hayashibe
Mitsuhiro Hayashibe
The state-of-the-art reinforcement learning (RL) techniques have made innumerable advancements in robot control, especially in combination with deep neural networks (DNNs), known as deep reinforcement learning (DRL). In this article, instead of reviewing the theoretical studies on RL, which were almost fully completed several decades ago, we summarize some state-of-the-art techniques added to commonly used RL frameworks for robot control. We mainly review bioinspired robots (BIRs) because they can learn to locomote or produce natural behaviors similar to animals and humans. With the ultimate goal of practical applications in real world, we further narrow our review scope to techniques that could aid in sim-to-real transfer. We categorized these techniques into four groups: 1) use of accurate simulators; 2) use of kinematic and dynamic models; 3) use of hierarchical and distributed controllers; and 4) use of demonstrations. The purposes of these four groups of techniques are to supply general and accurate environments for RL training, improve sampling efficiency, divide and conquer complex motion tasks and redundant robot structures, and acquire natural skills. We found that, by synthetically using these techniques, it is possible to deploy RL on physical BIRs in actuality.

24 December 2019 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
WZWei Zhu
Wei Zhu
XGXian Guo
Xian Guo
YFYongchun Fang
Yongchun Fang
XZXueyou Zhang
Xueyou Zhang
Reinforcement learning (RL) combined with deep neural networks has led to a number of great achievements for robot control in virtual computer environments, where sufficient data can be obtained without any difficulty to train various models. However, thus far, only few and relatively simple tasks have been accomplished for practical robots, which is mainly caused by the following two reasons. First, training with real robots, especially with dynamic systems, is too complicated to be fully and accurately represented in simulations. Second, it is very costly to obtain training data from real systems. To address these two problems effectively, in this article, a path-integral-based RL algorithm is proposed for the task of path following of an autoassembly mobile robot, wherein three kernel techniques are introduced. First, a generalized path-integral-control approach is proposed to obtain the numerical solution of a stochastic dynamical system, wherein the calculation of the gradient and kinematics inverse is avoided to ensure fast and reliable training convergence. Second, a novel parameterization method using Lyapunov techniques is introduced into the RL algorithm to ensure good performance of the system when directly transferring simulation results into practical systems. Third, the optimal parameters for all discrete initial states are first learned offline and then tuned online to improve the generalization and real-time performance. In addition to the optimization control for the mobile robot, the proposed method also possesses general applicability for a class of nonlinear systems such as crane systems. Simulation and experimental results are included and analyzed to illustrate the superior performance of the proposed algorithm.

3 December 2018 in IEEE Transactions on Industrial Electronics
Verified
Journal Article
Closed access
XGXian Guo
Xian Guo
WZWei Zhu
Wei Zhu
YFYongchun Fang
Yongchun Fang
In this paper, a novel guided motion planning method is proposed for snake-like robots, which decomposes the configuration space into the fiber space and the gait space, with the motion planned in the low-dimension fiber space, so as to avoid the dimensionality curse problem. More specifically, firstly, based on geometry mechanics, the kinematic connection is derived, which successfully maps the motion in the fiber space intothatinthegaitspace.Accordingtothekinematicconnection, a novel bidirectional motion control method for snake-like robots is proposed to improve the fiexibility which can produce not only the forward locomotion but also the backward locomotion additionally. The convergence of the bidirectional motion control method is proved based on averaging theory. Then, the motion planning problem is solved in the low-dimensional fiber space,for which the HJB equation is used to generate the optimal control inthe fiber space to avoid the well known curse of dimensionality. Finally, combing the bidirectional motion control and the motion planned in the fiber space, a guided motion planning method in the configuration space is proposed. Numerical simulations and experiments based on the real snake-like robot platform are performed, whose results demonstrate that the proposed algorithm is valid and robust.

19 December 2024 in Expert Systems with Applications
Verified
Journal Article
Closed access
XXXiaojie Xu
Xiaojie Xu
YWYunfan Wang
Yunfan Wang
XGXian Guo
Xian Guo
KHKuihua Huang
Kuihua Huang
XZXuebo Zhang
Xuebo Zhang

27 February 2018 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Open access
XGXian Guo
Xian Guo
SMShugen Ma
Shugen Ma
BLBin Li
Bin Li
YFYongchun Fang
Yongchun Fang
In this paper, a novel serpentine gait generation method is proposed based on geometry mechanics. From the view of differential geometry, the configuration of snake-like robots can be described by a fiber bundle, in which the net locomotion corresponds to the fiber space and the gait corresponds to the bases space. The serpentine gait can be generated by calculating the connection of the fiber bundle. Compared with the traditional gait generation method, such as the curve-based method and the central pattern generator-based method, the proposed method does not assume that the serpentine gait is a standard sinusoidal signal. Models have been developed based on geometric mechanics, which build the relation between the net locomotion and the serpentine gaits analytically. Based on these models, the serpentine gaits for snakelike robots with passive wheels can be generated by planning the quasi-velocity and the serpentine gaits for underwater snakelike robots can be generated by analyzing the integral of the height function. The serpentine gaits generated by the proposed method directly couple with the locomotion of the snakelike robot, which enables the desired locomotion to be realized efficiently. To validate the proposed method, both the snakelike robot with passive wheels and the underwater snakelike robot are taken to perform the experiments. Additionally the recursive Newton-Euler method with the model of hydrodynamic forces is also taken to test the underwater serpentine gaits. Experiments and simulation have validated our proposed method.

14 April 2023 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
WHWei Huang
Wei Huang
XGXian Guo
Xian Guo
HLHuawang Liu
Huawang Liu
YFYongchun Fang
Yongchun Fang
In this article, a radius estimation approach for snake robot's helical climbing motion is proposed, which enables a snake robot successfully implementing compliant helical climbing along pipes/trees with varying radius. More specifically, a mathematical model is first set up to describe the relationship between the helical rolling gait and the radius information. Based on the model, a robust radius estimation approach, consisting of two important stages of multistep calculation and curve fitting, is then proposed, which utilizes the measurements of joint angles as feedback to generate an accurate estimation for the radius of pipes/trees. Utilizing the estimation result, a control algorithm is then employed to make the robot climb along pipes/trees successfully, even when the radius changes over time. Some experimental results are collected and then analyzed to show the superior performance of the proposed robust model-based radius estimation approach.