Xiaoping Zhang

Dr. Xiaoping Zhang

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 April 2019 in Sensors
Verified
Journal Article
Open access
PDF file
YXYao Xiao
Yao Xiao
XRXiaogang Ruan
Xiaogang Ruan
JCJie Chai
Jie Chai
XZXiaoping Zhang
Xiaoping Zhang
Xiaoqing ZhuXiaoqing Zhu
Xiaoqing Zhu
Low-cost microelectro mechanical systems (MEMS)-based inertial measurement unit (IMU) measurements are usually affected by inaccurate scale factors, axis misalignments, and g-sensitivity errors. These errors may significantly influence the performance of visual-inertial methods. In this paper, we propose an online IMU self-calibration method for visual-inertial systems equipped with a low-cost inertial sensor. The goal of our method is to concurrently perform 3D pose estimation and online IMU calibration based on optimization methods in unknown environments without any external equipment. To achieve this goal, we firstly develop a novel preintegration method that can handle the IMU intrinsic parameters error propagation. Then, we frame IMU calibration problem into general factors so that we can easily integrate the factors into the current graph-based visual-inertial frameworks and jointly optimize the IMU intrinsic parameters as well as the system states in a big bundle. We evaluate the proposed method with a publicly available dataset. Experimental results verify that the proposed approach is able to accurately calibrate all the considered parameters in real time, leading to significant improvement of estimation precision of visual-inertial system (VINS) compared with the estimation results with offline precalibrated IMU measurements.

22 October 2024 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
HWHuijiang Wang
Huijiang Wang
XZXiaoping Zhang
Xiaoping Zhang
FIFumiya Iida
Fumiya Iida
Recent advances in machine learning have paved the way for the development of musical and entertainment robots. However, human-robot cooperative instrument playing remains a challenge, particularly due to the intricate motor coordination and temporal synchronization. In this paper, we propose a theoretical framework for human-robot cooperative piano playing based on non-verbal cues. First, we present a music improvisation model that employs a recurrent neural network (RNN) to predict appropriate chord progressions based on the human's melodic input. Second, we propose a behavior-adaptive controller to facilitate seamless temporal synchronization, allowing the cobot to generate harmonious acoustics. The collaboration takes into account the bidirectional information flow between the human and robot. We have developed an entropy-based system to assess the quality of cooperation by analyzing the impact of different communication modalities during human-robot collaboration. Experiments demonstrate that our RNN-based improvisation can achieve a 93% accuracy rate. Meanwhile, with the MPC adaptive controller, the robot could respond to the human teammate in homophony performances with real-time accompaniment. Our designed framework has been validated to be effective in allowing humans and robots to work collaboratively in the artistic piano-playing task.

1 November 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
XZXiaoping Zhang
Xiaoping Zhang
YZYuanpeng Zheng
Yuanpeng Zheng
LWLi Wang
Li Wang
AArsen Abdulali
Arsen Abdulali
FIFumiya Iida
Fumiya Iida
Multi-agent collaborative target search is one of the main challenges in the multi-agent field, and deep reinforcement learning (DRL) is a good way to learn such a task. However, DRL always faces the problem of sparse reward, which to some extent reduces its efficiency in task learning. Introducing intrinsic motivation has proved to be a useful way to make the sparse reward in DRL. So, based on the multi-agent deep deterministic policy gradient (MADDPG) structure, a new MADDPG algorithm with the emotional intrinsic motivation name MADDPG-E is proposed in this paper for the multi-agent collaborative target search. In MADDPG-E, a new emotional intrinsic motivation module with three emotions, joy, sadness, and fear, is designed. The three emotions are defined by corresponding psychological knowledge to the multi-agent embodied situations in an environment. An emotional steady-state variable function H is then designed to help judge the goodness of the emotions. Based on H, an emotion-based intrinsic reward function is finally proposed. With the designed emotional intrinsic motivation module, the multi-agent system always tries to make itself joy, which means it always learns to search the target. To show the effectiveness of the proposed MADDPG-E algorithm, two kinds of simulation experiments with a determined initial position and random initial position, respectively, are carried out, and comparisons are performed with MADDPG as well as MADDPG-ICM (MADDPG with an intrinsic curiosity module). The results show that with the designed emotional intrinsic motivation module, MADDPG-E has a higher learning speed and better learning stability, and the advantage is more obvious when facing complex situations.

31 March 2017 in Journal of Shanghai Jiaotong University (Science)
Verified
Journal Article
Closed access
PDF file
XZXiaoping Zhang
Xiaoping Zhang
XRXiaogang Ruan
Xiaogang Ruan
YXYao Xiao
Yao Xiao
JHJing Huang
Jing Huang

7 October 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
XZXiaoping Zhang
Xiaoping Zhang
YWYitong Wu
Yitong Wu
HWHuijiang Wang
Huijiang Wang
FIFumiya Iida
Fumiya Iida
LWLi Wang
Li Wang
Animals have evolved to adapt to complex and uncertain environments, acquiring locomotion skills for diverse surroundings. To endow a robot’s animal-like locomotion ability, in this paper, we propose a learning algorithm for quadruped robots based on deep reinforcement learning (DRL) and a rhythm controller that is based on a cosine oscillator. For a quadruped robot, two cosine oscillators are utilized at the hip joint and the knee joint of one leg, respectively, and, finally, eight oscillators form the controller to realize the quadruped robot’s locomotion rhythm during moving. The coupling between the cosine oscillators of the rhythm controller is realized by the phase difference, which is simpler and easier to realize when dealing with the complex coupling relationship between different joints. DRL is used to help learn the controller parameters and, in the reward function design, we address the challenge of terrain adaptation without relying on the complex camera-based vision processing but based on the proprioceptive information, where a state estimator is introduced to achieve the robot’s posture and help finally utilize the food-end coordinate. Experiments are carried out in CoppeliaSim, and all of the flat, uphill and downhill conditions are considered. The results show that the robot can successfully accomplish all the above skills and, at the same time, with the reward function designed, the robot’s pitch angle, yaw angle and roll angle are very small, which means that the robot is relatively stable during walking. Then, the robot is transplanted to a new scene; the results show that although the environment is previously unencountered, the robot can still fulfill the task, which demonstrates the effectiveness and robustness of this proposed method.

29 September 2020 in IEEE Access
Verified
Journal Article
Open access
XZXiaoping Zhang
Xiaoping Zhang
XRXiaogang Ruan
Xiaogang Ruan
HZHong Zhang
Hong Zhang
LLLei Liu
Lei Liu
CHCunwu Han
Cunwu Han
LWLi Wang
Li Wang
Simulating biological intelligence has been proved to be an effective way to design intelligent robots, and simultaneously can solve the problems existing in machine learning methods. For creatures, their motor skills achieving is the first stage of learning. By combining two important cognitive elements: orientation and curiosity, this paper proposes a new neurobiologically-inspired sensorimotor developmental learning method for the mobile robot. In this method, curiosity promotes robot’s exploration of the environment, while orientation enhances robot’s exploitation knowledge of the environment. The orientation cognitive algorithm is designed based on Skinner’s operant conditioning theory, and its rationality is proved. The balance of exploration and exploitation, which is a key problem for all the cognitive learning method, is solved in this method. The developmental learning process can avoid fixed sensorimotor mapping space problem, and help reduce learning waste as well as computing waste. All of the developmental learning method’s characters are finally verified via simulations on a virtual mobile robot.