Qixin Sha

Dr. Qixin Sha

orcid

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 January 2020 in IEEE Access
Verified
Journal Article
Open access
QZQilei Zhang
Qilei Zhang
JLJinying Lin
Jinying Lin
QSQixin Sha
Qixin Sha
Bo HeBo He
Bo He
GLGuangliang Li
Guangliang Li
Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and deep reinforcement learning have been introduced into the AUV design and research to improve its autonomy. However, these methods are still difficult to apply directly to the actual AUV system because of the sparse rewards and low learning efficiency. In this paper, we proposed a deep interactive reinforcement learning method for path following of AUV by combining the advantages of deep reinforcement learning and interactive RL. In addition, since the human trainer cannot provide human rewards for AUV when it is running in the ocean and AUV needs to adapt to a changing environment, we further propose a deep reinforcement learning method that learns from both human rewards and environmental rewards at the same time. We test our methods in two path following tasks—straight line and sinusoids curve following of AUV by simulating in the Gazebo platform. Our experimental results show that with our proposed deep interactive RL method, AUV can converge faster than a DQN learner from only environmental reward. Moreover, AUV learning with our deep RL from both human and environmental rewards can also achieve a similar or even better performance than that with deep interactive RL and can adapt to the actual environment by further learning from environmental rewards.

17 July 2023 in Electronics
Verified
Journal Article
Open access
PDF file
XZXiaofang Zhang
Xiaofang Zhang
YFYu Fan
Yu Fan
HLHongjie Liu
Hongjie Liu
YZYunzhong Zhang
Yunzhong Zhang
QSQixin Sha
Qixin Sha
An effective autonomous underwater vehicle (AUV) simulation system can greatly improve development efficiency and reduce the cost and risk of actual equipment operation. In this paper, a comprehensive simulation system is developed using Mission Oriented Operating Suite (MOOS) and Unreal Engine 4 (UE4). The former provides an open-source development framework and application components, which are widely used in the field of underwater robots. The latter is a well-known game development engine that has realistic effects and various plugins. As far as we know, there are few simulation systems based on MOOS and UE4. Moreover, a modular architecture for the simulation system is designed and implemented in the paper. The developed system consists of four subsystems, including the simulation editing and controlling subsystem, shore-based operation subsystem, simulation engine subsystem, and three-dimensional (3D) visualization subsystem. These subsystems have modular characteristics and independent functions and communicate with each other through network sockets. Through the system, users can customize simulation scenarios, send missions and control simulation progress from the graphic user interface. And the system can be used in operation training, software testing, algorithm verification of AUV, etc.

8 November 2023 in Electronics
Verified
Journal Article
Open access
PDF file
云陈云 紫 陈
云 紫 陈
DZDengsheng Zhang
Dengsheng Zhang
CWChengxiang Wang
Chengxiang Wang
QSQixin Sha
Qixin Sha
For underwater target exploration, multiple Autonomous Underwater Vehicles (AUVs) have shown significant advantages over single AUVs. Aiming at Multi-AUV task allocation, which is an important issue for collaborative work in underwater environments, this paper proposes a Multi-AUV task allocation method based on the Differential Evolutionary Gray Wolf Optimization (DE-GWO) algorithm. Firstly, the working process of the Multi-AUV system was analyzed, and the allocation model and objective function were established. Then, we combined the advantages of the strong global search capability of the Differential Evolutionary (DE) algorithm and the excellent convergence performance of Gray Wolf Optimization (GWO) to solve the task assignment of the Multi-AUV system. Finally, a reassignment mechanism was used to solve the problem of AUV failures during the task’s execution. In the simulation comparison experiments, the DE-GWO, GWO, DE, and Particle Swarm Optimization (PSO) algorithms were carried out for different AUV execution capabilities, respectively.

Verified
Journal Article
Open access
PDF file
QSQixin Sha
Qixin Sha
JZJiaming Zhang
Jiaming Zhang
YSYue Shen
Yue Shen
Bo HeBo He
Bo He
Efficiency is very important for robots when executing multiple tasks, especially for autonomous underwater vehicles (AUVs) with limited endurance. In order to improve efficiency, task-sequencing optimization, which focuses on achieving the optimal execution order of multiple tasks, is one effective way. In this paper, the classic lawnmower traverse task is taken as an example for optimization, and discrete salp swarm algorithm (DSSA), which combines salp swarm algorithm (SSA) and genetic algorithm (GA), is selected and applied to optimize task sequencing for one AUV. In the optimization process, there are two key problems that need to be solved. One is how to encode the individual chromosome and the other is how to perform genetic operations on chromosomes of different lengths. For the former problem, a two-layer encoding method is proposed to generate individuals in the population, in which identity number and entry point of different areas are encoded, respectively. For the latter problem, mutation and crossover operators are modified and extended to deal with individuals of variable length due to the limited endurance of AUVs. Simulation results show that the sequencing optimization can be achieved after finite iteration. Through comprehensive comparison, DSSA is finally implemented and verified in a physical AUV.

10 March 2026 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
SWSiyu Wang
Siyu Wang
QSQixin Sha
Qixin Sha
BJBinghui Ji
Binghui Ji
SSShangfa Song
Shangfa Song
PCPeimiao Chen
Peimiao Chen
Bo HeBo He
Bo He
Accurate alignment between the Doppler Velocity Log (DVL) and the Strapdown Inertial Navigation System (SINS) is essential for reliable Autonomous Underwater Vehicles (AUVs) navigation, especially in dynamic and GNSS-denied environments. Conventional DVL calibration methods often suffer from local optima and limited robustness, leading to inaccurate estimation of scale factors and misalignment angles. While optimized calibration parameters can improve the performance of traditional filters such as EKF or UKF, their effectiveness remains sensitive to environmental disturbances, outliers, and non-Gaussian noise. To address these challenges, this paper proposes a unified calibration and navigation framework. A Simulated Annealing Adaptive Particle Swarm Optimization (SA-APSO) algorithm is developed to globally and robustly estimate DVL error parameters. These parameters are then used in conjunction with a Modified Residual Adaptive Unscented Kalman Filter (MRUKF) with M-estimation, which enhances resilience to measurement anomalies and dynamic noise. Unlike conventional filters, MRUKF adaptively adjusts residual weighting, allowing it to better exploit calibration benefits under non-ideal conditions. Simulations conducted on four representative AUV trajectories demonstrate the superiority of the proposed framework. Compared with EKF and UKF, endpoint errors are reduced by up to 50.2% and 54.1%, respectively, while overall position RMSE decreases by 30.6% and 29.6%. These results confirm that combining accurate calibration with robust filtering is essential for high-precision navigation in realistic, uncertain underwater environments.