Mobile manipulation has a broad range of applications in robotics. However, it is usually more challenging than fixed-base manipulation due to the complex coordination of a mobile base and a manipulator. Although recent works have demonstrated that deep reinforcement learning is a powerful technique for fixed-base manipulation tasks, most of them are not applicable to mobile manipulation. This paper investigates how to leverage deep reinforcement learning to tackle whole-body mobile manipulation tasks in unstructured environments using only on-board sensors. A novel mobile manipulation system which integrates the state-of-the-art deep reinforcement learning algorithms with visual perception is proposed. It has an efficient framework decoupling visual perception from the deep reinforcement learning control, which enables its generalization from simulation training to real-world testing. Extensive simulation and experiment results show that the proposed mobile manipulation system is able to grasp different types of objects autonomously in various simulation and real-world scenarios, verifying the effectiveness of the proposed mobile manipulation system.

Recently, as humans have become increasingly interested in ocean resources, underwater vehicle-manipulator systems (UVMSs) have played an increasingly important role in ocean exploitation. To realize precise operation in underwater narrow spaces, the fly arm underwater vehicle manipulator system (FAUVMS) is proposed with manipulators as its core. However, this system suffers severe dynamic coupling effects due to the combination of small vehicle and big manipulators. To resolve this issue, we propose a robust adaptive controller that contains two parts. In the first part, the extended Kalman filter (EKF) is designed to estimate the system states and predicts external disturbances to achieve adaptive control. In the second part, a chattering-free sliding mode control (SMC) is designed to converge the tracking errors to zero, thus guaranteeing the robustness of the controller. We constructed the simulation platform based on the geometric model of FAUVMS, and various simulations are carried out under different situations. Compared to the traditional methods, the proposed method has a faster convergent speed, a better robustness and adaptiveness to external disturbances, and the tracking errors of positions of the vehicle and each end-effector are much smaller.

The 2022 Winter Olympics has shown that robots can serve, protect, and help people excel in many aspects of their lives.

Currently, for underwater close-range large-target localization, visual localization techniques fail since large targets completely occupy the camera’s field of view at ultraclose ranges. To address the issue, a multi-stage optical localization method combining a binocular camera and a single-point laser rangefinder is proposed in this paper. The proposed method comprises three parts. First, the imaging model of the underwater camera is modified, and a laser rangefinder is used to further correct the underwater calibration results of the binocular camera. Second, YOLOv8 is applied to recognize the targets to prepare for target localization. Third, extrinsic calibration of the binocular camera and laser rangefinder is performed, and a Kalman filter is employed to fuse the target position information measured by the binocular camera and laser rangefinder. The experimental results show that, compared with using a binocular camera alone, the proposed method can accurately and stably locate the target at close ranges with an average error of only 2.27 cm, without the risk of localization failure, and reduces binocular localization error by 90.57%.

The force tracking control of deep-sea hydraulic manipulator systems with long transmission pipelines is disposed via fuzzy adaptive backstepping control based on an extended state observer in this paper. The pipeline model is established and then used to estimate the pressures in cylinder chambers, which are used to obtain the output force. In this process, the velocity of the piston, which is unmeasured, is needed, and an extended state observer is constructed to estimate the unmeasurable velocity signal. To cope with parameter uncertainties caused by changes in working depth, an adaptive algorithm is combined with the backstepping controller. Fuzzy logic is employed to design self-tuners that can automatically adjust the control parameters to guarantee force control performance from shallow seas to deep seas. The experimental results illustrate the success of the proposed control method. Comparative experimental results demonstrate that the extended state observer-based fuzzy adaptive backstepping controller has a relatively better tracking performance in different working conditions.

Dynamic control of underwater vehicle manipulator systems (UVMSs) is the key part of underwater intervention tasks. In this paper, we propose an adaptive controller with a disturbance observer that mainly consists of two parts: the first part is the adaptive control law that estimates the changes in the center of mass (COM) and the center of buoyancy (COB) of the vehicle, and the second part is the nonlinear disturbance observer that estimates the external disturbance and model uncertainties. To attenuate the overestimation problem, a damping term is introduced to the adaptive law. The stability of the proposed method is proven on the basis of Lyapunov theory. We develop three scenarios on the Simurv platform and illustrate the effectiveness of the proposed method with a short response time and high tracking performance.