Mobile robots can complete a task in cooperation with a human partner. In this paper, a hybrid shared control method for a mobile robot with omnidirectional wheels is proposed. A human partner utilizes a six degrees of freedom haptic device and electromyography (EMG) signals sensor to control the mobile robot. A hybrid shared control approach based on EMG and artificial potential field is exploited to avoid obstacles according to the repulsive force and attractive force and to enhance the human perception of the remote environment based on force feedback of the mobile platform. This shared control method enables the human partner to tele-control the mobile robot's motion and achieve obstacles avoidance synchronously. Compared with conventional shared control methods, this proposed one provides a force feedback based on muscle activation and drives the human partners to update their control intention with predictability. Experimental results demonstrate the enhanced performance of the mobile robots in comparison with the methods in the literatures.

Teleoperated robot systems are able to support humans to accomplish their tasks in many applications. However, the performance of teleoperation largely depends on motor functionality and human operator's skill, especially when a human operator is short of skill training. In order to adapt to various unstructured environments for the robot system and the human operator, in this paper, a teleoperation scheme using integrated tremor attenuation with a variable gain control algorithm involving surface electromyogram is proposed to achieve personalized control performance and to reduce reliance on operator's skill. For attenuating tremor, a filter based on support vector machine is developed to guarantee normal operation. This filter depends on the machine learning scheme and does not rely on a priori filter parameters. Semiphysical experiments have been performed to demonstrate the effectiveness of the proposed methods.

Due to rich spectral information, hyperspectral images (HSIs) have been widely used in various fields. However, limited by imaging systems, the low spatial resolution of HSIs has become an important problem. In this article, for enhancing the spatial resolution, Interactformer is proposed to interact with global and local features extracted by transformer and 3-D convolutional neural network (CNN) branches. Within the transformer branch, a separable self-attention module with linear complexity is designed to solve the problem that traditional self-attention mechanisms suffer from large memory costs due to quadratic complexity. In the 3-D CNN branch, the spectral attention module and 3-D convolution are applied jointly to better protect the spectral correlation among spectral bands and facilitate local feature extraction of HSIs. The interactive attention unit between the two parallel branches is designed to interact with local and global feature information adaptively. Compared with state-of-the-art super-resolution (SR) methods, the proposed method reconstructs better HSI in simulated SR experiments, real SR experiments, and classification experiments, which proves that Interactformer can effectively improve the spatial resolution while preserving the spectral information.

Due to the lack of transparent and friendly human-robot interaction (HRI) interface, as well as various uncertainties, it is usually a challenge to remotely manipulate a robot to accomplish a complicated task. To improve the teleoperation performance, we propose a new perception mechanism by integrating a novel learning method to operate the robots in the distance. In order to enhance the perception of the teleoperation system, we utilize a surface electromyogram signal to extract the human operator's muscle activation. As a response to the changes in the external environment, as sensed through haptic and visual feedback, a human operator naturally reacts with various muscle activations. By imitating the human behaviors in task execution, not only motion trajectory but also arm stiffness adjusted by muscle activation, it is expected that the robot would be able to carry out the repetitive tasks autonomously or uncertain tasks with improved intelligence. To this end, we develop a robot learning algorithm based on probability statistics under an integrated framework of the hidden semi-Markov model (HSMM) and the Gaussian mixture method. This method is employed to obtain a generative task model based on the robot's trajectory. Then, Gaussian mixture regression based on HSMM is applied to correct the robot trajectory with the reproduced results from the learned task model. The execution procedures consist of a learning phase and a reproduction phase. To guarantee the stability, immersion, and maneuverability of the teleoperation system, a variable gain control method that involves electromyography (EMG) is introduced. Experimental results have demonstrated the effectiveness of the proposed method.

In this work, a human motion intention prediction method based on an autoregressive (AR) model for teleoperation is developed. Based on this method, the robot’s motion trajectory can be updated in real time through updating the parameters of the AR model. In the teleoperated robot’s control loop, a virtual force model is defined to describe the interaction profile and to correct the robot’s motion trajectory in real time. The proposed human motion prediction algorithm acts as a feedforward model to update the robot’s motion and to revise this motion in the process of human–robot interaction (HRI). The convergence of this method is analyzed theoretically. Comparative studies demonstrate the enhanced performance of the proposed approach. Note to Practitioners—In general, the robot trajectory is predetermined and it does not consider the influence of the interaction profiles in terms of position and interaction force between the human and the robot. In addition, it is hard to quantify the influence of interaction profile for the robot trajectory. For teleoperation, an AR-based model is proposed to predict the trajectory of the human and then to update the trajectory of the robot. The developed method includes the following aspects: 1) the robot trajectory can be regulated based on the interaction profiles; 2) the feedforward model can estimate the trajectory of the human to achieve the purpose of human intention recognition in advance for the robot; and 3) the proposed method can be potentially utilized for telerehabilitation, microsurgery, and so on.

The dynamics of human arms has a high impact on the humans' activities in daily life, especially when a human operates a tool such as interactions with a robot with the need for high dexterity. The dexterity of human arms depends largely on motor functionality of muscle. In this sense, the dynamics of human arms should be well analyzed. In this paper, in order to analyse the characteristic of human arms, a neural-network-based algorithm is proposed for exploring the potential model between electromyography (EMG) signal and human arm's force. Based on the analysis of force for humans, the mean absolute value of the electromyographic signal is selected as the input for the potential model. In this paper, in order to accurately estimate the potential model, three domains fuzzy wavelet neural network (TDFWNN) algorithm without prior knowledge of the biomechanical model is utilized. The performance of the proposed algorithm has been demonstrated by the experimental results in comparison with the conventional radial basis function neural network (RBFNN) method. By comparison, the proposed TDFWNN algorithm provides an effective solution to evaluate the influence of human factors based on biological signals.