Gesture recognition is essential for human and robot collaboration. Within an industrial hybrid assembly cell, the performance of such a system significantly affects the safety of human workers. This work presents an approach to recognizing hand gestures accurately during an assembly task while in collaboration with a robot co-worker. We have designed and developed a sensor system for measuring natural human-robot interactions. The position and rotation information of a human worker's hands and fingertips are tracked in 3D space while completing a task. A modified chain-code method is proposed to describe the motion trajectory of the measured hands and fingertips. The Hidden Markov Model (HMM) method is adopted to recognize patterns via data streams and identify workers' gesture patterns and assembly intentions. The effectiveness of the proposed system is verified by experimental results. The outcome demonstrates that the proposed system is able to automatically segment the data streams and recognize the gesture patterns thus represented with a reasonable accuracy ratio.
21 July 2021 in Journal of Electrical and Computer Engineering
Loop closure detection serves as the fulcrum of improving the accuracy and precision in simultaneous localization and mapping (SLAM). The majority of loop detection methods extract artificial features, which fall short of learning comprehensive data information, but unsupervised learning as a typical deep learning method excels in self-access learning and clustering to analyze the similarity without handling the data. Moreover, the unsupervised learning method does solve restrictions on image quality and singleness semantics in many traditional SLAM methods. Therefore, a loop closure detection strategy based on an unsupervised learning method is proposed in this paper. The main component adopts BigBiGAN to extract features and establish an original bag of words. Then, the complete bag of words is used to detect loop closing. Finally, a considerable validation check of the ORB descriptor is added to verify the result and output outcome of loop closure detection. The proposed algorithm and other compared algorithms are, respectively, applied on Autolabor Pro1 to execute the indoor visual SLAM. The experiment shows that the proposed algorithm increases the recall rate by 20 compared with ORB-SLAM2 and LSD-SLAM. And it also improves at least 40.0 accuracy than others and reduces 14 time loss of ORB-SLAM2. Therefore, the presented SLAM based on BigBiGAN does benefit much the visual SLAM in the indoor environment.
A new positioning algorithm based on RSS measurement is proposed. The algorithm adopts maximum likelihood estimation and semi-definite programming. The received signal strength model is transformed to a non-convex estimator for the positioning of the target using the maximum likelihood estimation. The non-convex estimator is then transformed into a convex estimator by semi-definite programming, and the global minimum of the target location estimation is obtained. This algorithm aims at the known problem and then extends its application to the case of unknown. The simulations and experimental results show that the proposed algorithm has better accuracy than the existing positioning algorithms.
The implementation of low-energy cooperative movements is one of the key technologies for the complex control of the movements of humanoid robots. A control method based on optimal parameters is adopted to optimize the energy consumption of the cooperative movements of two humanoid robots. A dynamic model that satisfies the cooperative movements is established, and the motion trajectory of two humanoid robots in the process of cooperative manipulation of objects is planned. By adopting the control method with optimal parameters, the parameters optimization of the energy consumption index function is performed and the stability judgment index of the robot in the movement process is satisfied. Finally, the effectiveness of the method is verified by simulations and experimentations.
A novel posture motion-based spatiotemporal fused graph convolutional network (PM-STGCN) is presented for skeleton-based action recognition. Existing methods on skeleton-based action recognition focus on independently calculating the joint information in single frame and motion information of joints between adjacent frames from the human body skeleton structure and then combine the classification results. However, that does not take into consideration of the complicated temporal and spatial relationship of the human body action sequence, so they are not very efficient in distinguishing similar actions. In this work, we enhance the ability of distinguishing similar actions by focusing on spatiotemporal fusion and adaptive feature extraction for high discrimination information. Firstly, the local posture motion-based attention (LPM-TAM) module is proposed for the purpose of suppressing the skeleton sequence data with a low amount of motion in the temporal domain, and the representation of motion posture features is concentrated. Besides, the local posture motion-based channel attention module (LPM-CAM) is introduced to make use of the strongly discriminative representation between different action classes of similarity. Finally, the posture motion-based spatiotemporal fusion (PM-STF) module is constructed which fuses the spatiotemporal skeleton data by filtering out the low-information sequence and enhances the posture motion features adaptively with high discrimination. Extensive experiments have been conducted, and the results demonstrate that the proposed model is superior to the commonly used action recognition methods. The designed human-robot interaction system based on action recognition has competitive performance compared with the speech interaction system.
Affection is regarded as a new solution to coordinate task allocation problems in the multi-robot system. In this paper, we proposed an interpretable and computational affection model based on willingness and a new personality model named CASE to measure the heterogeneity of the robot. Emotion contagion model is used to calculate affective interaction among robots, and we use willingness to quantify the impact of affective factors on task allocation and as an important factor for task allocation. Task allocation algorithm is designed for affective robots, and simulate the application of the affection model at task allocation by a typical example. It displays the characteristics and novelty of affection in task allocation and to verify the correctness, effectiveness, and novelty of affective robot task allocation algorithm. The result of the simulation experiment shows that affective robots in multi-robot cooperation systems obtain a better solution than rational robots and express the state of the art of task allocation for effective robots.