Abstract Motor imagery based brain-computer interface (MI-BCI) has been studied for improvement of patients’ motor function in neurorehabilitation and motor assistance. However, the difficulties in performing imagery tasks limit its application. To overcome the limitation, an enhanced MI-BCI based on functional electrical stimulation (FES) and virtual reality (VR) is proposed in this study. On one hand, the FES is used to stimulate the subjects’ lower limbs before their imagination to make them experience the muscles’ contraction and improve their attention on the lower limbs, by which it is supposed that the subjects’ motor imagery (MI) abilities can be enhanced. On the other hand, a ball-kicking movement scenario from the first-person perspective is designed to provide visual guidance for performing MI tasks. The combination of FES and VR can be used to reduce the difficulties in performing MI tasks and improve classification accuracy. Finally, the comparison experiments were conducted on twelve healthy subjects to validate the performance of the enhanced MI-BCI. The results show that the classification performance can be improved significantly by using the proposed MI-BCI in terms of the classification accuracy (ACC), the area under the curve (AUC) and the F1_score (paired t-test, p<0.05).
14 June 2024 in IEEE/ASME Transactions on Mechatronics
Accurate acquisition of interactive information is crucial for the effective execution of rehabilitation training. However, due to model and sensor errors, it is difficult to obtain interactive information accurately and quickly. To overcome these challenges, a novel accurate and fast estimation method for the human–robot interaction torques (HRITs) is proposed in this article. First, the HRIT model with order adaptive adjustment ability (HMOAA) is constructed. The polynomial order of HMOAA can be adaptively adjusted based on the partial state estimation, which is more consistent with the dynamic time-varying characteristics of HRIT. Second, the Sage–Husa adaptive strong tracking Kalman filter (SHASTKF) is designed based on the modified Sage–Husa adaptive Kalman filter (SHAKF) and strong tracking Kalman filter (STKF). The SHASTKF can quickly track the abrupt HRIT changes when the subject suddenly exerts active torques in rehabilitation training. Moreover, it also has the ability to recursively estimate the noise characteristics, and can stably complete the HRIT estimation task when the noise characteristics are unknown. Finally, simulations and experiments are conducted to validate the proposed method, and the comparison results demonstrate that the proposed method has good torque estimation precision and fast tracking ability of abrupt changes in HRITs.
16 May 2023 in IEEE Transactions on Automation Science and Engineering
The development of robotic hand that can imitate human movements has always been an important research topic. In this paper, a linkage-driven underactuated three-finger hand is proposed to imitate the flexion/extension (f/e) and abduction/adduction (a/a) motions of human hand. The robotic hand has three identical underactuated fingers, each of which contains an underactuated planar linkage, a spherical four-bar mechanism, and a set of bevel gears. The spherical four-bar mechanism is designed to provide 2-degree-of-freedom actuation, driving the f/e and a/a motions of the proximal joint simultaneously. Based on screw theory, the kinematic model of the spherical mechanism is established, and the maximum available workspace index (MAW) of the spherical mechanism is proposed to evaluate the workspace with the same adduction and abduction angle ranges. The effects of the parameters of the spherical mechanism on the MAW and the transmission efficiency are obtained, and the parameters of the spherical mechanism are optimized. The optimization results show that the MAW of the spherical mechanism can be increased by up to 3.5 times. Finally, experiments are carried out to show the proposed robotic hand can perform simultaneous adaptive grasping and in-hand manipulation. Note to Practitioners —The robotic hand is of great significance for replacing workers in heavy, repetitive, and unsafe working environments. Uncertain environments in non-manufacturing fields, such as industries for pick-and-place, sorting, palletizing, assembly and other operations, marine development, and medical service, require that robotic hands can operate tasks like human hands. Inspired by the human hand with the f/e and a/a motions, a linkage-driven underactuated three-finger hand is proposed in this paper to imitate the functions of the human hand. Due to its underactuated characteristics and a/a function, the designed robotic hand is more dexterous and economical. The effects of the design parameters of the spherical mechanism on the MAW and the transmission efficiency are analyzed, and the parameters of the spherical mechanism are optimized to improve the performance of the robotic hand. This approach can be used in other industrial applications related to the robotic hand or the spherical mechanism.
20 July 2019 in Journal of Ambient Intelligence and Humanized Computing
Accurate recognition of human motion intention (HMI) is beneficial for exoskeleton robots to improve the wearing comfort level and achieve natural human-robot interaction. A classifier trained on labeled source subjects (domains) performs poorly on unlabeled target subject since the difference in individual motor characteristics. The unsupervised domain adaptation (UDA) method has become an effective way to this problem. However, the labeled data are collected from multiple source subjects that might be different not only from the target subject but also from each other. The current UDA methods for HMI recognition ignore the difference between each source subject, which reduces the classification accuracy. Therefore, this article considers the differences between source subjects and develops a novel theory and algorithm for UDA to recognize HMI, where the margin disparity discrepancy (MDD) is extended to multisource UDA theory and a novel weight-aware-based multisource UDA algorithm (WMDD) is proposed. The source domain weight, which can be adjusted adaptively by the MDD between each source subject and target subject, is incorporated into UDA to measure the differences between source subjects. The developed multisource UDA theory is theoretical and the generalization error on target subject is guaranteed. The theory can be transformed into an optimization problem for UDA, successfully bridging the gap between theory and algorithm. Moreover, a lightweight network is employed to guarantee the real-time of classification and the adversarial learning between feature generator and ensemble classifiers is utilized to further improve the generalization ability. The extensive experiments verify theoretical analysis and show that WMDD outperforms previous UDA methods on HMI recognition tasks.
The present study focuses on summarizing the recent advancements in the field of fish swimming mode research and bionic robotic fish prototypes based on smart materials. It has been widely acknowledged that fish exhibit exceptional swimming efficiency and manoeuvrability compared to conventional underwater vehicles. In the pursuit of developing autonomous underwater vehicles (AUVs), conventional experimental methods often prove to be complex and expensive. Hence, the utilization of computer simulations for hydrodynamic modelling provides a cost-effective and efficient approach for analysing the swimming behaviour of bionic robotic fish. Additionally, computer simulations can provide data that are difficult to obtain through experimental methods. Smart materials, which integrate perception, drive, and control functions, are increasingly being applied to bionic robotic fish research. However, the utilization of smart materials in this field is still an area of ongoing research and several challenges remain unresolved. This study provides an overview of the current state of research on fish swimming modes and the development of hydrodynamic modelling. The application of four distinct types of smart materials in bionic robotic fish is then reviewed, with a focus on analysing the advantages and disadvantages of each material in driving swimming behaviour. In conclusion, the paper highlights the key technical challenges that must be addressed for the practical implementation of bionic robotic fish and provides insights into the potential future directions of this field.