Currently, most of the high-performance models for frequency recognition of steady-state visual evoked potentials (SSVEPs) are linear. However, SSVEPs collected from different channels can have non-linear relationship among each other. Linearly combining electroencephalogram (EEG) from multiple channels is not the most accurate solution in SSVEPs classification. To further improve the performance of SSVEP-based braincomputer interface (BCI), we propose a convolutional neural network-based non-linear model, i.e. convolutional correlation analysis (Conv-CA). Different from pure deep learning models, Conv-CA use convolutional neural networks (CNNs) at the top of a self-defined correlation layer. The CNNs function on how to transform multiple channel EEGs into a single EEG signal. The correlation layer calculates the correlation coefficients between the transformed single EEG signal and reference signals. The CNNs provide non-linear operations to combine EEGs in different channels and different time. And the correlation layer constrains the fitting space of the deep learning model. A comparison study between the proposed Conv-CA method and the task-related component analysis (TRCA) based methods is conducted. Both methods are validated on a 40-class SSVEP benchmark dataset recorded from 35 subjects. The study verifies that the Conv-CA method significantly outperforms the TRCA-based methods. Moreover, Conv-CA has good explainability since its inputs of the correlation layer can be analyzed for visualizing what the model learnt from the data. Conv-CA is a non-linear extension of spatial filters. Its CNN structures can be further explored and tuned for reaching a better performance. The structure of combining neural networks and unsupervised features has the potential to be applied to the classification of other signals.
21 June 2023 in IEEE Robotics & Automation Magazine
In this article, we present AR3n (pronounced as Aaron), an assist-as-needed (AAN) controller that utilizes reinforcement learning (RL), to supply adaptive assistance during a robot-assisted handwriting rehabilitation task. Unlike previous AAN controllers, our method does not rely on patient-specific controller parameters or physical models. We propose the use of a virtual patient model to generalize AR3n across multiple subjects. The system modulates robotic assistance in real time based on a subject’s tracking errors while minimizing the amount of robotic assistance. The controller is experimentally validated through a set of simulations and human subject experiments. Finally, a comparative study with a traditional rule-based controller is conducted to analyze differences in the assistance mechanisms of the two controllers.
23 December 2019 in IEEE Robotics and Automation Letters
In this letter, we present an intelligent Assistant for Robotic Therapy (iART), that provides robotic assistance during 3D trajectory tracking tasks. We propose a novel LSTM-based robot learning from demonstration (LfD) paradigm to mimic a therapist's assistance behavior. iART presents a trajectory agnostic LfD routine that can generalize learned behavior from a single trajectory to any 3D shape. Once the therapist's behavior has been learned, iART enables the patient to modify this behavior as per their preference. The system requires only a single demonstration of 2 minutes and exhibits a mean accuracy of 91.41% in predicting, and hence mimicking a therapist's assistance behavior. The system delivers stable assistance in realtime and successfully reproduces different types of assistance behaviors.
22 October 2018 in IEEE Transactions on Control Systems Technology
This paper studies a problem of bilateral teleoperation in the presence of asymmetric communication delays, in the case when there is a controller saturation constraint on both the local and remote manipulators. Stability under time delays has been a key challenge in the control of a teleoperation system, and several controllers, mostly based on the concept of passivity, have been proposed over the past two decades. The recently proposed controllers with damping injection improve tracking performance in addition to guaranteeing stability, due to explicit position information in the controller. These results are extended in the case of manipulators that can only produce bounded joint torques for coordination and force reflection. Sufficient conditions for guaranteeing stability and tracking are provided under such a controller restriction. The proposed scheme is validated by experiments on two three degrees of freedom manipulators.
25 November 2019 in The International Journal of Medical Robotics and Computer Assisted Surgery