The closed-loop control of rehabilitative technologies by neural commands has shown a great potential to improve motor recovery in patients suffering from paralysis. Brain-machine interfaces (BMI) can be used as a natural control method for such technologies. BMI provide a continuous association between the brain activity and peripheral stimulation, with the potential to induce plastic changes in the nervous system. Paraplegic patients, and especially the ones with incomplete injuries, constitute a potential target population to be rehabilitated with brain-controlled robotic systems, as they may improve their gait function after the reinforcement of their spared intact neural pathways. This paper proposes a closed-loop BMI system to control an ambulatory exoskeleton–without any weight or balance support–for gait rehabilitation of incomplete spinal cord injury (SCI) patients. The integrated system was validated with three healthy subjects, and its viability in a clinical scenario was tested with four SCI patients. Using a cue-guided paradigm, the electroencephalographic signals of the subjects were used to decode their gait intention, and to trigger the movements of the exoskeleton. We designed a protocol with a special emphasis on safety, since patients with poor balance were required to stand and walk. We continuously monitored their fatigue and exertion levels, and conducted usability and user-satisfaction tests after the experiments. The results show that, for the three healthy subjects, 84.44□14.56% of the trials were correctly decoded. Three out of the four patients performed at least one successful BMI session, with an average performance of 77.61□14.72%. The shared control strategy implemented (i.e., the exoskeleton could only move during specific periods of time) was effective in preventing unexpected movements during periods in which patients were asked to relax. On average, 55.22□16.69% and 40.45□16.98% of the trials (for healthy subjects and patients, respectively) would have suffered from unexpected activations (i.e., false positives) without the proposed control strategy. All the patients showed low exertion and fatigue levels during the performance of the experiments. This paper constitutes a proof-of-concept study to validate the feasibility of a BMI to control an ambulatory exoskeleton by patients with incomplete paraplegia (i.e., patients with good prognosis for gait rehabilitation).

This paper shows how a robot arm can follow and grasp moving objects tracked by a vision system, as is needed when a human hands over an object to the robot during collaborative working. While the object is being arbitrarily moved by the human co-worker, a set of likely grasps, generated by a learned grasp planner, are evaluated online to generate a feasible grasp with respect to both: the current configuration of the robot respecting the target grasp; and the constraints of finding a collision-free trajectory to reach that configuration. A task-based cost function enables relaxation of motion-planning constraints, enabling the robot to continue following the object by maintaining its end-effector near to a likely pre-grasp position throughout the object’s motion. We propose a method of dynamic switching between: a local planner, where the hand smoothly tracks the object, maintaining a steady relative pre-grasp pose; and a global planner, which rapidly moves the hand to a new grasp on a completely different part of the object, if the previous graspable part becomes unreachable. Various experiments are conducted using a real collaborative robot and the obtained results are discussed.

This paper addresses the problem of grasping arbitrarily shaped objects, observed as partial point-clouds, without requiring: models of the objects, physics parameters, training data, or other a-priori knowledge. A grasp metric is proposed based on Local Contact Moment (LoCoMo). LoCoMo combines zero-moment shift features, of both hand and object surface patches, to determine local similarity. This metric is then used to search for a set of feasible grasp poses with associated grasp likelihoods. LoCoMo overcomes some limitations of both classical grasp planners and learning-based approaches. Unlike force-closure analysis, LoCoMo does not require knowledge of physical parameters such as friction coefficients, and avoids assumptions about fingertip contacts, instead enabling robust contacts of large areas of hand and object surface. Unlike more recent learning-based approaches, LoCoMo does not require training data, and does not need any prototype grasp configurations to be taught by kinesthetic demonstration. We present results of real-robot experiments grasping 21 different objects, observed by a wrist-mounted depth camera. All objects are grasped successfully when presented to the robot individually. The robot also successfully clears cluttered heaps of objects by sequentially grasping and lifting objects until none remain.

Gait training for individuals with neurological disorders is challenging in providing the suitable assistance and more adaptive behaviour towards user needs. The user specific adaptation can be defined based on the user interaction with the orthosis and by monitoring the user intentions. In this paper, an adaptive control model, commanded by the user intention, is evaluated using a lower limb exoskeleton with incomplete spinal cord injury individuals (SCI). A user intention based adaptive control model has been developed and evaluated with 4 incomplete SCI individuals across 3 sessions of training per individual. The adaptive control model modifies the joint impedance properties of the exoskeleton as a function of the human-orthosis interaction torques and the joint trajectory evolution along the gait sequence, in real time. The volitional input of the user is identified by monitoring the neural signals, pertaining to the user’s motor activity. These volitional inputs are used as a trigger to initiate the gait movement, allowing the user to control the initialization of the exoskeleton movement, independently. A Finite-state machine based control model is used in this set-up which helps in combining the volitional orders with the gait adaptation. The exoskeleton demonstrated an adaptive assistance depending on the patients’ performance without guiding them to follow an imposed trajectory. The exoskeleton initiated the trajectory based on the user intention command received from the brain machine interface, demonstrating it as a reliable trigger. The exoskeleton maintained the equilibrium by providing suitable assistance throughout the experiments. A progressive change in the maximum flexion of the knee joint was observed at the end of each session which shows improvement in the patient performance. Results of the adaptive impedance were evaluated by comparing with the application of a constant impedance value. Participants reported that the movement of the exoskeleton was flexible and the walking patterns were similar to their own distinct patterns. This study demonstrates that user specific adaptive control can be applied on a wearable robot based on the human-orthosis interaction torques and modifying the joints’ impedance properties. The patients perceived no external or impulsive force and felt comfortable with the assistance provided by the exoskeleton. The main goal of such a user dependent control is to assist the patients’ needs and adapt to their characteristics, thus maximizing their engagement in the therapy and avoiding slacking. In addition, the initiation directly controlled by the brain allows synchronizing the user’s intention with the afferent stimulus provided by the movement of the exoskeleton, which maximizes the potentiality of the system in neuro-rehabilitative therapies.

Sit-to-stand transition is an essential step in a lower limb rehabilitation therapy, mainly for assisting the patient to transit from wheel chair to the next level of therapy. A mixed stiffness-damping control adaptation is proposed for this task which will help in reaching the final position with a constant velocity. A combination of control model is proposed to ensure the initiation and the final stage of the transition, such as to ensure stability and to maintain the equilibrium. The combined control model helps in reaching the goal position with equal participation from the user. For patient studies, such as with paraplegic patients, a combinational control model with muscle stimulation can be included to provide a complete assistance. The role of muscle stimulation and joint movement assistance is also considered in this control model. Further, final stage of this transition must ensure keeping or helping the user to maintain the upright position.