Objective. Assistive robots can be developed to restore or provide more autonomy for individuals with motor impairments. In particular, power wheelchairs can compensate lower-limb impairments, while robotic manipulators can compensate upper-limbs impairments. Recent studies have shown that Brain-Computer Interfaces (BCI) can be used to operate this type of devices. However, activities of daily living and long-term use in real-life contexts such as home require robustness and adaptability to complex, changing and cluttered environments which can be problematic given the neural signals that do not always allow a safe and efficient use. Approach. This article describes assist-as-needed sensor-based shared control methods relying on the blending of BCI and depth-sensor-based control. The proposed assistance targets the BCI-teleoperation of effectors for tasks that answer mobility and manipulation needs in a at-home context. Main Results. The assistance provided by the proposed methods was evaluated through a wheelchair mobility and reach-and-grasp laboratory-based experiments in a controlled environment, as part of a clinical trial with a quadriplegic patient implanted with a wireless 64-channel ElectroCorticoGram (ECoG) recording implant named WIMAGINE. Results showed that the proposed methods can assist BCI users in both tasks. Indeed, the time to perform the tasks and the number of changes of mental tasks were reduced. Moreover, unwanted actions, such as wheelchair collisions with the environment, and gripper opening that could result in the fall of the object were avoided. Significance. The proposed methods are steps toward at-home use of BCI-teleoperated assistive robots. Indeed, the proposed shared control methods improved the performance of the two assistive devices. Clinical trial, registration number: NCT02550522.
Upright posture control and gait are essential for achieving autonomous daily living activities. Postural control of upright posture relies, among others, on the integration of various sensory information. In this context, light touch (LT) and light grip (LG) of a stationary object provide an additional haptic sensory input that helps to reduce postural sway. When LG was studied through the grasp of a cane, the sensory role of this assistive tool was often limited to a mediation interface. Its role was restricted to transmit the interaction forces between its tip and the ground to the hand. While most studies involve participants standing in an unstable way, such as the tandem stance, in this paper we study LG from a different perspective. We attached a handle of a cane firmly to a stationary support. Thus, we can focus on the role of the hand receptors in the LG mechanism. LG condition was ensured through the tactile information gathered by FSR sensors placed on the handle surface. Moreover, participants involved in our study stood in a usual way. The study involved twelve participants in an experiment composed of two conditions: standing relaxed while lightly gripping an equipped handle attached to the ground, and standing in the same way without gripping the handle. Spatial and frequency analyses confirmed the results reported in the literature with other approaches.