This paper studies the perception of 2-dimensional directional cues presented on a hand-held tangible interface that resembles a cylindrical handle. The tangible interface is designed to be comfortably held with one hand and houses five custom electromagnetic actuators composed of coils as stators and magnets as movers. We carried out a human subjects experiment enrolling 24 participants, analysing the recognition rate of directional cues using the actuators either to vibrate or tap in sequence across the user's palm. Results show an impact of the positioning/holding of the handle, the mode of stimulation, and the directional indication sent via the handle. There was also a correlation between the score and the confidence of the participants, showing that participants are more confident when recognising vibration patterns. Overall, results supported the potential of the haptic handle to provide accurate guidance, with recognition rates higher than 70 $\%$ in all conditions and higher than 75 $\%$ in the precane and power wheelchair configurations.
Informative and realistic haptic feedback significantly enhances virtual reality (VR) manipulation. In particular, vibrotactile feedback (VF) can deliver diverse haptic sensations while remaining relatively simple. This has made it a go-to solution for haptics within hand-held controllers and tangible props for VR. However, VF in hand-helds has solely focused on monolithic vibration of the entire hand-held device. Thus, it is not clear to what extent such hand-held devices could support the delivery of spatialized information within the hand. In this paper, we consider a tangible cylindrical handle that allows interaction with virtual objects extending beyond it. This handle is fitted with a pair of vibrotactile actuators with the objective of providing in-hand spatialized cues indicating direction and distance of impacts. We evaluated its capability for rendering spatialized impacts with external virtual objects. Results show that it performs very well for conveying an impact’s direction and moderately well for conveying an impact’s distance to the user.
24 May 2023 in IEEE Transactions on Visualization and Computer Graphics
Rich, informative and realistic haptic feedback is key to enhancing Virtual Reality (VR) manipulation. Tangible objects provide convincing grasping and manipulation interactions with haptic feedback of e.g., shape, mass and texture properties. But these properties are static, and cannot respond to interactions in the virtual environment. On the other hand, vibrotactile feedback provides the opportunity for delivering dynamic cues rendering many different contact properties, such as impacts, object vibrations or textures. Handheld objects or controllers in VR are usually restricted to vibrating in a monolithic fashion. In this article, we investigate how spatialiazing vibrotactile cues within handheld tangibles could enable a wider range of sensations and interactions. We conduct a set of perception studies, investigating the extent to which spatialization of vibrotactile feedback within tangible objects is possible as well as the benefits of proposed rendering schemes leveraging multiple actuators in VR. Results show that vibrotactile cues from localized actuators can be discriminated and are beneficial for certain rendering schemes.
Objective. Assistive robots can be developed to restore or provide more autonomy for individuals with motor impairments. In particular, power wheelchairs can compensate lower-limb impairments, while robotic manipulators can compensate upper-limbs impairments. Recent studies have shown that Brain-Computer Interfaces (BCI) can be used to operate this type of devices. However, activities of daily living and long-term use in real-life contexts such as home require robustness and adaptability to complex, changing and cluttered environments which can be problematic given the neural signals that do not always allow a safe and efficient use. Approach. This article describes assist-as-needed sensor-based shared control methods relying on the blending of BCI and depth-sensor-based control. The proposed assistance targets the BCI-teleoperation of effectors for tasks that answer mobility and manipulation needs in a at-home context. Main Results. The assistance provided by the proposed methods was evaluated through a wheelchair mobility and reach-and-grasp laboratory-based experiments in a controlled environment, as part of a clinical trial with a quadriplegic patient implanted with a wireless 64-channel ElectroCorticoGram (ECoG) recording implant named WIMAGINE. Results showed that the proposed methods can assist BCI users in both tasks. Indeed, the time to perform the tasks and the number of changes of mental tasks were reduced. Moreover, unwanted actions, such as wheelchair collisions with the environment, and gripper opening that could result in the fall of the object were avoided. Significance. The proposed methods are steps toward at-home use of BCI-teleoperated assistive robots. Indeed, the proposed shared control methods improved the performance of the two assistive devices. Clinical trial, registration number: NCT02550522.