The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS‐Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.
16 September 2021 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
In previous work, we developed an exoskeleton, Hand Spring Operated Movement Enhancer (HandSOME II), that allows movement at 15 hand degrees of freedom (DOF). Eleven separate elastic elements can be added to customize the extension assistance for individuals with impaired hand function. In this pilot study of twelve individuals with stroke, we measured the immediate improvements in range of motion (ROM) and upper extremity function when wearing the device. Index finger ROM was significantly improved at the PIP (p=.01) and DIP joints (p=.026), and the max extension was significantly increased at the MCP (p<; .001), PIP (p=.013) and DIP joints (p=.016). The thumb CMC abduction max (p=.017) and CMC flexion/extension ROM also increased (p=.04). In a grip and release task involving various objects, six subjects were unable to complete the tasks without assistance. Across these 6 subjects, 13 of 42 tasks were completed without assistance, while 36 of 42 tasks were completed when wearing HandSOME II. Despite the extension assistance provided by the device, flexion grip force was not statistically decreased. HandSOME II can potentially increase the effectiveness of repetitive task practice in patients with moderate-severe hand impairment by allowing completion of grasp and release tasks that are impossible to complete unassisted.