Teleoperation plays a crucial role in enabling robot operations in challenging environments, yet existing limitations in effectiveness and accuracy necessitate the development of innovative strategies for improving teleoperated tasks. This letter introduces a novel approach that utilizes mixed reality and assistive autonomy to enhance the efficiency and precision of humanoid robot teleoperation. By leveraging Probabilistic Movement Primitives, object detection, and Affordance Templates, the assistance combines user motion with autonomous capabilities, achieving task efficiency while maintaining human-like robot motion. Experiments and feasibility studies on the Nadia robot confirm the effectiveness of the proposed framework.
26 August 2024 in International Journal of Human–Computer Interaction
Intelligent systems are increasingly interacting with people, both in their daily lives and through their use in safety critical systems. Current research is focused on how to use intelligent systems in a collaborative way as a teammate, rather than a tool. This requires a better understanding of what behaviors enable effective human-agent teams. This paper reports an experiment where a human player collaborates with an agent to perform a maneuvering task while concurrently performing a memory task. The player must determine in which contexts the agent requires their input to achieve better combined game plus memory task accuracy scores. We hypothesized that high-performing teams would exhibit different patterns of control inputs when compared to low-performing teams and that these patterns of control would be made more evident with user interfaces that increased operator situation awareness. Preliminary results are inconclusive, but show different patterns of interaction between high- and low-performing teams.
This article presents a case study using Human-Centered Design (HCD) to improve the safety and experience of Spaceflight Participants (SFPs) in commercial space transportation suborbital flight scenarios. The focus of the study is on the microgravity coasting phase, where the 2 dominant expectations of SFPs involve: (1) a view of the earth from space and (2) a weightlessness experience. Although SFPs enjoy a unique experience, it is important to provide them with appropriate information in a timely fashion, especially when off-nominal events occur. To gain an insight into how cabin resources could help SFPs perform their required tasks during the microgravity coasting phase, a preliminary experiment was conducted by using a set of low-fidelity prototypes. The findings of the test should be applicable to other suborbital and orbital flight experience designs, such as Blue Origin or The Space Perspective. This article demonstrates an HCD approach for the enhancement of SFPs' safety and overall experience. It concludes with a discussion on the limitations of this study and considerations for follow-on design iterations.
Teleoperation plays a crucial role in enabling robot operations in challenging environments, yet existing limitations in effectiveness and accuracy necessitate the development of innovative strategies for improving teleoperated tasks. This article introduces a novel approach that utilizes mixed reality and assistive autonomy to enhance the efficiency and precision of humanoid robot teleoperation. By leveraging Probabilistic Movement Primitives, object detection, and Affordance Templates, the assistance combines user motion with autonomous capabilities, achieving task efficiency while maintaining human-like robot motion. Experiments and feasibility studies on the Nadia robot confirm the effectiveness of the proposed framework.