Intelligent virtual agents (VAs) already support us in a variety of everyday tasks such as setting up appointments, monitoring our fitness, and organizing messages. Adding a humanoid body representation to these mostly voice-based VAs has enormous potential to enrich the human–agent communication process but, at the same time, raises expectations regarding the agent’s social, spatial, and intelligent behavior. Embodied VAs may be perceived as less human-like if they, for example, do not return eye contact, or do not show a plausible collision behavior with the physical surroundings. In this article, we introduce a new model that extends human-to-human interaction to interaction with intelligent agents and covers different multi-modal and multi-sensory channels that are required to create believable embodied VAs. Theoretical considerations of the different aspects of human–agent interaction are complemented by implementation guidelines to support the practical development of such agents. In this context, we particularly emphasize one aspect that is distinctive of embodied agents, i.e., interaction with the physical world. Since previous studies indicated negative effects of implausible physical behavior of VAs, we were interested in the initial responses of users when interacting with a VA with virtual–physical capabilities for the first time. We conducted a pilot study to collect subjective feedback regarding two forms of virtual–physical interactions. Both were designed and implemented in preparation of the user study, and represent two different approaches to virtual–physical manipulations: (i) displacement of a robotic object, and (ii) writing on a physical sheet of paper with thermochromic ink. The qualitative results of the study indicate positive effects of agents with virtual–physical capabilities in terms of their perceived realism as well as evoked emotional responses of the users. We conclude with an outlook on possible future developments of different aspects of human–agent interaction in general and the physical simulation in particular.
Raycasting-based interaction techniques are widely used for object selection in immersive environments. Despite their intuitive use, they come with challenges due to small or far away objects, hand tremor, and tracking inaccuracies. Previous adaptations for raycasting, such as directly snapping the ray to the closest target, extruding the ray to a cone, or multi-step selection techniques, require additional time for users to become familiar with them. To address these issues, we propose three assistive techniques in which the visible selection ray is subtly redirected towards a target, with a proximity and gain based increase in the redirection amount. In a user study (N = 26), we compared these redirection techniques with a baseline condition based on a Fitts’ law task and collected performance measures as well as comprehensive subjective feedback. The results indicate that the three redirection techniques are significantly faster and have higher effective throughput than the baseline condition. Participants retained a high sense of agency with all redirection techniques and reported significantly lower total workload compared to the baseline. The majority of participants preferred selection with assistive ray redirection and perceived it as not distracting or intrusive. Our findings support that assistive redirected raycasting techniques can improve object selection performance and user experience in virtual environments.
1 February 2018 in PRESENCE: Virtual and Augmented Reality
Spatial augmented reality (SAR) technology allows one to change the appearance of objects by projecting directly onto their surface without the requirement of wearing glasses, and therefore can be used in many practical applications. In this article, we present a human–subject study, which investigates the research question whether it is possible to use SAR to change one's perception of depth and spatial relationships among objects and humans in a real-world environment. Such projected illusions could open up new possibilities, for example, supporting people who suffer from poor depth perception by compensating distance and size misperceptions. We present three monoscopic projection-based techniques that we adapted from visual arts: (i) color temperature, (ii) luminance contrast, and (iii) blur, and show that each of them can significantly change depth perception, even in a real-world environment when displayed with other distance cues. We discuss practical implications and individual differences in the perception of depth between observers, and we outline future directions to influence and improve human depth perception in the real world.
Handray selection is widely used for hand-tracking-based interactions in head-mounted displays, as it is a simple and straightforward interaction technique. However, selection performance decreases for small and distant objects. It is also negatively affected by input inaccuracies due to natural hand tremors, tracking issues, and movement caused by pinch gestures. Recent work introduced assistive raycast redirection for controller raycasting which facilitates object selection in virtual reality. It applies a gradual proximity and gain-based redirection of the ray towards the target center within a predefined redirection zone. Inspired by this approach, we implemented two redirection techniques for improving handray selection while maintaining ease of use: (1) RayToTarget, which adapts existing controller-based raycast redirection to hand-tracking, and (2) gaze-assisted RayToGaze as a novel technique. We evaluated them together with classic handray in a Fitts’ Law user study. Our findings suggest that both redirection techniques perform significantly better than classic handray, but performance for RayToGaze decreases at greater target depth compared to RayToTarget. Generally, handray redirection was well received and did not decrease the sense of agency. However, different individual preferences and target acquisition strategies affect the user experience for both redirection techniques and might impact selection performance.