How can we design the user interfaces for augmented reality (AR) so that we can interact as simple, flexible and expressive as we can with smartphones in one hand? To explore this question, we propose PalmGazer as an interaction concept integrating eye-hand interaction to establish a singlehandedly operable menu system. In particular, PalmGazer is designed to support quick and spontaneous digital commands– such as to play a music track, check notifications or browse visual media – through our devised three-way interaction model: hand opening to summon the menu UI, eye-hand input for selection of items, and dragging gesture for navigation. A key aspect is that it remains always-accessible and movable to the user, as the menu supports meaningful hand and head based reference frames. We demonstrate the concept in practice through a prototypical mobile UI with application probes, and describe technique designs specifically-tailored to the application UI. A qualitative evaluation highlights the system’s interaction benefits and drawbacks, e.g., that common 2D scroll and selection tasks are simple to operate, but higher degrees of freedom may be reserved for two hands. Our work contributes interaction techniques and design insights to expand AR’s uni-manual capabilities.
14 November 2019 in ACM Transactions on Computer-Human Interaction
Most systems that we use in everyday life are shared—because multiple people can interact or because an interaction by one person can affect other people. However, everyday Internet of Things systems are often designed for individual use. Prior research on collaboration technologies (Computer Supported Collaborative Work) has shown that to coordinate system sharing people require awareness of the social context, which interfaces can support by making salient information visible. Although literature exists on how to design for awareness, this can be fragmented and difficult to relate to other application domains. To introduce a broader audience of interaction designers to awareness, we aim to make the available design knowledge more generalizable and operational. With this aim, we construct the Designing for Awareness in Shared Systems framework that gives a structured and comprehensive overview of design considerations for awareness. The framework can stimulate reflection and inform decision-making when designing interactions with shared systems.
This paper presents a case study exploring the use of speculative artefacts framed within the Fictional Inquiry co-design technique. The case is derived from a project investigating current practices and potential future strategies to improve patients’ hand hygiene standards at the Department of Oncology of Aarhus University Hospital. This paper explores how five speculative artefacts were designed and used to inquire into participants’ experiences of their hand hygiene, both concerning current practice and future ideas. Our study demonstrates how the speculative artefacts used in Fictional Inquiry supported participant’s immersion and engagement in co-design sessions and how the artefacts were used to maintain momentum throughout the session.
This pictorial review illustrates an array of visual strategies employed in 271 pictorials published in DIS, C&C, and TEI conferences between 2014 and 2023. Based on a thematic analysis the pictorial review presents the visual strategies under seven analytical themes: 1) composition, 2) typography, 3) colour, 4) drawing attention, 5) visual style, 6) active engagement, and 7) visual related work. The review focuses on strategies for communicating research visually, rather than the content and contribution of the reviewed pictorials. The review outlines both basic graphical principles, as well as novel use of visual elements. The pictorial is the first attempt at a visual analysis of the pictorial format, offering authors of future pictorials, both an overview of the development of the format, as well as inspiration for new ways to complement text with visual content. Lastly, the challenges and future potentials which emerged from the review are discussed.