In motion-sensing interaction with large displays through bare hands, we can observe that users alternate their hands and move their bodies frequently. What cause such actions and how these actions affect free hand interaction results are less systematically investigated. To address this gap in knowledge, we conducted studies on Pointer-Acceleration (PA)-based free hand interactions of target selection and found that (1) users made more frequent hand alternations when selecting small targets with large movement amplitudes, as in such cases users were not only affected by observable arm fatigue, but were also motivated to switch hands for higher selection accuracy and convenience; (2) hand alternation led to the hand orientation effects: target selection on display areas at the operating hand’s side was more efficient and accurate than that at the opposite side; (3) large movement amplitudes on the user interface increased users’ physical movements in front of the large display, which harmed selection efficiency; (4) selection of small targets led to a closer interaction distance, while large movement amplitudes led to a larger interaction distance; and (5) selection results were affected by interaction distances, as users gained high efficiency, but low accuracy at a large distance and low efficiency, but high accuracy at a close distance. Given these results, this article discusses practical implications for applying PA-based free hand interaction techniques and designing related user interfaces on large displays.
Augmented reality museums allow visitors to jointly view and interact with exhibits. However, real-time exhibit browsing does not accommodate latecomers to museums and offers limited support to temporally separated visitors. To stimulate asynchronous exhibit browsing, we developed a distance-driven user interface that divided the augmented reality exhibit-egocentric space into four distance ranges, each having a set of social networking features and different privileges for exhibit viewing and interaction. The user interface enables asynchronous exhibit browsing for visitors participating at different times. We conducted empirical studies to evaluate how the user interface affected visitors' collaborative exhibit browsing in terms of perceived usability and learning gains. The results show that the perceived usability of the user interface is consistently high across all distance ranges. The user interface stimulates collaborative exhibit browsing with significant improvements in learning efficiency and learning attention durations, although learning satisfaction showed no difference across the participants. Implications for how the distance-driven user interface can be generalized for other interactive applications are discussed.
Repetitive tasks widely exist in applied fields of human-computer interaction. One underestimated example is parcel scanning, which has consistent operation difficulty but comprises multiple processes (e.g., label seeking and scanning, result confirming, and parcel relocating), involving respective cognitive requirements. Many devices are developed to facilitate repetitive operations, but few are to reduce fluctuating cognitive load throughout task processes. We present the eye-tracking augmented reality headset that integrates foveated vision detection and smooth pursuit of eye tracking and investigate how it can reduce cognitive load in the repetitive task. In total, 33 participants completed a set of parcel scanning tasks with the headset and their visual and cognitive performance were assessed. The results show that the headset maintained high scanning efficiency and lower cognitive load across the tasks with varying difficulties and it significantly reduced the participants’ cognitive load during the processes of barcode seeking and scanning and result confirmation. The headset demonstrated good usability and ease of use. Implications for how the case study result could be used in generalizing applications are discussed.
Eye tracking is a widely used technique. To enhance eye gaze estimation in different contexts, many eye tracking datasets have been proposed. However, these datasets depend on calibrations in data capture and its applications. We seek to construct a dataset that enables the design of a calibration-free eye tracking device irrespective of users and scenes. To reach this goal, we present ARGaze, a dataset with 1,321,968 pairs of eye gaze images at 32 × 32 pixel resolution and 50 corresponding videos of world views based on a replicable augmented reality headset. The dataset was captured from 25 participants who completed eye gaze tasks for 30 min in both real-world and augmented reality scenes. To validate the dataset, we compared it against state-of-the-art eye gaze datasets in terms of effectiveness and accuracy and report that the ARGaze dataset achieved record low gaze estimation error by 3.70 degrees on average and 1.56 degrees on specific participants without calibrations to the two scenes. Implications for generalising the use of the dataset are discussed.