This work compares four mid-air target selection methods (Push, Tap, Dwell, Pinch) with two types of ultrasonic haptic feedback (Select, HoverSelect) in a Fitts’ law experiment. Results revealed that Tap is the fastest, the most accurate, and one of the least physically and cognitively demanding selection methods. Pinch is relatively fast but error prone and physically and cognitively demanding. Dwell is slowest by design, yet the most accurate and the least physically and cognitively demanding. Both haptic feedback methods improve selection performance by increasing users’ spatial awareness. Particularly, Push augmented with Hover & Select feedback is comparable to Tap. Besides, participants perceive the selection methods as faster, more accurate, and more physically and cognitively comfortable with the haptic feedback methods.
Free-hand mid-air Qwerty enables entering text in virtual reality without the use of controllers. However, it is much slower and more error prone than its physical counterpart, primarily due to the absence of haptic feedback and reduced spatial awareness. In this paper, we design three different ultrasonic haptic feedback for mid-air Qwerty: feedback only on keypress, on both touch and keypress, and gradual feedback that increases intensity as users push down a key. In a pilot study, the touch & press feedback performed significantly better both quantitatively and qualitatively. We then compare a mid-air Qwerty with and without touch & press feedback in a user study. Results revealed that haptic feedback improves entry speed by 16% and reduces error rate by 26%. Besides, most participants feel that it improves presence and spatial awareness in the virtual-world by maintaining a higher consistency with the real-world, and significantly reduces mental demand, effort, and frustration.
This article presents the Digital Thimble, an index-finger-wearable device designed for free-hand interactions in virtual reality (VR) by varying the touch contact force on a surface. It contains an optical mouse sensor for tracking and a pressure sensor for detecting contact force. A Fitts’ law study compared the Digital Thimble with a commercial finger mouse and a VR controller using both on-press and on-release selection methods. The results showed that the finger mouse provided higher throughput (3.11 bps) and faster speed (1258 ms) compared to the VR controller (2.89 bps; 1327 ms) and the Digital Thimble (2.61 bps; 1487 ms). Further evaluation in sorting and teleportation tasks demonstrated that the Digital Thimble delivered better accuracy and precision. Participants favored the Digital Thimble for its comfort and convenience, highlighting its potential as a user-friendly VR input device.