Scholars who study nonverbal behavior have focused an incredible amount of work on proxemics, how close people stand to one another, and mutual gaze, whether or not they are looking at one another. Moreover, many studies have demonstrated a correlation between gaze and distance, and so-called equilibrium theory posits that people modulate gaze and distance to maintain proper levels of nonverbal intimacy. Virtual reality scholars have also focused on these two constructs, both for theoretical reasons, as distance and gaze are often used as proxies for psychological constructs such as social presence, and for methodological reasons, as head orientation and body position are automatically produced by most VR tracking systems. However, to date, the studies of distance and gaze in VR have largely been conducted in laboratory settings, observing behavior of a small number of participants for short periods of time. In this experimental field study, we analyze the proxemics and gaze of 232 participants over two experimental studies who each contributed up to about 240 minutes of tracking data during eight weekly 30-minute social virtual reality sessions. Participants' non-verbal behaviors changed in conjunction with context manipulations and over time. Interpersonal distance increased with the size of the virtual room; and both mutual gaze and interpersonal distance increased over time. Overall, participants oriented their heads toward the center of walls rather than to corners of rectangularly-aligned environments. Finally, statistical models demonstrated that individual differences matter, with pairs and groups maintaining more consistent differences over time than would be predicted by chance. Implications for theory and practice are discussed.
1 November 2023 in Cyberpsychology, Behavior, and Social Networking
Social virtual reality (VR) is an emerging set of platforms where users interact while embodying avatars. Given that VR headsets track real physical movements and map them onto one's avatar body, the nature of one's digital representation is an important aspect of social VR. However, little is known about how the visual proximity of an avatar to the self shapes user experience in naturalistic, social VR environments. In this article, we use this context to explore how embodiment is influenced by the perceived differences between the physical attributes of a user and the virtual attributes of their avatar. We selected a number of attributes for this measure that have been shown to be important for customization and representation in VR. Participants created an avatar, spent time in social VR, and reported on their experience in a questionnaire. Our results demonstrate a significant negative association between attribute discrepancy and avatar embodiment, the psychological experience of one's virtual body as their own body. We discuss implications for theories of self-representation and suggest urgency on the part of games and VR designers to improve the methods of creating avatars.
In networked virtual reality (VR), user behaviors, individual differences, and group dynamics can serve as important signals for future speech behaviors, such as who the next speaker will be and the timing of turn-taking behaviors. The ability to predict and understand these behaviors offers opportunities to provide adaptive and personalized assistance, for example helping users with varying sensory abilities navigate complex social scenes and instantiating virtual moderators with natural behaviors. In this work, we predict turn-taking behaviors using features extracted based on social dynamics literature. We discuss results from a large-scale VR classroom dataset consisting of 77 sessions and 1660 minutes of small-group social interactions collected over four weeks. In our evaluation, gradient boosting classifiers achieved the best performance, with accuracies of 0.71-0.78 AUC (area under the ROC curve) across three tasks concerning the ''what'', ''who'', and ''when'' of turn-taking behaviors. In interpreting these models, we found that group size, listener personality, speech-related behavior (e.g., time elapsed since the listener's last speech event), group visual attention (e.g., the group's head orientation towards the speaker), and the listener and previous speaker's head pitch, head y-axis position, and left hand y-axis position more saliently influenced predictions. Results suggested that these features remain reliable indicators in novel social VR settings, as prediction performance is robust over time and with groups and activities not used in the training dataset. We discuss theoretical and practical implications of the work.
The advent of widely-accessible VR has enabled individuals to communicate—and miscommunicate—in new ways. To explore these miscommunications, we introduce a preliminary framework based on events that occurred during 3600 minutes of observation inside a university course taught in VR. During the course, 250 people met in groups for about 20 minutes per session. We identify three types of miscommunication that routinely occurred: body crumple, sound intrusion, and embodiment violation. By mapping the affordances by which social VR fails to facilitate effective communication, we hope to provide educators, developers, and virtual ethnographers with a means for understanding and navigating the challenges of VR-based collaboration.