Hyperscanning is a technique which simultaneously records the neural activity of two or more people. This is done using one of several neuroimaging methods, such as electroencephalography (EEG), functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The use of hyperscanning has seen a dramatic rise in recent years to monitor social interactions between two or more people. Similarly, there has been an increase in the use of virtual reality (VR) for collaboration, and an increase in the frequency of social interactions being carried out in virtual environments (VE). In light of this, it is important to understand how interactions function within VEs, and how they can be enhanced to improve their quality in a VE. In this paper, we present some of the work that has been undertaken in the field of social neuroscience, with a special emphasis on hyperscanning. We also cover the literature detailing the work that has been carried out in the human–computer interaction domain that addresses remote collaboration. Finally, we present a way forward where these two research domains can be combined to explore how monitoring the neural activity of a group of participants in VE could enhance collaboration among them.
8 September 2016 in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Visual search performance was studied using auditory cues delivered over a bone conduction headset. Two types of auditory cues were employed to evaluate the effectiveness of such cues in an attention redirection task. Participants were required to locate and shoot targets at one of four locations on a screen when one of the two audio cues was delivered. Reaction and target acquisition times were significantly reduced when the binaurally spatialised cues were used compared to unlocalisable, monophonic cues. This appears to suggest that an auditory cue with directional information is far superior at aiding search tasks or alerting the user to redirect attention in the real-world space in comparison to a centered ‘monophonic’ cue. The results demonstrate the effectiveness of a binaurally spatialised, dynamic cue and point to its potential use in an information rich environment to provide useful and actionable information.
1 May 2024 in Journal of the Royal Society of New Zealand
Tinnitus spatial localisation is an essential attribute of tinnitus perception and how it is separated from other ongoing neural activity. A scoping review was undertaken to determine how tinnitus localisation is reported, the role of the perceived spatial location of tinnitus on neurophysiology and if sound presented spatially can change tinnitus perception. Following reading of the full‐text articles and including articles from reference lists, 46 articles were included for review. Six themes emerged from the results. 1. Where tinnitus was localised. 2. The effects of tinnitus on localisation. 3. The mechanisms underpinning tinnitus spatial location. 4. Masking. 5. Auditory training. 6. Multisensory training and virtual reality (VR). Tinnitus is much more complex than the often‐used description of ‘ringing in the ears’. Tinnitus can be heard anywhere in and around the head. Spatial sound presentation and perceptual training approaches may disrupt spatial selective attention to tinnitus and appear as changes in some of the neural networks involved in sound localisation. Where tinnitus is heard is a critical aspect of its perception, but its report, even in studies purporting to study localisation, is too general. A matrix for standardised minimum reporting of tinnitus location is recommended.
Navigation with passive haptic feedback can enhance users’ immersion in virtual environments. We propose a constrained path redirection method to provide users with corresponding haptic feedback at the right time and place. We have quantified the VR exploration practicality in a study and the results show advantages over steer-to-center method in terms of presence, and over Steinicke’s method in terms of matching errors and presence.