Human balance is a complex process in healthy adults, requiring precisely timed coordination among sensory information, cognitive processing, and motor control. It has been difficult to quantify brain dynamics during human balance control due to limitations in brain-imaging modalities. The goal of this study was to determine whether by using high-density electroencephalography (EEG) and independent component analysis, we can identify common cortical responses to visual and physical balance perturbations during walking and standing. We studied the responses of 30 healthy young adults to sensorimotor perturbations that challenged their balance. Subjects performed four 10 min trials of beam walking and tandem stance while either being mediolaterally pulled at the waist or viewing brief 20° field-of-view rotations in virtual reality. We recorded high-density EEG, motion capture, lower leg electromyography (EMG), and neck EMG. We hypothesized that both physical pull and visual rotation perturbations would elicit time–frequency fluctuations in theta (4–8 Hz) and beta (13–30 Hz) bands, with increased occipito-parietal activity during visual rotations compared with pull perturbations. Our results confirmed this hypothesis. For both perturbations, we found early theta synchronization and late alpha–beta (8–30 Hz) desynchronization following perturbation onset. This pattern was strongest in occipito-parietal areas during visual perturbations and strongest in sensorimotor areas during pull perturbations. These results suggest a similar time–frequency electrocortical pattern when humans respond to sensorimotor conflict, but with substantive differences in the brain areas involved for visual versus physical perturbations. Our findings may have important implications for assessing and training balance in individuals with and without motor disabilities.
Virtual reality has been increasingly used in research on balance rehabilitation because it provides robust and novel sensory experiences in controlled environments. We studied 19 healthy young subjects performing a balance beam walking task in two virtual reality conditions and with unaltered view (15 minutes each) to determine if virtual reality high heights exposure induced stress. We recorded number of steps off the beam, heart rate, electrodermal activity, response time to an auditory cue, and high-density electroencephalography (EEG). We hypothesized that virtual high heights exposure would increase measures of physiological stress compared to unaltered viewing at low heights. We found that the virtual high height condition increased heart rate variability and heart rate frequency power relative to virtual low heights. Virtual reality use resulted in increased number of step-offs, heart rate, electrodermal activity, and response time compared to the unaltered viewing at low heights condition. Our results indicated that virtual reality decreased dynamic balance performance and increased physical and cognitive loading compared to unaltered viewing at low heights. In virtual reality, we found significant decreases in source-localized EEG peak amplitude relative to unaltered viewing in the anterior cingulate, which is considered important in sensing loss of balance. Our findings indicate that virtual reality provides realistic experiences that can induce physiological stress in humans during dynamic balance tasks, but virtual reality use impairs physical and cognitive performance during balance.
Maintaining balance is a complex process requiring multisensory processing and coordinated muscle activation. Previous studies have indicated that the cortex is directly involved in balance control, but less information is known about cortical flow of signals for balance. We studied source-localized electrocortical effective connectivity dynamics of healthy young subjects (29 subjects: 14 male and 15 female) walking and standing with both visual and physical perturbations to their balance. The goal of this study was to quantify differences in group-level corticomuscular connectivity responses to sensorimotor perturbations during walking and standing. We hypothesized that perturbed visual input during balance would transiently decrease connectivity between occipital and parietal areas due to disruptive visual input during sensory processing. We also hypothesized that physical pull perturbations would increase cortical connections to central sensorimotor areas because of higher sensorimotor integration demands. Our findings show decreased occipito-parietal connectivity during visual rotations and widespread increases in connectivity during pull perturbations focused on central areas, as expected. We also found evidence for communication from cortex to muscles during perturbed balance. These results show that sensorimotor perturbations to balance alter cortical networks and can be quantified using effective connectivity estimation.
Objective. Advances in neural decoding have enabled brain-computer interfaces to perform increasingly complex and clinically-relevant tasks. However, such decoders are often tailored to specific participants, days, and recording sites, limiting their practical long-term usage. Therefore, a fundamental challenge is to develop neural decoders that can robustly train on pooled, multi-participant data and generalize to new participants. Approach. We introduce a new decoder, HTNet, which uses a convolutional neural network with two innovations: (a) a Hilbert transform that computes spectral power at data-driven frequencies and (b) a layer that projects electrode-level data onto predefined brain regions. The projection layer critically enables applications with intracranial electrocorticography (ECoG), where electrode locations are not standardized and vary widely across participants. We trained HTNet to decode arm movements using pooled ECoG data from 11 of 12 participants and tested performance on unseen ECoG or electroencephalography (EEG) participants; these pretrained models were also subsequently fine-tuned to each test participant. Main results. HTNet outperformed state-of-the-art decoders when tested on unseen participants, even when a different recording modality was used. By fine-tuning these generalized HTNet decoders, we achieved performance approaching the best tailored decoders with as few as 50 ECoG or 20 EEG events. We were also able to interpret HTNet’s trained weights and demonstrate its ability to extract physiologically-relevant features. Significance. By generalizing to new participants and recording modalities, robustly handling variations in electrode placement, and allowing participant-specific fine-tuning with minimal data, HTNet is applicable across a broader range of neural decoding applications compared to current state-of-the-art decoders.
Immersive virtual reality can expose humans to novel training and sensory environments, but motor training with virtual reality has not been able to improve motor performance as much as motor training in real-world conditions. An advantage of immersive virtual reality that has not been fully leveraged is that it can introduce transient visual perturbations on top of the visual environment being displayed. The goal of this study was to determine whether transient visual perturbations introduced in immersive virtual reality modify electrocortical activity and behavioral outcomes in human subjects practicing a novel balancing task during walking. We studied three groups of healthy young adults (5 male and 5 female for each) while they learned a balance beam walking task for 30 min under different conditions. Two groups trained while wearing a virtual reality headset, and one of those groups also had half-second visual rotation perturbations lasting ~10% of the training time. The third group trained without virtual reality. We recorded high-density electroencephalography (EEG) and movement kinematics. We hypothesized that virtual reality training with perturbations would increase electrocortical activity and improve balance performance compared with virtual reality training without perturbations. Our results confirmed the hypothesis. Brief visual perturbations induced increased theta spectral power and decreased alpha spectral power in parietal and occipital regions and improved balance performance in posttesting. Our findings indicate that transient visual perturbations during immersive virtual reality training can boost short-term motor learning by inducing a cognitive change, minimizing the negative effects of virtual reality on motor training. NEW & NOTEWORTHY We found that transient visual perturbations in virtual reality during balance training can boost short-term motor learning by inducing a cognitive change, overcoming the negative effects of immersive virtual reality. As a result, subjects training in immersive virtual reality with visual perturbations have equivalent performance improvement as training in real-world conditions. Visual perturbations elicited cortical responses in occipital and parietal regions and may have improved the brain’s ability to adapt to variations in sensory input.