The perception of body-ownership creates a sense of embodiment, which can be a powerful learning tool. Embodied learning can occur by watching an individual's body movement and also via human-computer interactions such as virtual reality (VR) and augmented reality (AR). In this study, we designed and implemented a novel virtual body-ownership AR/VR tool for human anatomy—the human muscular arm avatar (HMAA). HMAA utilizes embodiment-based body-ownership to explore the human hand/forearm musculature. The HMAA was trialed with medical students to explore the extent to which it could be used to aid student learning. Key findings of the usability study suggest that 98% (n=100) of students found the tool extremely useful; 83% reported that the tool allowed them to engage with the learning materials, peers and content effectively. Also, 10% of students mentioned that the HMAA fostered an embodied learning experience. This triggered an intentional exploration of instances suggesting embodiment in the data. HMAA is believed to have allowed individuals to visualize and conceptualize abstract ideas that would have been otherwise challenging using static models. The outcomes of the study indicate the significant potential of body-ownership based self-learning tools for anatomy. However, further studies using learning outcomes are needed to investigate the potential advantages of body-ownership based tools compared to current learning techniques.
Parkinson’s disease affects millions worldwide with a large rise in expected burden over the coming decades. More easily accessible tools and techniques to diagnose and monitor Parkinson’s disease can improve the quality of life of patients. With the advent of new wearable technologies such as smart rings and watches, this is within reach. However, it is unclear what method for these new technologies may provide the best opportunity to capture the patient-specific severity. This study investigates which locations on the hand can be used to capture and monitor maximal movement/tremor severity. Using a Leap Motion device and custom-made software the volume, velocity, acceleration, and frequency of Parkinson’s (n = 55, all right-handed, majority right-sided onset) patients’ hand locations (25 joints inclusive of all fingers/thumb and the wrist) were captured simultaneously. Distal locations of the right hand, i.e., the ends of fingers and the wrist showed significant trends (p < 0.05) towards having the largest movement velocities and accelerations. The right hand, compared with the left hand, showed significantly greater volumes, velocities, and accelerations (p < 0.01). Supplementary analysis showed that the volumes, acceleration, and velocities had significant correlations (p < 0.001) with clinical MDS-UPDRS scores, indicating the potential suitability of using these metrics for monitoring disease progression. Maximal movements at the distal hand and wrist area indicate that these locations are best suited to capture hand tremor movements and monitor Parkinson’s disease.
Pupillary alterations in virtual humans induce neurophysiological responses within an observer. Technological advances have enabled rapid developments in artificial intelligence (AI), from verbal systems, to visual AI interfaces with the ability to express, and respond to emotional states of a user. Visual AI interfaces are able to change their physical parameters, such as pupil diameter. Pupillary changes can alter heart rate, however, effects on heart rate variability (HRV) are unknown. HRV, is an autonomic, non-conscious parameter which monitors sympathetic and parasympathetic nervous system (PNS) activity. N = 34 male participants aged between 19–33 were subjected to a number of conditions such as pupil dilation, constriction and blushing. The present research is the first to investigate the effects of virtual human interactions on human HRV. Outcomes of this study were obtained using eye tracking and HRV measurements. Pupil dilation relative to constriction presented in the female virtual partner induced a significant right pupillary diameter increase (p = 0.041) in human observers. Additionally, female virtual partner pupil constriction relative to dilation induced a significant increase in participants’ PNS HRV response (p = 0.036). These findings indicate the ability of a female virtual interaction partner to modulate parasympathetic autonomic functioning in young healthy male humans. This allows first insights into the effects of interacting with virtual AI interaction partners, on human autonomic functioning, and may aid development of future virtual humans, and their implementation into relevant clinical settings.
The Unified Parkinson’s Disease Rating Scale (UPDRS) is a subjective Parkinson’s Disease (PD) physician scoring/monitoring system. To date, there is no single upper limb wearable/non-contact system that can be used objectively to assess all UPDRS-III motor system subgroups (i.e., tremor (T), rigidity (R), bradykinesia (B), gait and posture (GP), and bulbar anomalies (BA)). We evaluated the use of a non-contact hand motion tracking system for potential extraction of GP information using forearm pronation–supination (P/S) motion parameters (speed, acceleration, and frequency). Twenty-four patients with idiopathic PD participated, and their UPDRS data were recorded bilaterally by physicians. Pearson’s correlation, regression analyses, and Monte Carlo validation was conducted for all combinations of UPDRS subgroups versus motion parameters. In the 262,125 regression models that were trained and tested, the models within 1% of the lowest error showed that the frequency of P/S contributes to approximately one third of all models; while speed and acceleration also contribute significantly to the prediction of GP from the left-hand motion of right handed patients. In short, the P/S better indicated GP when performed with the non-dominant hand. There was also a significant negative correlation (with medium to large effect size, range: 0.3–0.58) between the P/S speed and the single BA score for both forearms and combined UPDRS score for the dominant hand. This study highlights the potential use of wearable or non-contact systems for forearm P/S to remotely monitor and predict the GP information in PD.
(1) Background: Acute acoustic (sound) stimulus prompts a state of defensive motivation in which unconscious muscle responses are markedly enhanced in humans. The orbicularis oculi (OO) of the eye is an easily accessed muscle common for acoustic startle reaction/response/reflex (ASR) investigations and is the muscle of interest in this study. Although the ASR can provide insights about numerous clinical conditions, existing methodologies (Electromyogram, EMG) limit the usability of the method in real clinical conditions. (2) Objective: With EMG-free muscle recording in mind, our primary aim was to identify and investigate potential correlations in the responses of individual and cooperative OO muscles to various acoustic stimuli using a mobile and wire-free system. Our secondary aim was to investigate potential altered responses to high and also relatively low intensity acoustics at different frequencies in both sitting and standing positions through the use of biaural sound induction and video diagnostic techniques and software. (3) Methods: This study used a mobile-phone acoustic startle response monitoring system application to collect blink amplitude and velocity data on healthy males, aged 18–28 community cohorts during (n = 30) in both sitting and standing postures. The iPhone X application delivers specific sound parameters and detects blinking responses to acoustic stimulus (in millisecond resolution) to study the responses of the blinking reflex to acoustic sounds in standing and sitting positions by using multiple acoustic test sets of different frequencies and amplitudes introduced as acute sound stimuli (<0.5 s). The single acoustic battery of 15 pure-square wave sounds consisted of frequencies and amplitudes between 500, 1000, 2000, 3000, and 4000 Hz scales using 65, 90, and 105 dB (e.g., 3000 Hz_90 dB). (4) Results: Results show that there was a synchronization of amplitude and velocity between both eyes to all acoustic startles. Significant differences (p = 0.01) in blinking reaction time between sitting vs. standing at the high intensity (105 dB) 500 Hz acoustic test set was discovered. Interestingly, a highly significant difference (p < 0.001) in response times between test sets 500 Hz_105 dB and 4000 Hz_105 dB was identified. (5) Conclusions: To our knowledge, this is the first mobile phone-based acoustic battery used to detect and report significant ASR responses to specific frequencies and amplitudes of sound stimulus with corresponding sitting and standing conditions. The results from this experiment indicate the potential significance of using the specific frequency, amplitude, and postural conditions (as never before identified) which can open new horizons for ASR to be used for diagnosis and monitoring in numerous clinical and remote or isolated conditions.
Objective. Early diagnosis of heart problems is essential for improving patient prognosis. Approach. We created a non-contact imaging system that calculates the vessel-induced deformation of the skin to estimate the carotid artery pressure displacement waveforms. We present a clinical study of the system in patients (n = 27) with no underlying condition, aortic stenosis (AS), or mitral regurgitation (MR). Main results. Displacement waveforms were compared to aortic catheter pressures in the same patients. The morphologies of the pressure and displacement waveforms were found to be similar, and pulse wave analysis metrics, such as our modified reflection indices (RI) and waveform duration proportions, showed no significant differences. Compared with the control group, AS patients displayed a greater proportion of time to peak (p = 0.026 and p = 0.047 for catheter and displacement, respectively), whereas augmentation index (AIx) was greater for the displacement waveform only (p = 0.030). The modified RI for MR (p = 0.047 and p = 0.004 for catheter and displacement, respectively) was lower than in the controls. AS and MR were also significantly different for the proportion of time to peak (p = 0.018 for the catheter measurements), RI (p = 0.045 and p = 0.002 for the catheter and displacement, respectively), and AIx (p = 0.005 for the displacement waveform). Significance. These findings demonstrate the ability of our system to provide insights into cardiac conditions and support further development as a diagnostic/telehealth-based screening tool.