14 December 2023 in Nature Biomedical Engineering
11 August 2020 in IEEE Transactions on Intelligent Transportation Systems
Trust in autonomous vehicles (AV) is of critical importance and demands comprehensive interdisciplinary research. While most studies utilize subjective measures, we employ electroencephalography (EEG) to study in a more objective manner the cognitive states associated with trust during AV driving. Subjects drove a simulated AV in Conditional Automation Driving (SAE L3) and Full Automation Driving (SAE L5) modes. In the experimental design, malfunctions were induced at both automation levels. Self-reported trust in the AV was reduced immediately after Full Automation malfunctions, but not after Conditional Automation malfunctions when subjects were able to take over vehicle control to avoid danger. EEG analyses reveal that during Full Automation malfunctions, there was a significant enhancement in approach motivation (i.e. desire to re-engage) and a disruption of right frontal functional clustering that supports executive cognition (i.e. planning and decision-making). No neurocognitive disruptions were observed during Conditional Automation malfunctions. Our results demonstrate that it is not automation malfunctions per se (e.g. failure to decelerate) that deteriorate trust, but rather the inability for human drivers to adaptively mitigate the risk of negative outcomes (e.g. risk of crashing) resulting from those malfunctions. This is reflected in changes in brain activity associated with motivational state and action planning. Keeping the human driver on-the-loop protects against trust loss. Frontal alpha EEG is a neural correlate of trust-in-automation, with potential for trust monitoring using wearable technology to support driver-vehicle adaptivity.
17 December 2019 in IEEE Sensors Letters
This letter presents a novel technique for classification of motor imagery EEG signals employing multiplex weighted visibility graph algorithm. Weighted visibility graph is an effective tool to map a univariate time series into a graphical representation while preserving its temporal characteristics. In this contribution, the concept of weighted visibility graph of univariate time series is extended to analyze multivariate EEG time series known as multiplex weighted visibility graph algorithm. From the graphical representation of the transformed EEG time series, a new method for construction of complex functional brain connectivity network using clustering coefficient was proposed based on mutual correlation between different electrodes. An auto encoder based deep feature extraction technique was employed to extract meaningful features from the images of brain connectivity matrix and classification of different MI tasks was performed using different benchmark classifiers. In this contribution, cross-subject classification is performed to address the problem of lack of generalized features from EEG signals across different subjects. It was observed that an average classification accuracy of 99.92% and 99.96% is obtained using Random Forest classifier. Experimental investigations on two publicly available databases revealed that the proposed model can be implemented to develop a robust and effective brain computer interface system.
1 April 2019 in IET Signal Processing
Here, a technique for automated detection of epilepsy is proposed, based on a novel set of features derived from the multifractal spectrum of electroencephalogram (EEG) signals. In fractal geometry, multifractal detrended fluctuation analysis (MDFA) is a technique to examine the self‐similarity of a non‐linear, chaotic and noisy time series. EEG signals which are representatives of complex human brain dynamics can be effectively characterised by MDFA. Here, EEG signals representing healthy, interictal and seizure activities are acquired from an available dataset. The acquired signals are at first analysed using MDFA. Based on the multifractal analysis, 14 novel features are proposed in this study, to distinguish between different types of EEG signals. The statistical significance of the selected features is evaluated using Kruskal–Wallis test and is finally served as input feature vector to a support vector machines classifier for the classification of EEG signals. Four classification problems are presented in this work and it is observed that 100% classification accuracy is obtained for three problems which validate the efficacy of the proposed model for computer‐aided diagnosis of epilepsy.
1 October 2020 in Journal of Neural Engineering
Objective. A major challenge for controlling a prosthetic arm is communication between the device and the user’s phantom limb. We show the ability to enhance phantom limb perception and improve movement decoding through targeted transcutaneous electrical nerve stimulation in individuals with an arm amputation. Approach. Transcutaneous nerve stimulation experiments were performed with four participants with arm amputation to map phantom limb perception. We measured myoelectric signals during phantom hand movements before and after participants received sensory stimulation. Using electroencephalogram (EEG) monitoring, we measured the neural activity in sensorimotor regions during phantom movements and stimulation. In one participant, we also tracked sensory mapping over 2 years and movement decoding performance over 1 year. Main results. Results show improvements in the participants’ ability to perceive and move the phantom hand as a result of sensory stimulation, which leads to improved movement decoding. In the extended study with one participant, we found that sensory mapping remains stable over 2 years. Sensory stimulation improves within-day movement decoding while performance remains stable over 1 year. From the EEG, we observed cortical correlates of sensorimotor integration and increased motor-related neural activity as a result of enhanced phantom limb perception. Significance. This work demonstrates that phantom limb perception influences prosthesis control and can benefit from targeted nerve stimulation. These findings have implications for improving prosthesis usability and function due to a heightened sense of the phantom hand.
28 May 2020 in Journal of Neural Engineering
Objective. Recent development of sensory stimulation techniques demonstrates the ability to elicit touch-like phantom sensations in upper limb amputees. The cortical processing of this phantom sensation and the corresponding influences on sensorimotor functional connectivity have not been studied. We hypothesize that sensory stimulation has a profound impact on the sensorimotor cortical functional interactions, which will be uncovered by dynamic functional connectivity (dFC) analysis of amputees’ electroencephalogram (EEG) recordings. Approach. We investigated dFC between cortical areas associated with somatosensory, motor, visual, and multisensory processing functions using EEG signals. We applied dFC to the EEG of two amputees performing hand movements with and without sensory stimulation and compared the results with those from three able-bodied subjects. We quantified the changes due to sensory stimulation using dFC metrics, namely temporal distance, number of connection paths, temporal global and local efficiencies, and clustering coefficient. Main results. We show a significant effect of sensory stimulation on functional connectivity in the amputee brains, with notable facilitation on multisensory processing among the cortical systems involved in sensorimotor processing. The dFC metrics reveal that sensory stimulation enhances the speed of information transfer (shown by decreases in temporal distance) and the number of connection paths between the brain systems involved in sensorimotor processing, including primary somatosensory and motor, and higher order processing regions. Significance. This is the first work to reveal dynamic communication between somatosensory, motor, and higher order processing regions in the cortex of amputees in response to sensory stimulation. We believe that our work provides crucial insights into the cortical impact of sensory stimulation in amputees, which may lead to the design of personalized brain-informed sensory feedback paradigms. This in turn may lead to building novel Machine to Brain Interfaces involving sensory feedback and the resultant enhanced motor performance.