Trust in autonomous vehicles (AV) is of critical importance and demands comprehensive interdisciplinary research. While most studies utilize subjective measures, we employ electroencephalography (EEG) to study in a more objective manner the cognitive states associated with trust during AV driving. Subjects drove a simulated AV in Conditional Automation Driving (SAE L3) and Full Automation Driving (SAE L5) modes. In the experimental design, malfunctions were induced at both automation levels. Self-reported trust in the AV was reduced immediately after Full Automation malfunctions, but not after Conditional Automation malfunctions when subjects were able to take over vehicle control to avoid danger. EEG analyses reveal that during Full Automation malfunctions, there was a significant enhancement in approach motivation (i.e. desire to re-engage) and a disruption of right frontal functional clustering that supports executive cognition (i.e. planning and decision-making). No neurocognitive disruptions were observed during Conditional Automation malfunctions. Our results demonstrate that it is not automation malfunctions per se (e.g. failure to decelerate) that deteriorate trust, but rather the inability for human drivers to adaptively mitigate the risk of negative outcomes (e.g. risk of crashing) resulting from those malfunctions. This is reflected in changes in brain activity associated with motivational state and action planning. Keeping the human driver on-the-loop protects against trust loss. Frontal alpha EEG is a neural correlate of trust-in-automation, with potential for trust monitoring using wearable technology to support driver-vehicle adaptivity.
10 July 2014 in IEEE Journal of Biomedical and Health Informatics
Intelligently extracting knowledge from social media has recently attracted great interest from the Biomedical and Health Informatics community to simultaneously improve healthcare outcomes and reduce costs using consumer-generated opinion. We propose a two-step analysis framework that focuses on positive and negative sentiment, as well as the side effects of treatment, in users' forum posts, and identifies user communities (modules) and influential users for the purpose of ascertaining user opinion of cancer treatment. We used a self-organizing map to analyze word frequency data derived from users' forum posts. We then introduced a novel network-based approach for modeling users' forum interactions and employed a network partitioning method based on optimizing a stability quality measure. This allowed us to determine consumer opinion and identify influential users within the retrieved modules using information derived from both word-frequency data and network-based properties. Our approach can expand research into intelligently mining social media data for consumer opinion of various treatments to provide rapid, up-to-date information for the pharmaceutical industry, hospitals, and medical staff, on the effectiveness (or ineffectiveness) of future treatments.
Fronto‐parietal subnetworks were revealed to compensate for cognitive decline due to mental fatigue by community structure analysis. Here, we investigate changes in topology of subnetworks of resting‐state fMRI networks due to mental fatigue induced by prolonged performance of a cognitively demanding task, and their associations with cognitive decline. As it is well established that brain networks have modular organization, community structure analyses can provide valuable information about mesoscale network organization and serve as a bridge between standard fMRI approaches and brain connectomics that quantify the topology of whole brain networks. We developed inter‐ and intramodule network metrics to quantify topological characteristics of subnetworks, based on our hypothesis that mental fatigue would impact on functional relationships of subnetworks. Functional networks were constructed with wavelet correlation and a data‐driven thresholding scheme based on orthogonal minimum spanning trees, which allowed detection of communities with weak connections. A change from pre‐ to posttask runs was found for the intermodule density between the frontal and the temporal subnetworks. Seven inter‐ or intramodule network metrics, mostly at the frontal or the parietal subnetworks, showed significant predictive power of individual cognitive decline, while the network metrics for the whole network were less effective in the predictions. Our results suggest that the control‐type fronto‐parietal networks have a flexible topological architecture to compensate for declining cognitive ability due to mental fatigue. This community structure analysis provides valuable insight into connectivity dynamics under different cognitive states including mental fatigue.
Objective. Recent development of sensory stimulation techniques demonstrates the ability to elicit touch-like phantom sensations in upper limb amputees. The cortical processing of this phantom sensation and the corresponding influences on sensorimotor functional connectivity have not been studied. We hypothesize that sensory stimulation has a profound impact on the sensorimotor cortical functional interactions, which will be uncovered by dynamic functional connectivity (dFC) analysis of amputees’ electroencephalogram (EEG) recordings. Approach. We investigated dFC between cortical areas associated with somatosensory, motor, visual, and multisensory processing functions using EEG signals. We applied dFC to the EEG of two amputees performing hand movements with and without sensory stimulation and compared the results with those from three able-bodied subjects. We quantified the changes due to sensory stimulation using dFC metrics, namely temporal distance, number of connection paths, temporal global and local efficiencies, and clustering coefficient. Main results. We show a significant effect of sensory stimulation on functional connectivity in the amputee brains, with notable facilitation on multisensory processing among the cortical systems involved in sensorimotor processing. The dFC metrics reveal that sensory stimulation enhances the speed of information transfer (shown by decreases in temporal distance) and the number of connection paths between the brain systems involved in sensorimotor processing, including primary somatosensory and motor, and higher order processing regions. Significance. This is the first work to reveal dynamic communication between somatosensory, motor, and higher order processing regions in the cortex of amputees in response to sensory stimulation. We believe that our work provides crucial insights into the cortical impact of sensory stimulation in amputees, which may lead to the design of personalized brain-informed sensory feedback paradigms. This in turn may lead to building novel Machine to Brain Interfaces involving sensory feedback and the resultant enhanced motor performance.