This paper introduces a new methodology for dynamic learning, visualization, and classification of functional magnetic resonance imaging (fMRI) as spatiotemporal brain data. The method is based on an evolving spatiotemporal data machine of evolving spiking neural networks (SNNs) exemplified by the NeuCube architecture [1]. The method consists of several steps: mapping spatial coordinates of fMRI data into a 3-D SNN cube (SNNc) that represents a brain template; input data transformation into trains of spikes; deep, unsupervised learning in the 3-D SNNc of spatiotemporal patterns from data; supervised learning in an evolving SNN classifier; parameter optimization; and 3-D visualization and model interpretation. Two benchmark case study problems and data are used to illustrate the proposed methodology - fMRI data collected from subjects when reading affirmative or negative sentences and another one - on reading a sentence or seeing a picture. The learned connections in the SNNc represent dynamic spatiotemporal relationships derived from the fMRI data. They can reveal new information about the brain functions under different conditions. The proposed methodology allows for the first time to analyze dynamic functional and structural connectivity of a learned SNN model from fMRI data. This can be used for a better understanding of brain activities and also for online generation of appropriate neurofeedback to subjects for improved brain functions. For example, in this paper, tracing the 3-D SNN model connectivity enabled us for the first time to capture prominent brain functional pathways evoked in language comprehension. We found stronger spatiotemporal interaction between left dorsolateral prefrontal cortex and left temporal while reading a negated sentence. This observation is obviously distinguishable from the patterns generated by either reading affirmative sentences or seeing pictures. The proposed NeuCube-based methodology offers also a superior classification accuracy when compared with traditional AI and statistical methods. The created NeuCube-based models of fMRI data are directly and efficiently implementable on high performance and low energy consumption neuromorphic platforms for real-time applications.
Due to the ever-increasing demand for urbanized life and fast-constructed built environments, the urban quality of life and psychological well-being of the inhabitants is often neglected. This has led to the current built environment that we spend most of our lives in, without adequate investigation into how it impacts the human mental health and wellbeing. This paper aims to review and analyse the research efforts that investigate the impact of the built environment on the user’s state of mind, with a focus on the measured brain activities to indicate the momentary state of mind. The reviewed literature establishes that while in a natural environment the brain activities are more disentangled and meditative. Whilst in a built environment, the human brain has shown higher levels of stress. However, the mechanism in which the built environment impacts the brain is not yet thoroughly investigated. In this paper we have identified the current gaps to help shape the future towards a restorative built environment with knowledge about the human mind to maximize user benefits and well-being. In conclusion, there was only one design element, using curvatures in interior design, that was identified as more encouraging for higher engaging brain activity that reflect the attraction of brain to the surroundings. However, in the current neuro-architecture related research, there are still various areas, highlighted in this paper, that require further intensive research into different scales; interior, building and, urban design, in order to guide future regulations towards healthier built environment.
Familiarity of marketing stimuli may affect consumer behaviour at a peri-perceptual processing level. The current study introduces a method for deep learning of electroencephalogram (EEG) data using a spiking neural network (SNN) approach that reveals the complexity of peri-perceptual processes of familiarity. The method is applied to data from 20 participants viewing familiar and unfamiliar logos. The results support the potential of SNN models as novel tools in the exploration of peri-perceptual mechanisms that respond differentially to familiar and unfamiliar stimuli. Specifically, the activation pattern of the time-locked response identified by the proposed SNN model at approximately 200 milliseconds post-stimulus suggests greater connectivity and more widespread dynamic spatio-temporal patterns for familiar than unfamiliar logos. The proposed SNN approach can be applied to study other peri-perceptual or perceptual brain processes in cognitive and computational neuroscience.
There has been substantial interest in Mindfulness Training (MT) to understand how it can benefit healthy individuals as well as people with a broad range of health conditions. Research has begun to delineate associated changes in brain function. However, whether measures of brain function can be used to identify individuals who are more likely to respond to MT remains unclear. The present study applies a recently developed brain-inspired Spiking Neural Network (SNN) model to electroencephalography (EEG) data to provide novel insight into: i) brain function in depression; ii) the effect of MT on depressed and non-depressed individuals; and iii) neurobiological characteristics of depressed individuals who respond to mindfulness. Resting state EEG was recorded from before and after a 6 week MT programme in 18 participants. Based on self-report, 3 groups were formed: non-depressed (ND), depressed before but not after MT (responsive, D+) and depressed both before and after MT (unresponsive, D−). The proposed SNN, which utilises a standard brain-template, was used to model EEG data and assess connectivity, as indicated by activation levels across scalp regions (frontal, frontocentral, temporal, centroparietal and occipitoparietal), at baseline and follow-up. Results suggest an increase in activation following MT that was site-specific as a function of the group. Greater initial activation levels were seen in ND compared to depressed groups, and this difference was maintained at frontal and occipitoparietal regions following MT. At baseline, D+ had great activation than D−. Following MT, frontocentral and temporal activation reached ND levels in D+ but remained low in D−. Findings support the SNN approach in distinguishing brain states associated with depression and responsiveness to MT. The results also demonstrated that the SNN approach can be used to predict the effect of mindfulness on an individual basis before it is even applied.
7 December 2016 in IEEE Transactions on Cognitive and Developmental Systems
This paper argues that, the third generation of neural networks-the spiking neural networks (SNNs), can be used to model dynamic, spatio-temporal, cognitive brain processes measured as functional magnetic resonance imaging (fMRI) data. This paper proposes a novel method based on the NeuCube SNN architecture for which the following new algorithms are introduced: fMRI data encoding into spike sequences; deep unsupervised learning of fMRI data in a 3-D SNN reservoir; classification of cognitive states; and connectivity visualization and analysis for the purpose of understanding cognitive dynamics. The method is illustrated on two case studies of cognitive data modeling from a benchmark fMRI data set of seeing a picture versus reading a sentence.