1 March 2018 in Current Biology
1 August 2019 in The Journal of Neuroscience
Speech perception involves the integration of sensory input with expectations based on the context of that speech. Much debate surrounds the issue of whether or not prior knowledge feeds back to affect early auditory encoding in the lower levels of the speech processing hierarchy, or whether perception can be best explained as a purely feedforward process. Although there has been compelling evidence on both sides of this debate, experiments involving naturalistic speech stimuli to address these questions have been lacking. Here, we use a recently introduced method for quantifying the semantic context of speech and relate it to a commonly used method for indexing low-level auditory encoding of speech. The relationship between these measures is taken to be an indication of how semantic context leading up to a word influences how its low-level acoustic and phonetic features are processed. We record EEG from human participants (both male and female) listening to continuous natural speech and find that the early cortical tracking of a word9s speech envelope is enhanced by its semantic similarity to its sentential context. Using a forward modeling approach, we find that prediction accuracy of the EEG signal also shows the same effect. Furthermore, this effect shows distinct temporal patterns of correlation depending on the type of speech input representation (acoustic or phonological) used for the model, implicating a top-down propagation of information through the processing hierarchy. These results suggest a mechanism that links top-down prior information with the early cortical entrainment of words in natural, continuous speech. SIGNIFICANCE STATEMENT During natural speech comprehension, we use semantic context when processing information about new incoming words. However, precisely how the neural processing of bottom-up sensory information is affected by top-down context-based predictions remains controversial. We address this discussion using a novel approach that indexes a word9s similarity to context and how well a word9s acoustic and phonetic features are processed by the brain at the time of its utterance. We relate these two measures and show that lower-level auditory tracking of speech improves for words that are more related to their preceding context. These results suggest a mechanism that links top-down prior information with bottom-up sensory processing in the context of natural, narrative speech listening.
2 March 2021 in Scientific Reports
Healthy ageing leads to changes in the brain that impact upon sensory and cognitive processing. It is not fully clear how these changes affect the processing of everyday spoken language. Prediction is thought to play an important role in language comprehension, where information about upcoming words is pre-activated across multiple representational levels. However, evidence from electrophysiology suggests differences in how older and younger adults use context-based predictions, particularly at the level of semantic representation. We investigate these differences during natural speech comprehension by presenting older and younger subjects with continuous, narrative speech while recording their electroencephalogram. We use time-lagged linear regression to test how distinct computational measures of (1) semantic dissimilarity and (2) lexical surprisal are processed in the brains of both groups. Our results reveal dissociable neural correlates of these two measures that suggest differences in how younger and older adults successfully comprehend speech. Specifically, our results suggest that, while younger and older subjects both employ context-based lexical predictions, older subjects are significantly less likely to pre-activate the semantic features relating to upcoming words. Furthermore, across our group of older adults, we show that the weaker the neural signature of this semantic pre-activation mechanism, the lower a subject’s semantic verbal fluency score. We interpret these findings as prediction playing a generally reduced role at a semantic level in the brains of older listeners during speech comprehension and that these changes may be part of an overall strategy to successfully comprehend speech with reduced cognitive resources.
1 January 2019 in NeuroImage: Clinical
To localise and characterise changes in cognitive networks in Amyotrophic Lateral Sclerosis (ALS) using source analysis of mismatch negativity (MMN) waveforms. The MMN waveform has an increased average delay in ALS. MMN has been attributed to change detection and involuntary attention switching. This therefore indicates pathological impairment of the neural network components which generate these functions. Source localisation can mitigate the poor spatial resolution of sensor-level EEG analysis by associating the sensor-level signals to the contributing brain sources. The functional activity in each generating source can therefore be individually measured and investigated as a quantitative biomarker of impairment in ALS or its sub-phenotypes. MMN responses from 128-channel electroencephalography (EEG) recordings in 58 ALS patients and 39 healthy controls were localised to source by three separate localisation methods, including beamforming, dipole fitting and exact low resolution brain electromagnetic tomography. Compared with controls, ALS patients showed significant increase in power of the left posterior parietal, central and dorsolateral prefrontal cortices (false discovery rate = 0.1). This change correlated with impaired cognitive flexibility (rho = 0.45, 0.45, 0.47, p = .042, .055, .031 respectively). ALS patients also exhibited a decrease in the power of dipoles representing activity in the inferior frontal (left: p = 5.16 × 10-6, right: p = 1.07 × 10-5) and left superior temporal gyri (p = 9.30 × 10-6). These patterns were detected across three source localisation methods. Decrease in right inferior frontal gyrus activity was a good discriminator of ALS patients from controls (AUROC = 0.77) and an excellent discriminator of C9ORF72 expansion-positive patients from controls (AUROC = 0.95). Source localization of evoked potentials can reliably discriminate patterns of functional network impairment in ALS and ALS subgroups during involuntary attention switching. The discriminative ability of the detected cognitive changes in specific brain regions are comparable to those of functional magnetic resonance imaging (fMRI). Source analysis of high-density EEG patterns has excellent potential to provide non-invasive, data-driven quantitative biomarkers of network disruption that could be harnessed as novel neurophysiology-based outcome measures in clinical trials.
24 September 2017 in bioRxiv
Understanding natural speech requires that the human brain convert complex spectrotemporal patterns of acoustic input into meaning in a rapid manner that is reasonably tightly time-locked to the incoming speech signal. However, neural evidence for such a time-locked process has been lacking. Here, we sought such evidence by using a computational model to quantify the meaning carried by each word based on how semantically dissimilar it was to its preceding context and then regressing this quantity against electroencephalographic (EEG) data recorded from subjects as they listened to narrative speech. This produced a prominent negativity at a time-lag of 200– 600 ms on centro-parietal EEG electrodes. Subsequent EEG experiments involving time-reversed speech, cocktail party attention and audiovisual speech-in-noise demonstrated that this response was exquisitely sensitive to whether or not subjects were understanding the speech they heard. These findings demonstrate that, when successfully comprehending natural speech, the human brain encodes meaning as a function of the amount of new information carried by each word in a relatively time-locked fashion.