Peter Brunner

Peter Brunner

Auto-generated profile, based on publicly available information

Peter Brunner

Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA

Research Focus & Metrics

Academic Career Length

22Years (2005-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 June 2015 in Frontiers in Neuroscience
Verified
Journal Article
Open access
PDF file
CHChristian Herff
Christian Herff
DHDominic Heger
Dominic Heger
APAdriana de Pesters
Adriana de Pesters
DTDominic Telaar
Dominic Telaar
PBPeter Brunner
Peter Brunner
Tanja SchultzTanja Schultz
Tanja Schultz
It has long been speculated whether communication between humans and machines based on natural speech related cortical activity is possible. Over the past decade, studies have suggested that it is feasible to recognize isolated aspects of speech from neural signals, such as auditory features, phones or one of a few isolated words. However, until now it remained an unsolved challenge to decode continuously spoken speech from the neural substrate associated with speech and language processing. Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings. Specifically, we implemented a system, which we call Brain-To-Text that models single phones, employs techniques from automatic speech recognition (ASR), and thereby transforms brain activity while speaking into the corresponding textual representation. Our results demonstrate that our system achieved word error rates as low as 25% and phone error rates below 50%. Additionally, our approach contributes to the current understanding of the neural basis of continuous speech production by identifying those cortical regions that hold substantial information about individual phones. In conclusion, the Brain-To-Text system described in this paper represents an important step towards human-machine communication based on imagined speech.

21 September 2010 in Journal of Neural Engineering
Verified
Journal Article
Closed access
PBP Brunner
P Brunner
SJS Joshi
S Joshi
SBS Briskin
S Briskin
JWJ R Wolpaw
J R Wolpaw
HBH Bischof
H Bischof
GSG Schalk
G Schalk
Many people affected by debilitating neuromuscular disorders such as amyotrophic lateral sclerosis, brainstem stroke or spinal cord injury are impaired in their ability to, or are even unable to, communicate. A brain-computer interface (BCI) uses brain signals, rather than muscles, to re-establish communication with the outside world. One particular BCI approach is the so-called 'P300 matrix speller' that was first described by Farwell and Donchin (1988 Electroencephalogr. Clin. Neurophysiol. 70 510-23). It has been widely assumed that this method does not depend on the ability to focus on the desired character, because it was thought that it relies primarily on the P300-evoked potential and minimally, if at all, on other EEG features such as the visual-evoked potential (VEP). This issue is highly relevant for the clinical application of this BCI method, because eye movements may be impaired or lost in the relevant user population. This study investigated the extent to which the performance in a 'P300' speller BCI depends on eye gaze. We evaluated the performance of 17 healthy subjects using a 'P300' matrix speller under two conditions. Under one condition ('letter'), the subjects focused their eye gaze on the intended letter, while under the second condition ('center'), the subjects focused their eye gaze on a fixation cross that was located in the center of the matrix. The results show that the performance of the 'P300' matrix speller in normal subjects depends in considerable measure on gaze direction. They thereby disprove a widespread assumption in BCI research, and suggest that this BCI might function more effectively for people who retain some eye-movement control. The applicability of these findings to people with severe neuromuscular disabilities (particularly in eye-movements) remains to be determined.

26 September 2016 in Proceedings of the National Academy of Sciences
Verified
Journal Article
Closed access
PDF file
EFEvelina Fedorenko
Evelina Fedorenko
TSTerri L. Scott
Terri L. Scott
PBPeter Brunner
Peter Brunner
WCWilliam G. Coon
William G. Coon
BPBrianna Pritchett
Brianna Pritchett
NKNancy Kanwisher
Nancy Kanwisher
Significance: How do circuits of neurons in your brain extract and hold the meaning of a sentence? To start to address this unanswered question, we measured neural activity from the surface of the human brain in patients being mapped out before neurosurgery, as they read sentences. In many electrodes, neural activity increased steadily over the course of the sentence, but the same was not found when participants read lists of words or pronounceable nonwords, or grammatical nonword strings (“Jabberwocky”). This build-up of neural activity appears to reflect neither word meaning nor syntax alone, but the representation of complex meanings.

1 February 2011 in NeuroImage
Verified
Journal Article
Closed access
XPXiaomei Pei
Xiaomei Pei
ELEric C. Leuthardt
Eric C. Leuthardt
CGCharles M. Gaona
Charles M. Gaona
PBPeter Brunner
Peter Brunner
JWJonathan R. Wolpaw
Jonathan R. Wolpaw
GSGerwin Schalk
Gerwin Schalk

27 May 2014 in Frontiers in Neuroengineering
Verified
Journal Article
Open access
PDF file
SMStã©Phanie Martin
Stã©Phanie Martin
PBPeter Brunner
Peter Brunner
CHChris Holdgraf
Chris Holdgraf
HHHans-Jochen Heinze
Hans-Jochen Heinze
NCNathan E. Crone
Nathan E. Crone
BPBrian N. Pasley
Brian N. Pasley
Auditory perception and auditory imagery have been shown to activate overlapping brain regions. We hypothesized that these phenomena also share a common underlying neural representation. To assess this, we used intracranial recordings from epileptic patients performing an out loud or a silent reading task. In these tasks, short stories scrolled across a video screen in two conditions: subjects read the same stories both aloud (overt) and silently (covert). In a control condition the subject remained in a resting state. We first built a high gamma (70-150 Hz) neural decoding model to reconstruct spectrotemporal auditory features of self-generated overt speech. We then evaluated whether this same model could reconstruct auditory speech features in the covert speech condition. Two speech models were tested: a spectrogram and a modulation-based feature space. For the overt condition, reconstruction accuracy was evaluated as the correlation between original and predicted speech features, and was significant in each subject. For the covert speech condition, dynamic time warping was first used to realign the covert speech reconstruction with the corresponding original speech from the overt condition. Covert reconstruction accuracy was then compared to the accuracy obtained from reconstructions in the baseline control condition. Across the group of subjects, reconstruction accuracy for the covert condition was significantly better than for the control condition. Electrodes in the superior temporal gyrus, pre- and post-central gyrus were the strongest predictors of decoding accuracy. These results provide evidence that auditory representations of covert speech can be reconstructed from models that are built from an overt speech data set, supporting a partially shared neural substrate.

26 August 2024 in IEEE Reviews in Biomedical Engineering
Verified
Journal Article
Open access
BEBradley Edelman
Bradley Edelman
SZShuailei Zhang
Shuailei Zhang
GSGerwin Schalk
Gerwin Schalk
PBPeter Brunner
Peter Brunner
GMGernot R. Müller-Putz
Gernot R. Müller-Putz
BHBin He
Bin He
Brain-computer interface (BCI) is a rapidly evolving technology that has the potential to widely influence research, clinical and recreational use. Non-invasive BCI approaches are particularly common as they can impact a large number of participants safely and at a relatively low cost. Where traditional non-invasive BCIs were used for simple computer cursor tasks, it is now increasingly common for these systems to control robotic devices for complex tasks that may be useful in daily life. In this review, we provide an overview of the general BCI framework as well as the various methods that can be used to record neural activity, extract signals of interest, and decode brain states. In this context, we summarize the current state-of-the-art of non-invasive BCI research, focusing on trends in both the application of BCIs for controlling external devices and algorithm development to optimize their use. We also discuss various open-source BCI toolboxes and software, and describe their impact on the field at large.