Francis R. Willett

Francis R. Willett

Auto-generated profile, based on publicly available information

Francis R. Willett

Department of Neurosurgery, Stanford University, Stanford, CA, USA

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 May 2021 in Nature
Verified
Journal Article
Closed access
PDF file
FWFrancis R. Willett
Francis R. Willett
DADonald T. Avansino
Donald T. Avansino
LHLeigh R. Hochberg
Leigh R. Hochberg
JHJaimie M. Henderson
Jaimie M. Henderson
KSKrishna V. Shenoy
Krishna V. Shenoy

23 August 2023 in Nature
Verified
Journal Article
Open access
PDF file
FWFrancis R. Willett
Francis R. Willett
EKErin M. Kunz
Erin M. Kunz
CFChaofei Fan
Chaofei Fan
DADonald T. Avansino
Donald T. Avansino
GWGuy H. Wilson
Guy H. Wilson
JHJaimie M. Henderson
Jaimie M. Henderson
Speech brain–computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into text1,2 or sound3,4. Early demonstrations, although promising, have not yet achieved accuracies sufficiently high for communication of unconstrained sentences from a large vocabulary1–7. Here we demonstrate a speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant—who can no longer speak intelligibly owing to amyotrophic lateral sclerosis—achieved a 9.1% word error rate on a 50-word vocabulary (2.7 times fewer errors than the previous state-of-the-art speech BCI2) and a 23.8% word error rate on a 125,000-word vocabulary (the first successful demonstration, to our knowledge, of large-vocabulary decoding). Our participant’s attempted speech was decoded at 62 words per minute, which is 3.4 times as fast as the previous record8 and begins to approach the speed of natural conversation (160 words per minute9). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for restoring rapid communication to people with paralysis who can no longer speak.

1 April 2020 in Cell
Verified
Journal Article
Closed access
FWFrancis R. Willett
Francis R. Willett
DDDarrel R. Deo
Darrel R. Deo
DADonald T. Avansino
Donald T. Avansino
PRPaymon Rezaii
Paymon Rezaii
LHLeigh R. Hochberg
Leigh R. Hochberg
KSKrishna V. Shenoy
Krishna V. Shenoy

24 January 2018 in Journal of Neural Engineering
Verified
Journal Article
Closed access
DBDavid M Brandman
David M Brandman
THTommy Hosman
Tommy Hosman
JSJad Saab
Jad Saab
Michael C. BurkhartMichael C. Burkhart
Michael C. Burkhart
BSBenjamin E Shanahan
Benjamin E Shanahan
LHLeigh R Hochberg
Leigh R Hochberg
Objective . Brain–computer interfaces (BCIs) can enable individuals with tetraplegia to communicate and control external devices. Though much progress has been made in improving the speed and robustness of neural control provided by intracortical BCIs, little research has been devoted to minimizing the amount of time spent on decoder calibration. Approach . We investigated the amount of time users needed to calibrate decoders and achieve performance saturation using two markedly different decoding algorithms: the steady-state Kalman filter, and a novel technique using Gaussian process regression (GP-DKF). Main results . Three people with tetraplegia gained rapid closed-loop neural cursor control and peak, plateaued decoder performance within 3 min of initializing calibration. We also show that a BCI-naïve user (T5) was able to rapidly attain closed-loop neural cursor control with the GP-DKF using self-selected movement imagery on his first-ever day of closed-loop BCI use, acquiring a target 37 s after initiating calibration. Significance . These results demonstrate the potential for an intracortical BCI to be used immediately after deployment by people with paralysis, without the need for user learning or extensive system calibration.

11 November 2020 in Journal of Neural Engineering
Verified
Journal Article
Closed access
GWGuy H Wilson
Guy H Wilson
SSSergey D Stavisky
Sergey D Stavisky
FWFrancis R Willett
Francis R Willett
DADonald T Avansino
Donald T Avansino
JKJessica N Kelemen
Jessica N Kelemen
KSKrishna V Shenoy
Krishna V Shenoy
Objective . To evaluate the potential of intracortical electrode array signals for brain-computer interfaces (BCIs) to restore lost speech, we measured the performance of decoders trained to discriminate a comprehensive basis set of 39 English phonemes and to synthesize speech sounds via a neural pattern matching method. We decoded neural correlates of spoken-out-loud words in the ‘hand knob’ area of precentral gyrus, a step toward the eventual goal of decoding attempted speech from ventral speech areas in patients who are unable to speak. Approach . Neural and audio data were recorded while two BrainGate2 pilot clinical trial participants, each with two chronically-implanted 96-electrode arrays, spoke 420 different words that broadly sampled English phonemes. Phoneme onsets were identified from audio recordings, and their identities were then classified from neural features consisting of each electrode’s binned action potential counts or high-frequency local field potential power. Speech synthesis was performed using the ‘Brain-to-Speech’ pattern matching method. We also examined two potential confounds specific to decoding overt speech: acoustic contamination of neural signals and systematic differences in labeling different phonemes’ onset times. Main results . A linear decoder achieved up to 29.3% classification accuracy (chance = 6%) across 39 phonemes, while an RNN classifier achieved 33.9% accuracy. Parameter sweeps indicated that performance did not saturate when adding more electrodes or more training data, and that accuracy improved when utilizing time-varying structure in the data. Microphonic contamination and phoneme onset differences modestly increased decoding accuracy, but could be mitigated by acoustic artifact subtraction and using a neural speech onset marker, respectively. Speech synthesis achieved r = 0.523 correlation between true and reconstructed audio. Significance . The ability to decode speech using intracortical electrode array signals from a nontraditional speech area suggests that placing electrode arrays in ventral speech areas is a promising direction for speech BCIs.

20 June 2019 in Scientific Reports
Verified
Journal Article
Open access
PDF file
FWFrancis R. Willett
Francis R. Willett
DYDaniel R. Young
Daniel R. Young
BMBrian A. Murphy
Brian A. Murphy
WMWilliam D. Memberg
William D. Memberg
CBChristine H. Blabe
Christine H. Blabe
AAA. Bolu Ajiboye
A. Bolu Ajiboye
Decoders optimized offline to reconstruct intended movements from neural recordings sometimes fail to achieve optimal performance online when they are used in closed-loop as part of an intracortical brain-computer interface (iBCI). This is because typical decoder calibration routines do not model the emergent interactions between the decoder, the user, and the task parameters (e.g. target size). Here, we investigated the feasibility of simulating online performance to better guide decoder parameter selection and design. Three participants in the BrainGate2 pilot clinical trial controlled a computer cursor using a linear velocity decoder under different gain (speed scaling) and temporal smoothing parameters and acquired targets with different radii and distances. We show that a user-specific iBCI feedback control model can predict how performance changes under these different decoder and task parameters in held-out data. We also used the model to optimize a nonlinear speed scaling function for the decoder. When used online with two participants, it increased the dynamic range of decoded speeds and decreased the time taken to acquire targets (compared to an optimized standard decoder). These results suggest that it is feasible to simulate iBCI performance accurately enough to be useful for quantitative decoder optimization and design.