Kaila L. Stipancic

Dr. Kaila L. Stipancic

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2016 in Journal of Speech, Language, and Hearing Research
Verified
Journal Article
Closed access
KSKaila L. Stipancic
Kaila L. Stipancic
KTKris Tjaden
Kris Tjaden
GWGregory Wilding
Gregory Wilding
Purpose: This study obtained judgments of sentence intelligibility using orthographic transcription for comparison with previously reported intelligibility judgments obtained using a visual analog scale (VAS) for individuals with Parkinson's disease and multiple sclerosis and healthy controls (K. Tjaden, J. E. Sussman, & G. E. Wilding, 2014). Method: Speakers read Harvard sentences in habitual, clear, loud, and slow conditions. Sentence stimuli were equated for peak intensity and mixed with multitalker babble. A total of 50 listeners orthographically transcribed sentences. Procedures were identical to those for a VAS reported in Tjaden, Sussman, and Wilding (2014). Results: The percent correct scores from transcription were significantly higher in magnitude than the VAS scores. Multivariate linear modeling indicated that the pattern of findings for transcription and VAS was virtually the same with respect to differences among groups and speaking conditions. Correlation analyses further indicated a moderately strong, positive relationship between the two metrics. The majority of these correlations were significant. Last, intrajudge and interjudge listener reliability metrics for the two intelligibility tasks were comparable. Conclusion: Results suggest that there may be instances when the less time-consuming VAS task may be a viable substitute for an orthographic transcription task when documenting intelligibility in mild dysarthria.

11 November 2021 in Journal of Speech, Language, and Hearing Research
Verified
Journal Article
Closed access
KSKaila L. Stipancic
Kaila L. Stipancic
KPKira M. Palmer
Kira M. Palmer
HRHannah Rowe
Hannah Rowe
YYYana Yunusova
Yana Yunusova
JBJames D. Berry
James D. Berry
JGJordan R. Green
Jordan R. Green
Purpose: The main purpose of this study was to create an empirical classification system for speech severity in patients with dysarthria secondary to amyotrophic lateral sclerosis (ALS) by exploring the reliability and validity of speech-language pathologists' (SLPs') ratings of dysarthric speech. Method: Ten SLPs listened to speech samples from 52 speakers with ALS and 20 healthy control speakers. SLPs were asked to rate the speech severity of the speakers using five response options: normal, mild, moderate, severe, and profound. Four severity-surrogate measures were also calculated: SLPs transcribed the speech samples for the calculation of speech intelligibility and rated the effort it took to understand the speakers on a visual analog scale. In addition, speaking rate and intelligible speaking rate were calculated for each speaker. Intrarater and interrater reliability were calculated for each measure. We explored the validity of clinician-based severity ratings by comparing them to the severity-surrogate measures. Receiver operating characteristic (ROC) curves were conducted to create optimal cutoff points for defining dysarthria severity categories. Results: Intrarater and interrater reliability for the clinician-based severity ratings were excellent and were comparable to reliability for the severity-surrogate measures explored. Clinician severity ratings were strongly associated with all severity-surrogate measures, suggesting strong construct validity. We also provided a range of values for each severity-surrogate measure within each severity category based on the cutoff points obtained from the ROC analyses. Conclusions: Clinician severity ratings of dysarthric speech are reliable and valid. We discuss the underlying challenges that arise when selecting a stratification measure and offer recommendations for a classification scheme when stratifying patients and research participants into speech severity categories.

20 April 2022 in Journal of Speech, Language, and Hearing Research
Verified
Journal Article
Closed access
KSKaila L. Stipancic
Kaila L. Stipancic
KTKris Tjaden
Kris Tjaden
Purpose: This study sought to determine the minimally detectable change (MDC) of sentence intelligibility for speakers with multiple sclerosis (MS) and Parkinson's disease (PD). Method: Speakers included 78 participants consisting of 32 neurologically healthy control speakers, 30 speakers with MS, and 16 speakers with PD. All speakers were recorded reading 11 sentences comprising the Speech Intelligibility Test (SIT), which were subsequently transcribed by inexperienced listeners. Percent correct scores were calculated for each sentence. An average percent correct score was also calculated for each speaker. The MDC at the 95% confidence interval was calculated using the following formula: MDC 95 = 1.96 × √2 × standard error of measurement. Speakers were divided into operationally defined categories of severity, and MDCs were calculated for each category to permit comparison to MDCs reported for speakers with amyotrophic lateral sclerosis (ALS). Kruskal–Wallis tests were conducted to compare MDCs between groups and severity categories. Results: The average MDC 95 for control speakers was 5.53% (range = 3.21%–7.47%) and was statistically smaller than MDCs for speakers with MS (average = 10.08%, range = 5.30%–15.62%) and those for speakers with PD (average = 10.98%, range = 8.60%–13.98%). Statistical analyses further revealed significant differences between MDCs across severity categories. Conclusions: In agreement with previous work in ALS conducted under similar conditions (i.e., orthographic transcription of SIT sentences in a quiet listening environment), the MDC 95 of speech intelligibility ranged from 3% to 10% for speakers with MS and PD who have mildly impaired speech. These estimates are a step toward the development of a universal language with which to evaluate speech changes in a variety of patient populations.

27 May 2022 in Journal of Speech, Language, and Hearing Research
Verified
Journal Article
Closed access
SGSarah E. Gutz
Sarah E. Gutz
KSKaila L. Stipancic
Kaila L. Stipancic
YYYana Yunusova
Yana Yunusova
JBJames D. Berry
James D. Berry
JGJordan R. Green
Jordan R. Green
Purpose: There is increasing interest in using automatic speech recognition (ASR) systems to evaluate impairment severity or speech intelligibility in speakers with dysarthria. We assessed the clinical validity of one currently available off-the-shelf (OTS) ASR system (i.e., a Google Cloud ASR API) for indexing sentence-level speech intelligibility and impairment severity in individuals with amyotrophic lateral sclerosis (ALS), and we provided guidance for potential users of such systems in research and clinic. Method: Using speech samples collected from 52 individuals with ALS and 20 healthy control speakers, we compared word recognition rate (WRR) from the commercially available Google Cloud ASR API (Machine WRR) to clinician-provided judgments of impairment severity, as well as sentence intelligibility (Human WRR). We assessed the internal reliability of Machine and Human WRR by comparing the standard deviation of WRR across sentences to the minimally detectable change (MDC), a clinical benchmark that indicates whether results are within measurement error. We also evaluated Machine and Human WRR diagnostic accuracy for classifying speakers into clinically established categories. Results: Human WRR achieved better accuracy than Machine WRR when indexing speech severity, and, although related, Human and Machine WRR were not strongly correlated. When the speech signal was mixed with noise (noise-augmented ASR) to reduce a ceiling effect, Machine WRR performance improved. Internal reliability metrics were worse for Machine than Human WRR, particularly for typical and mildly impaired severity groups, although sentence length significantly impacted both Machine and Human WRRs. Conclusions: Results indicated that the OTS ASR system was inadequate for early detection of speech impairment and grading overall speech severity. While Machine and Human WRR were correlated, ASR should not be used as a one-to-one proxy for transcription speech intelligibility or clinician severity ratings. Overall, findings suggested that the tested OTS ASR system, Google Cloud ASR, has limited utility for grading clinical speech impairment in speakers with ALS.

19 October 2021 in American Journal of Speech-Language Pathology
Verified
Journal Article
Closed access
KMKatherine L. Marks
Katherine L. Marks
AVAlessandra Verdi
Alessandra Verdi
LTLaura E. Toles
Laura E. Toles
KSKaila L. Stipancic
Kaila L. Stipancic
AOAndrew J. Ortiz
Andrew J. Ortiz
DMDaryush Mehta
Daryush Mehta
Objective: The purpose of this study was to examine the psychometric properties of an ecological vocal effort scale linked to a voicing task. Method: Thirty-eight patients with nodules, 18 patients with muscle tension dysphonia, and 45 vocally healthy control individuals participated in a week of ambulatory voice monitoring. A global vocal status question was asked hourly throughout the day. Participants produced a vowel–consonant–vowel syllable string and rated the vocal effort needed to produce the task on a visual analog scale. Test–retest reliability was calculated for a subset using the intraclass correlation coefficient, ICC(A, 1). Construct validity was assessed by (a) comparing the weeklong vocal effort ratings between the patient and control groups and (b) comparing weeklong vocal effort ratings before and after voice rehabilitation in a subset of 25 patients. Cohen's d, the standard error of measurement ( SEM ), and the minimal detectable change (MDC) assessed sensitivity. The minimal clinically important difference (MCID) assessed responsiveness. Results: Test–retest reliability was excellent, ICC(A, 1) = .96. Weeklong mean effort was statistically higher in the patients than in controls ( d = 1.62) and lower after voice rehabilitation ( d = 1.75), supporting construct validity and sensitivity. SEM was 4.14, MDC was 11.47, and MCID was 9.74. Since the MCID was within the error of the measure, we must rely upon the MDC to detect real changes in ecological vocal effort. Conclusion: The ecological vocal effort scale offers a reliable, valid, and sensitive method of monitoring vocal effort changes during the daily life of individuals with and without vocal hyperfunction.

16 November 2022 in American Journal of Speech-Language Pathology
Verified
Journal Article
Closed access
KSKaila L. Stipancic
Kaila L. Stipancic
FBFrits van Brenk
Frits van Brenk
AKAlexander Kain
Alexander Kain
GWGregory Wilding
Gregory Wilding
KTKris Tjaden
Kris Tjaden
Purpose: This study investigated the effects of three clear speech variants on sentence intelligibility and speaking effort for speakers with Parkinson's disease (PD) and age- and sex-matched neurologically healthy controls. Method: Fourteen speakers with PD and 14 neurologically healthy speakers participated. Each speaker was recorded reading 18 sentences from the Speech Intelligibility Test in their habitual speaking style and for three clear speech variants: clear (SC; given instructions to speak clearly), hearing impaired (HI; given instructions to speak with someone with a hearing impairment), and overenunciate (OE; given instructions to overenunciate each word). Speakers rated the amount of physical and mental effort exerted during each speaking condition using visual analog scales (averaged to yield a metric of overall speaking effort). Sentence productions were orthographically transcribed by 50 naive listeners. Linear mixed-effects models were used to compare intelligibility and speaking effort across the clear speech variants. Results: Intelligibility was reduced for the PD group in comparison to the control group only in the habitual condition. All clear speech variants significantly improved intelligibility above habitual levels for the PD group, with OE maximizing intelligibility, followed by the SC and HI conditions. Both groups rated speaking effort to be significantly higher for both the OE and HI conditions versus the SC and habitual conditions. Discussion: For speakers with PD, all clear speech variants increased intelligibility to a level comparable to that of healthy controls. All clear speech variants were also associated with higher levels of speaking effort than habitual speech for the speakers with PD. Clinically, findings suggest that clear speech training programs consider using the instruction “overenunciate” for maximizing intelligibility. Future research is needed to identify if high levels of speaking effort elicited by the clear speech variants affect long-term sustainability of the intelligibility benefit.