Terri Elizabeth Workman

Dr. Terri Elizabeth Workman


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 October 2024 in Progress in Cardiovascular Diseases
Verified
Journal Article
Closed access
TWTerri Elizabeth Workman
Terri Elizabeth Workman
AAAli Ahmed
Ali Ahmed
HSHelen M. Sheriff
Helen M. Sheriff
VRVenkatesh K. Raman
Venkatesh K. Raman
SZSijian Zhang
Sijian Zhang
QZQing Zeng-Treitler
Qing Zeng-Treitler

18 January 2019 in BMC Research Notes
Verified
Journal Article
Open access
PDF file
TWTerri Elizabeth Workman
Terri Elizabeth Workman
YSYijun Shao
Yijun Shao
GDGuy Divita
Guy Divita
QZQing Zeng-Treitler
Qing Zeng-Treitler
Misspellings in clinical free text present challenges to natural language processing. With an objective to identify misspellings and their corrections, we developed a prototype spelling analysis method that implements Word2Vec, Levenshtein edit distance constraints, a lexical resource, and corpus term frequencies. We used the prototype method to process two different corpora, surgical pathology reports, and emergency department progress and visit notes, extracted from Veterans Health Administration resources. We evaluated performance by measuring positive predictive value and performing an error analysis of false positive output, using four classifications. We also performed an analysis of spelling errors in each corpus, using common error classifications. In this small-scale study utilizing a total of 76,786 clinical notes, the prototype method achieved positive predictive values of 0.9057 and 0.8979, respectively, for the surgical pathology reports, and emergency department progress and visit notes, in identifying and correcting misspelled words. False positives varied by corpus. Spelling error types were similar among the two corpora, however, the authors of emergency department progress and visit notes made over four times as many errors. Overall, the results of this study suggest that this method could also perform sufficiently in identifying misspellings in other clinical document types.

6 April 2024 in Healthcare
Verified
Journal Article
Open access
PDF file
TWTerri Elizabeth Workman
Terri Elizabeth Workman
JKJoel Kupersmith
Joel Kupersmith
PMPhillip Ma
Phillip Ma
CSChristopher Spevak
Christopher Spevak
FSFriedhelm Sandbrink
Friedhelm Sandbrink
QZQing Zeng-Treitler
Qing Zeng-Treitler
Opioid use disorder is known to be under-coded as a diagnosis, yet problematic opioid use can be documented in clinical notes, which are included in electronic health records. We sought to identify problematic opioid use from a full range of clinical notes and compare the demographic and clinical characteristics of patients identified as having problematic opioid use exclusively in clinical notes to patients documented through ICD opioid use disorder diagnostic codes. We developed and applied a natural language processing (NLP) tool that combines rule-based pattern analysis and a trained support vector machine to the clinical notes of a patient cohort (n = 222,371) from two Veteran Affairs service regions to identify patients with problematic opioid use. We also used a set of ICD diagnostic codes to identify patients with opioid use disorder from the same cohort. The NLP tool achieved 96.6% specificity, 90.4% precision/PPV, 88.4% sensitivity/recall, and 94.4% accuracy on unseen test data. NLP exclusively identified 57,331 patients; 6997 patients had positive ICD code identifications. Patients exclusively identified through NLP were more likely to be women. Those identified through ICD codes were more likely to be male, younger, have concurrent benzodiazepine prescriptions, more comorbidities, and more care encounters, and were less likely to be married. Patients in both these groups had substantially elevated comorbidity levels compared with patients not documented through either method as experiencing problematic opioid use. Clinicians may be reluctant to code for opioid use disorder. It is therefore incumbent on the healthcare team to search for documentation of opioid concerns within clinical notes.

9 June 2021 in Western Journal of Emergency Medicine
Verified
Journal Article
Open access
PDF file
CBCynthia Brandt
Cynthia Brandt
TWTerri Elizabeth Workman
Terri Elizabeth Workman
MFMelissa M. Farmer
Melissa M. Farmer
KAKathleen M. Akgün
Kathleen M. Akgün
EAErica A. Abel
Erica A. Abel
LPLori A. Post
Lori A. Post
Introduction: Presence of a firearm is associated with increased risk of violence and suicide. United States military veterans are at disproportionate risk of suicide. Routine healthcare provider screening of firearm access may prompt counseling on safe storage and handling of firearms. The objective of this study was to determine the frequency with which Veterans Health Administration (VHA) healthcare providers document firearm access in electronic health record (EHR) clinical notes, and whether this varied by patient characteristics.Methods: The study sample is a post-9-11 cohort of veterans in their first year of VHA care, with at least one outpatient care visit between 2012-2017 (N = 762,953). Demographic data, veteran military service characteristics, and clinical comorbidities were obtained from VHA EHR. We extracted clinical notes for outpatient visits to primary, urgent, or emergency clinics (total 105,316,004). Natural language processing and machine learning (ML) approaches were used to identify documentation of firearm access. A taxonomy of firearm terms was identified and manually annotated with text anchored by these terms, and then trained the ML algorithm. The random-forest algorithm achieved 81.9% accuracy in identifying documentation of firearm access.Results:The proportion of patients with EHR-documented access to one or more firearms during their first year of care in the VHA was relatively low and varied by patient characteristics. Men had significantly higher documentation of firearms than women (9.8% vs 7.1%; P < .001) and veterans >50 years old had the lowest (6.5%). Among veterans with any firearm term present, only 24.4% were classified as positive for access to a firearm (24.7% of men and 20.9% of women).Conclusion: Natural language processing can identify documentation of access to firearms in clinical notes with acceptable accuracy, but there is a need for investigation into facilitators and barriers for providers and veterans to improve a systemwide process of firearm access screening. Screening, regardless of race/ethnicity, gender, and age, provides additional opportunities to protect veterans from self-harm and violence.

11 September 2023 in Health Science Reports
Verified
Journal Article
Open access
TWTerri Elizabeth Workman
Terri Elizabeth Workman
JGJoseph L. Goulet
Joseph L. Goulet
CBCynthia A. Brandt
Cynthia A. Brandt
AWAllison R. Warren
Allison R. Warren
JEJacob Eleazer
Jacob Eleazer
QZQing Zeng‐Treitler
Qing Zeng‐Treitler
Background and Aims: In deep learning, a major difficulty in identifying suicidality and its risk factors in clinical notes is the lack of training samples given the small number of true positive instances among the number of patients screened. This paper describes a novel methodology that identifies suicidality in clinical notes by addressing this data sparsity issue through zero‐shot learning. Our general aim was to develop a tool that leveraged zero‐shot learning to effectively identify suicidality documentation in all types of clinical notes.Methods: US Veterans Affairs clinical notes served as data. The training data set label was determined using diagnostic codes of suicide attempt and self‐harm. We used a base string associated with the target label of suicidality to provide auxiliary information by narrowing the positive training cases to those containing the base string. We trained a deep neural network by mapping the training documents’ contents to a semantic space. For comparison, we trained another deep neural network using the identical training data set labels, and bag‐of‐words features.Results: The zero‐shot learning model outperformed the baseline model in terms of area under the curve, sensitivity, specificity, and positive predictive value at multiple probability thresholds. In applying a 0.90 probability threshold, the methodology identified notes documenting suicidality but not associated with a relevant ICD‐10‐CM code, with 94% accuracy.Conclusion: This method can effectively identify suicidality without manual annotation.

13 December 2022 in Medical Care
Verified
Journal Article
Closed access
TWTerri Elizabeth Workman
Terri Elizabeth Workman
JGJoseph L. Goulet
Joseph L. Goulet
CBCynthia A. Brandt
Cynthia A. Brandt
LLLuke Lindemann
Luke Lindemann
MSMelissa Msw Skanderson
Melissa Msw Skanderson
QZQing Zeng-Treitler
Qing Zeng-Treitler
Objective: Disclosure of sexual orientation and gender identity correlates with better outcomes, yet data may not be available in structured fields in electronic health record data. To gain greater insight into the care of sexual and gender-diverse patients in the Veterans Health Administration (VHA), we examined the documentation patterns of sexual orientation and gender identity through extraction and analyses of data contained in unstructured electronic health record clinical notes. Methods: Salient terms were identified through authoritative vocabularies, the research team’s expertise, and frequencies, and the use of consistency in VHA clinical notes. Term frequencies were extracted from VHA clinical notes recorded from 2000 to 2018. Temporal analyses assessed usage changes in normalized frequencies as compared with nonclinical use, relative growth rates, and geographic variations. Results: Over time most terms increased in use, similar to Google ngram data, especially after the repeal of the “Don’t Ask Don’t Tell” military policy in 2010. For most terms, the usage adoption consistency also increased by the study’s end. Aggregated use of all terms increased throughout the United States. Conclusion: Term usage trends may provide a view of evolving care in a temporal continuum of changing policy. These findings may be useful for policies and interventions geared toward sexual and gender-diverse individuals. Despite the lack of structured data, the documentation of sexual orientation and gender identity terms is increasing in clinical notes.