Kelly Jean Thomas Craig

Kelly Jean Thomas Craig

orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 September 2022 in Academic Medicine
Verified
Journal Article
Closed access
RRRegina G. PhD Russell
Regina G. PhD Russell
LNLaurie Lovett Novak
Laurie Lovett Novak
MPMehool Patel
Mehool Patel
KGKim V. PhD Garvey
Kim V. PhD Garvey
KCKelly Jean Thomas Craig
Kelly Jean Thomas Craig
BMBonnie M. Md Miller
Bonnie M. Md Miller
Purpose: The expanded use of clinical tools that incorporate artificial intelligence (AI) methods has generated calls for specific competencies for effective and ethical use. This qualitative study used expert interviews to define AI-related clinical competencies for health care professionals. Method: In 2021, a multidisciplinary team interviewed 15 experts in the use of AI-based tools in health care settings about the clinical competencies health care professionals need to work effectively with such tools. Transcripts of the semistructured interviews were coded and thematically analyzed. Draft competency statements were developed and provided to the experts for feedback. The competencies were finalized using a consensus process across the research team. Results: Six competency domain statements and 25 subcompetencies were formulated from the thematic analysis. The competency domain statements are: (1) basic knowledge of AI: explain what AI is and describe its health care applications; (2) social and ethical implications of AI: explain how social, economic, and political systems influence AI-based tools and how these relationships impact justice, equity, and ethics; (3) AI-enhanced clinical encounters: carry out AI-enhanced clinical encounters that integrate diverse sources of information in creating patient-centered care plans; (4) evidence-based evaluation of AI-based tools: evaluate the quality, accuracy, safety, contextual appropriateness, and biases of AI-based tools and their underlying data sets in providing care to patients and populations; (5) workflow analysis for AI-based tools: analyze and adapt to changes in teams, roles, responsibilities, and workflows resulting from implementation of AI-based tools; and (6) practice-based learning and improvement regarding AI-based tools: participate in continuing professional development and practice-based improvement activities related to use of AI tools in health care. Conclusions: The 6 clinical competencies identified can be used to guide future teaching and learning programs to maximize the potential benefits of AI-based tools and diminish potential harms.

19 March 2021 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
DBDavid W. Bates
David W. Bates
DLDavid Levine
David Levine
ASAnia Syrowatka
Ania Syrowatka
MKMasha Kuznetsova
Masha Kuznetsova
KCKelly Jean Thomas Craig
Kelly Jean Thomas Craig
KRKyu Rhee
Kyu Rhee
Artificial intelligence (AI) represents a valuable tool that could be used to improve the safety of care. Major adverse events in healthcare include: healthcare-associated infections, adverse drug events, venous thromboembolism, surgical complications, pressure ulcers, falls, decompensation, and diagnostic errors. The objective of this scoping review was to summarize the relevant literature and evaluate the potential of AI to improve patient safety in these eight harm domains. A structured search was used to query MEDLINE for relevant articles. The scoping review identified studies that described the application of AI for prediction, prevention, or early detection of adverse events in each of the harm domains. The AI literature was narratively synthesized for each domain, and findings were considered in the context of incidence, cost, and preventability to make projections about the likelihood of AI improving safety. Three-hundred and ninety-two studies were included in the scoping review. The literature provided numerous examples of how AI has been applied within each of the eight harm domains using various techniques. The most common novel data were collected using different types of sensing technologies: vital sign monitoring, wearables, pressure sensors, and computer vision. There are significant opportunities to leverage AI and novel data sources to reduce the frequency of harm across all domains. We expect AI to have the greatest impact in areas where current strategies are not effective, and integration and complex analysis of novel, unstructured data are necessary to make accurate predictions; this applies specifically to adverse drug events, decompensation, and diagnostic errors.

1 December 2019 in Mayo Clinic Proceedings: Innovations, Quality & Outcomes
Verified
Journal Article
Open access
PDPaul F. DeChant
Paul F. DeChant
AAAnnabel Acs
Annabel Acs
KRKyu B. Rhee
Kyu B. Rhee
TBTalia S. Boulanger
Talia S. Boulanger
JSJane L. Snowdon
Jane L. Snowdon
KCKelly Jean Thomas Craig
Kelly Jean Thomas Craig
To assess the impact of organization-directed workplace interventions on physician burnout, including stress or job satisfaction in all settings, we conducted a systematic review of the literature published from January 1, 2007, to October 3, 2018, from multiple databases. Manual searches of grey literature and bibliographies were also performed. Of the 633 identified citations, 50 met inclusion criteria. Four unique categories of organization-directed workplace interventions were identified. Teamwork involved initiatives to incorporate scribes or medical assistants into electronic health record (EHR) processes, expand team responsibilities, and improve communication among physicians. Time studies evaluated the impact of schedule adjustments, duty hour restrictions, and time-banking initiatives. Transitions referred to workflow changes such as process improvement initiatives or policy changes within the organization. Technology related to the implementation or improvement of EHRs. Of the 50 included studies, 35 (70.0%) reported interventions that successfully improved the 3 measures of physician burnout, job satisfaction, and/or stress. The largest benefits resulted from interventions that improved processes, promoted team-based care, and incorporated the use of scribes/medical assistants to complete EHR documentation and tasks. Implementation of EHR interventions to improve clinical workflows worsened burnout, but EHR improvements had positive effects. Time interventions had mixed effects on burnout. The results of our study suggest that organization-directed workplace interventions that improve processes, optimize EHRs, reduce clerical burden by the use of scribes, and implement team-based care can lessen physician burnout. Benefits of process changes can enhance physician resiliency, augment care provided by the team, and optimize the coordination and communication of patient care and health information.

10 June 2021 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
ASAnia Syrowatka
Ania Syrowatka
MKMasha Kuznetsova
Masha Kuznetsova
AAAva Alsubai
Ava Alsubai
ABAdam L. Beckman
Adam L. Beckman
PBPaul A. Bain
Paul A. Bain
DBDavid W. Bates
David W. Bates
Artificial intelligence (AI) represents a valuable tool that could be widely used to inform clinical and public health decision-making to effectively manage the impacts of a pandemic. The objective of this scoping review was to identify the key use cases for involving AI for pandemic preparedness and response from the peer-reviewed, preprint, and grey literature. The data synthesis had two parts: an in-depth review of studies that leveraged machine learning (ML) techniques and a limited review of studies that applied traditional modeling approaches. ML applications from the in-depth review were categorized into use cases related to public health and clinical practice, and narratively synthesized. One hundred eighty-three articles met the inclusion criteria for the in-depth review. Six key use cases were identified: forecasting infectious disease dynamics and effects of interventions; surveillance and outbreak detection; real-time monitoring of adherence to public health recommendations; real-time detection of influenza-like illness; triage and timely diagnosis of infections; and prognosis of illness and response to treatment. Data sources and types of ML that were useful varied by use case. The search identified 1167 articles that reported on traditional modeling approaches, which highlighted additional areas where ML could be leveraged for improving the accuracy of estimations or projections. Important ML-based solutions have been developed in response to pandemics, and particularly for COVID-19 but few were optimized for practical application early in the pandemic. These findings can support policymakers, clinicians, and other stakeholders in prioritizing research and development to support operationalization of AI for future pandemics.

19 January 2021 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
KCKelly Jean Thomas Craig
Kelly Jean Thomas Craig
VWVan C Willis
Van C Willis
DGDavid Gruen
David Gruen
KRKyu Rhee
Kyu Rhee
GJGretchen P Jackson
Gretchen P Jackson
Objective: To conduct a systematic review identifying workplace interventions that mitigate physician burnout related to the digital environment including health information technologies (eg, electronic health records) and decision support systems) with or without the application of advanced analytics for clinical care. Materials and Methods: Literature published from January 1, 2007 to June 3, 2020 was systematically reviewed from multiple databases and hand searches. Subgroup analysis identified relevant physician burnout studies with interventions examining digital tool burden, related workflow inefficiencies, and measures of burnout, stress, or job satisfaction in all practice settings. Results: The search strategy identified 4806 citations of which 81 met inclusion criteria. Thirty-eight studies reported interventions to decrease digital tool burden. Sixty-eight percent of these studies reported improvement in burnout and/or its proxy measures. Burnout was decreased by interventions that optimized technologies (primarily electronic health records), provided training, reduced documentation and task time, expanded the care team, and leveraged quality improvement processes in workflows. Discussion: The contribution of digital tools to physician burnout can be mitigated by careful examination of usability, introducing technologies to save or optimize time, and applying quality improvement to workflows. Conclusion: Physician burnout is not reduced by technology implementation but can be mitigated by technology and workflow optimization, training, team expansion, and careful consideration of factors affecting burnout, including specialty, practice setting, regulatory pressures, and how physicians spend their time.

21 January 2022 in JMIR Medical Informatics
Verified
Journal Article
Open access
VWVan C Willis
Van C Willis
KCKelly Jean Thomas Craig
Kelly Jean Thomas Craig
YJYalda Jabbarpour
Yalda Jabbarpour
ESElisabeth L Scheufele
Elisabeth L Scheufele
YAYull E Arriaga
Yull E Arriaga
ABAndrew Bazemore
Andrew Bazemore
Background: Disease prevention is a central aspect of primary care practice and is comprised of primary (eg, vaccinations), secondary (eg, screenings), tertiary (eg, chronic condition monitoring), and quaternary (eg, prevention of overmedicalization) levels. Despite rapid digital transformation of primary care practices, digital health interventions (DHIs) in preventive care have yet to be systematically evaluated. Objective: This review aimed to identify and describe the scope and use of current DHIs for preventive care in primary care settings. Methods: A scoping review to identify literature published from 2014 to 2020 was conducted across multiple databases using keywords and Medical Subject Headings terms covering primary care professionals, prevention and care management, and digital health. A subgroup analysis identified relevant studies conducted in US primary care settings, excluding DHIs that use the electronic health record (EHR) as a retrospective data capture tool. Technology descriptions, outcomes (eg, health care performance and implementation science), and study quality as per Oxford levels of evidence were abstracted. Results: The search yielded 5274 citations, of which 1060 full-text articles were identified. Following a subgroup analysis, 241 articles met the inclusion criteria. Studies primarily examined DHIs among health information technologies, including EHRs (166/241, 68.9%), clinical decision support (88/241, 36.5%), telehealth (88/241, 36.5%), and multiple technologies (154/241, 63.9%). DHIs were predominantly used for tertiary prevention (131/241, 54.4%). Of the core primary care functions, comprehensiveness was addressed most frequently (213/241, 88.4%). DHI users were providers (205/241, 85.1%), patients (111/241, 46.1%), or multiple types (89/241, 36.9%). Reported outcomes were primarily clinical (179/241, 70.1%), and statistically significant improvements were common (192/241, 79.7%). Results were summarized across the following 5 topics for the most novel/distinct DHIs: population-centered, patient-centered, care access expansion, panel-centered (dashboarding), and application-driven DHIs. The quality of the included studies was moderate to low. Conclusions: Preventive DHIs in primary care settings demonstrated meaningful improvements in both clinical and nonclinical outcomes, and across user types; however, adoption and implementation in the US were limited primarily to EHR platforms, and users were mainly clinicians receiving alerts regarding care management for their patients. Evaluations of negative results, effects on health disparities, and many other gaps remain to be explored.