Adam Szerencsy

Adam Szerencsy

Auto-generated profile, based on publicly available information

Adam Szerencsy

Department of Health Informatics, Medical Center Information Technology, NYU Langone Health, New York, NY, United States

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 April 2021 in Journal of Medical Internet Research
Verified
Journal Article
Open access
JAJonathan Austrian
Jonathan Austrian
FMFelicia Mendoza
Felicia Mendoza
ASAdam Szerencsy
Adam Szerencsy
LFLucille Fenelon
Lucille Fenelon
LHLeora I Horwitz
Leora I Horwitz
DMDevin M Mann
Devin M Mann
Background: Clinical decision support (CDS) is a valuable feature of electronic health records (EHRs) designed to improve quality and safety. However, due to the complexities of system design and inconsistent results, CDS tools may inadvertently increase alert fatigue and contribute to physician burnout. A/B testing, or rapid-cycle randomized tests, is a useful method that can be applied to the EHR in order to rapidly understand and iteratively improve design choices embedded within CDS tools. Objective: This paper describes how rapid randomized controlled trials (RCTs) embedded within EHRs can be used to quickly ascertain the superiority of potential CDS design changes to improve their usability, reduce alert fatigue, and promote quality of care. Methods: A multistep process combining tools from user-centered design, A/B testing, and implementation science was used to understand, ideate, prototype, test, analyze, and improve each candidate CDS. CDS engagement metrics (alert views, acceptance rates) were used to evaluate which CDS version is superior. Results: To demonstrate the impact of the process, 2 experiments are highlighted. First, after multiple rounds of usability testing, a revised CDS influenza alert was tested against usual care CDS in a rapid (~6 weeks) RCT. The new alert text resulted in minimal impact on reducing firings per patients per day, but this failure triggered another round of review that identified key technical improvements (ie, removal of dismissal button and firings in procedural areas) that led to a dramatic decrease in firings per patient per day (23.1 to 7.3). In the second experiment, the process was used to test 3 versions (financial, quality, regulatory) of text supporting tobacco cessation alerts as well as 3 supporting images. Based on 3 rounds of RCTs, there was no significant difference in acceptance rates based on the framing of the messages or addition of images. Conclusions: These experiments support the potential for this new process to rapidly develop, deploy, and rigorously evaluate CDS within an EHR. We also identified important considerations in applying these methods. This approach may be an important tool for improving the impact of and experience with CDS. Trial Registration: Flu alert trial: ClinicalTrials.gov NCT03415425; https://clinicaltrials.gov/ct2/show/NCT03415425. Tobacco alert trial: ClinicalTrials.gov NCT03714191; https://clinicaltrials.gov/ct2/show/NCT03714191

14 February 2024 in npj Digital Medicine
Verified
Journal Article
Open access
PDF file
SMSoumik Mandal
Soumik Mandal
BWBatia M. Wiesenfeld
Batia M. Wiesenfeld
DMDevin M. Mann
Devin M. Mann
ASAdam C. Szerencsy
Adam C. Szerencsy
EIEduardo Iturrate
Eduardo Iturrate
ONOded Nov
Oded Nov
The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians’ after-hours clinical work ("work-outside-work”). The surge in patients’ digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians’ after-hours commitments. We examined the impact on physicians’ workload from two types of digital demands - patients’ messages requesting medical advice (PMARs) sent to physicians’ inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians’ work-outside-work and that this relationship is moderated by physicians’ specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians’ work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.

27 January 2021 in JMIR Medical Informatics
Verified
Journal Article
Open access
JFJonah Feldman
Jonah Feldman
ASAdam Szerencsy
Adam Szerencsy
DMDevin Mann
Devin Mann
JAJonathan Austrian
Jonathan Austrian
UKUlka Kothari
Ulka Kothari
PTPaul Testa
Paul Testa
Background: The transformation of health care during COVID-19, with the rapid expansion of telemedicine visits, presents new challenges to chronic care and preventive health providers. Clinical decision support (CDS) is critically important to chronic care providers, and CDS malfunction is common during times of change. It is essential to regularly reassess an organization's ambulatory CDS program to maintain care quality. This is especially true after an immense change, like the COVID-19 telemedicine expansion. Objective: Our objective is to reassess the ambulatory CDS program at a large academic medical center in light of telemedicine's expansion in response to the COVID-19 pandemic. Methods: Our clinical informatics team devised a practical framework for an intrapandemic ambulatory CDS assessment focused on the impact of the telemedicine expansion. This assessment began with a quantitative analysis comparing CDS alert performance in the context of in-person and telemedicine visits. Board-certified physician informaticists then completed a formal workflow review of alerts with inferior performance in telemedicine visits. Informaticists then reported on themes and optimization opportunities through the existing CDS governance structure. Results: Our assessment revealed that 10 of our top 40 alerts by volume were not firing as expected in telemedicine visits. In 3 of the top 5 alerts, providers were significantly less likely to take action in telemedicine when compared to office visits. Cumulatively, alerts in telemedicine encounters had an action taken rate of 5.3% (3257/64,938) compared to 8.3% (19,427/233,636) for office visits. Observations from a clinical informaticist workflow review included the following: (1) Telemedicine visits have different workflows than office visits. Some alerts developed for the office were not appearing at the optimal time in the telemedicine workflow. (2) Missing clinical data is a common reason for the decreased alert firing seen in telemedicine visits. (3) Remote patient monitoring and patient-reported clinical data entered through the portal could replace data collection usually completed in the office by a medical assistant or registered nurse. Conclusions: In a large academic medical center at the pandemic epicenter, an intrapandemic ambulatory CDS assessment revealed clinically significant CDS malfunctions that highlight the importance of reassessing ambulatory CDS performance after the telemedicine expansion.

11 January 2024 in Nursing Research
Verified
Journal Article
Closed access
MMMargaret McKeever McCarthy
Margaret McKeever McCarthy
ASAdam Szerencsy
Adam Szerencsy
LTLeslie Taza-Rocano
Leslie Taza-Rocano
SHStephanie Hopkins
Stephanie Hopkins
DMDevin Mann
Devin Mann
SKStuart D. Katz
Stuart D. Katz
Background: Currently, only about half of U.S. adults achieve current physical activity guidelines. Routine physical activity is not regularly assessed, nor are patients routinely counseled by their healthcare provider on achieving recommended levels. The three-question physical activity vital sign (PAVS) was developed to assess physical activity duration and intensity and identify adults not meeting physical activity guidelines. Clinical decision support provided via a best practice advisory in an electronic health record (EHR) system can be triggered as a prompt, reminding healthcare providers to implement the best practice intervention when appropriate. Remote patient monitoring of physical activity can provide objective data in the EHR. Objectives: This study aimed to evaluate the feasibility and clinical utility of embedding the PAVS and a triggered best practice advisor into the EHR in an ambulatory preventive cardiology practice setting to alert providers to patients reporting low physical activity and prompt healthcare providers to counsel these patients as needed. Methods: Three components based in the EHR were integrated for the purpose of this study: Patients completed the PAVS through their electronic patient portal prior to an office visit, a best practice advisory was created to prompt providers to counsel patients who reported low levels of physical activity, and remote patient monitoring via Fitbit synced to the EHR provided objective physical activity data. The intervention was pilot-tested in the Epic EHR for 1 year (July 1, 2021 to June 30, 2022). Qualitative feedback on the intervention from both providers and patients was obtained at the completion of the study. Results: Monthly assessments of the use of the PAVS and best practice advisory and remote patient monitoring were completed. Patients’ completion of the PAVS varied from 35% to 48% per month. The best practice advisory was signed by providers between 2% and 65% and was acknowledged by 2%–22% per month. The majority (58%) of patients were able to sync a Fitbit device to their EHR for remote monitoring. Discussion: Although uptake of each component needs improvement, this pilot demonstrated the feasibility of incorporating a physical activity promotion intervention into the EHR. Qualitative feedback provided guidance for future implementation.

20 November 2025 in JMIR Medical Informatics
Verified
Journal Article
Open access
ESElizabeth R Stevens
Elizabeth R Stevens
JHJager Hartman
Jager Hartman
PTPaul Testa
Paul Testa
AMAjay Mansukhani
Ajay Mansukhani
CMCasey Monina
Casey Monina
ASAdam Szerencsy
Adam Szerencsy
Background: With rising patient volumes and a focus on quality, our health system had the objective to create a more efficient way to ensure accurate documentation of colorectal cancer (CRC) screening intervals from inbound colonoscopy reports to ensure timely follow-up. We developed an integrated end-to-end workflow solution using machine learning (ML) and robotic process automation (RPA) to extract and update electronic health record (EHR) follow-up dates from unstructured data. Objective: This study aimed to automate data extraction from external, free-text colonoscopy reports to identify and document recommended follow-up dates for CRC screening in structured EHR fields. Methods: As proof of concept, we outline the process development, validity, and implementation of an approach that integrates available tools to automate data retrieval and entry within the EHR of a large academic health system. The health system uses Epic Systems as its EHR platform, and the ML model used was trained on health system patient colonoscopy reports. This proof-of-concept process study consisted of six stages: (1) identification of gaps in documenting recommendations for follow-up CRC screening from external colonoscopy reports, (2) defining process objectives, (3) identification of technologies, (4) creation of process architecture, (5) process validation, and (6) health system–wide implementation. A chart review was performed to validate process outcomes and estimate impact. Results: We developed an automated process with 3 primary steps leveraging ML and RPA to create a fully orchestrated workflow to update CRC screening recall dates based on colonoscopy reports received from external sources. Process validity was assessed with 690 scanned colonoscopy reports. During process validation, the overall automated process achieved an accuracy of 80.7% (557/690, 95% CI 77.8%-83.7%) for correctly identifying the presence or absence of a valid follow-up date and a follow-up date false negative identification rate of 32.9% (130/395, 95% CI 29.4%-36.4%). From the organization-wide implementation to go-live until December 31, 2024, the system processed 16,563 external colonoscopy reports. Of these, 35.3% (5841/16,563) had a follow-up date meeting the relevant ML model threshold and thus were identified as ready for RPA processing. Conclusions: Implementation of an automated workflow to extract and update CRC screening follow-up dates from colonoscopy reports is feasible and has the potential to improve accuracy in patient recall while reducing documentation burden. By standardizing data ingestion, extending this approach to various unstructured data types can address deficiencies in structured EHR documentation and solve for a lack of data integration and reporting for quality measures. Automated workflows leveraging ML and RPA offer practical solutions to overcome interoperability challenges and the use of unstructured data within health care systems.

5 March 2025 in JMIR Preprints
Verified
Preprint
Open access
ESElizabeth R Stevens
Elizabeth R Stevens
JHJager Hartman
Jager Hartman
PTPaul Testa
Paul Testa
AMAjay Mansukhani
Ajay Mansukhani
CMCasey Monina
Casey Monina
ASAdam Szerencsy
Adam Szerencsy
BACKGROUND Effective Colorectal cancer (CRC) screening is a cornerstone of preventive healthcare. Existing electronic health record (EHR) tools to facilitate reminders for CRC screening follow-up are inadequate to address clinician needs. With rising patient volumes and a focus on quality, our health system had the objective to create a more efficient way to ensure accurate documentation of CRC screening follow-up intervals from inbound colonoscopy reports. We developed an integrated end-to-end workflow solution using machine learning (ML) and robotic process automation (RPA) to extract and update follow-up dates from unstructured data. OBJECTIVE To automate data extraction from external, free-text colonoscopy reports to identify and document recommended follow-up dates for CRC screening in structured fields within the EHR. METHODS As proof of concept, we outline the process development, validity, and implementation of an approach that integrates available tools to automate data retrieval and entry within the EHR of a large academic health system. The health system uses Epic Systems as its EHR platform. This proof-of-concept process study consisted of six stages: 1) identification of gaps in documenting recommendations for follow-up CRC screening from external colonoscopy reports; 2) defining process objectives; 3) identification of technologies; 4) creation of process architecture; 5) process validation; and 6) health system-wide implementation. Chart review was performed to validate process outcomes and estimate impact. RESULTS We developed an automated process with three primary steps that leveraged ML and RPA to create a fully orchestrated workflow to update the CRC screening recall date based on colonoscopy reports received from external sources. Process validity was assessed with 690 scanned colonoscopy reports. From the organization-wide implementation go-live date until December 31st, 2024, the system has processed 16,563 external colonoscopy reports. Of these 35.3% (5841) had a follow-up date that met the relevant threshold by the ML model and thus were identified as ready for RPA processing. This resulted in an estimated increase in documentation accuracy of 27.2%. CONCLUSIONS The implementation of an automated workflow to extract and update CRC screening follow-up dates from external colonoscopy reports is feasible and has the potential to improve accuracy in patient recall based on recommendations while reducing clinician documentation burden. Expanding similar processes to other types of unstructured data could provide another mechanism to solve for a lack of data integration and improve reporting for quality measures within the EHR. Automated workflows leveraging ML and RPA offer practical solutions to overcome interoperability challenges and enhance the use of unstructured data within healthcare systems.