Levon Utidjian

Levon Utidjian

Auto-generated profile, based on publicly available information

Levon Utidjian

Division of General Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA, United States

Research Focus & Metrics

Academic Career Length

23Years (2004-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2016 in Pediatric Clinics of North America
Verified
Journal Article
Closed access
LULevon Utidjian
Levon Utidjian
EAErika Abramson
Erika Abramson

8 April 2017 in Journal of the American Medical Informatics Association
Verified
Journal Article
Closed access
RKRitu Khare
Ritu Khare
LULevon Utidjian
Levon Utidjian
BRByron J Ruth
Byron J Ruth
MKMichael G Kahn
Michael G Kahn
EBEvanette Burrows
Evanette Burrows
LBL Charles Bailey
L Charles Bailey
Objective: PEDSnet is a clinical data research network (CDRN) that aggregates electronic health record data from multiple children’s hospitals to enable large-scale research. Assessing data quality to ensure suitability for conducting research is a key requirement in PEDSnet. This study presents a range of data quality issues identified over a period of 18 months and interprets them to evaluate the research capacity of PEDSnet. Materials and Methods: Results were generated by a semiautomated data quality assessment workflow. Two investigators reviewed programmatic data quality issues and conducted discussions with the data partners’ extract-transform-load analysts to determine the cause for each issue. Results: The results include a longitudinal summary of 2182 data quality issues identified across 9 data submission cycles. The metadata from the most recent cycle includes annotations for 850 issues: most frequent types, including missing data (>300) and outliers (>100); most complex domains, including medications (>160) and lab measurements (>140); and primary causes, including source data characteristics (83%) and extract-transform-load errors (9%). Discussion: The longitudinal findings demonstrate the network’s evolution from identifying difficulties with aligning the data to a common data model to learning norms in clinical pediatrics and determining research capability. Conclusion: While data quality is recognized as a critical aspect in establishing and utilizing a CDRN, the findings from data quality assessments are largely unpublished. This paper presents a real-world account of studying and interpreting data quality findings in a pediatric CDRN, and the lessons learned could be used by other CDRNs.

30 November 2016 in eGEMs (Generating Evidence & Methods to improve patient outcomes)
Verified
Journal Article
Open access
PDF file
VHVojtech Huser
Vojtech Huser
FDFrank J. DeFalco
Frank J. DeFalco
MSMartijn Schuemie
Martijn Schuemie
PRPatrick B. Ryan
Patrick B. Ryan
NSNing Shang
Ning Shang
CBCharles Bailey
Charles Bailey
Introduction: Data quality and fitness for analysis are crucial if outputs of analyses of electronic health record data or administrative claims data should be trusted by the public and the research community.Methods: We describe a data quality analysis tool (called Achilles Heel) developed by the Observational Health Data Sciences and Informatics Collaborative (OHDSI) and compare outputs from this tool as it was applied to 24 large healthcare datasets across seven different organizations.Results: We highlight 12 data quality rules that identified issues in at least 10 of the 24 datasets and provide a full set of 71 rules identified in at least one dataset. Achilles Heel is a freely available software that provides a useful starter set of data quality rules with the ability to add additional rules. We also present results of a structured email-based interview of all participating sites that collected qualitative comments about the value of Achilles Heel for data quality evaluation.Discussion: Our analysis represents the first comparison of outputs from a data quality tool that implements a fixed (but extensible) set of data quality rules. Thanks to a common data model, we were able to compare quickly multiple datasets originating from several countries in America, Europe and Asia.

3 September 2018 in Statistics in Medicine
Verified
Journal Article
Open access
PDF file
RHRebecca A. Hubbard
Rebecca A. Hubbard
JHJing Huang
Jing Huang
JHJoanna Harton
Joanna Harton
AOArman Oganisian
Arman Oganisian
GCGrace Choi
Grace Choi
YCYong Chen
Yong Chen
Phenotyping, ie, identification of patients possessing a characteristic of interest, is a fundamental task for research conducted using electronic health records. However, challenges to this task include imperfect sensitivity and specificity of clinical codes and inconsistent availability of more detailed data such as laboratory test results. Despite these challenges, most existing electronic health records–derived phenotypes are rule‐based, consisting of a series of Boolean arguments informed by expert knowledge of the disease of interest and its coding. The objective of this paper is to introduce a Bayesian latent phenotyping approach that accounts for imperfect data elements and missing not at random missingness patterns that can be used when no gold‐standard data are available. We conducted simulation studies to compare alternative phenotyping methods under different patterns of missingness and applied these approaches to a cohort of 68 265 children at elevated risk for type 2 diabetes mellitus (T2DM). In simulation studies, the latent class approach had similar sensitivity to a rule‐based approach (95.9% vs 91.9%) while substantially improving specificity (99.7% vs 90.8%). In the PEDSnet cohort, we found that biomarkers and clinical codes were strongly associated with latent T2DM status. The latent T2DM class was also strongly predictive of missingness in biomarkers. Glucose was missing in 83.4% of patients (odds ratio for latent T2DM status = 0.52) while hemoglobin A1c was missing in 91.2% (odds ratio for latent T2DM status = 0.03 ), suggesting missing not at random missingness. The latent phenotype approach may substantially improve on rule‐based phenotyping.

24 January 2019 in eGEMs (Generating Evidence & Methods to improve patient outcomes)
Verified
Journal Article
Open access
RKRitu Khare
Ritu Khare
LULevon H. Utidjian
Levon H. Utidjian
HRHanieh Razzaghi
Hanieh Razzaghi
VSVictoria Soucek
Victoria Soucek
EBEvanette Burrows
Evanette Burrows
LBL Charles Bailey
L Charles Bailey
Background: Clinical data research networks (CDRNs) aggregate electronic health record data from multiple hospitals to enable large-scale research. A critical operation toward building a CDRN is conducting continual evaluations to optimize data quality. The key challenges include determining the assessment coverage on big datasets, handling data variability over time, and facilitating communication with data teams. This study presents the evolution of a systematic workflow for data quality assessment in CDRNs.Implementation: Using a specific CDRN as use case, the workflow was iteratively developed and packaged into a toolkit. The resultant toolkit comprises 685 data quality checks to identify any data quality issues, procedures to reconciliate with a history of known issues, and a contemporary GitHub-based reporting mechanism for organized tracking.Results: During the first two years of network development, the toolkit assisted in discovering over 800 data characteristics and resolving over 1400 programming errors. Longitudinal analysis indicated that the variability in time to resolution (15day mean, 24day IQR) is due to the underlying cause of the issue, perceived importance of the domain, and the complexity of assessment.Conclusions: In the absence of a formalized data quality framework, CDRNs continue to face challenges in data management and query fulfillment. The proposed data quality toolkit was empirically validated on a particular network, and is publicly available for other networks. While the toolkit is user-friendly and effective, the usage statistics indicated that the data quality process is very time-intensive and sufficient resources should be dedicated for investigating problems and optimizing data for research.

1 January 2015 in Applied Clinical Informatics
Verified
Journal Article
Closed access
PDF file
AHA. Hogan
A. Hogan
JMJ. Michel
J. Michel
ALA.R. Localio
A.R. Localio
DKD. Karavite
D. Karavite
LSL. Song
L. Song
LUL.H. Utidjian
L.H. Utidjian
Summary: Background and Objectives: Palivizumab can reduce hospitalizations due to respiratory syncytial virus (RSV), but many eligible infants fail to receive the full 5-dose series. The efficacy of clinical decision support (CDS) in fostering palivizumab receipt has not been studied. We sought a comprehensive solution for identifying eligible patients and addressing barriers to palivizumab administration.Methods: We developed workflow and CDS tools targeting patient identification and palivizumab administration. We randomized 10 practices to receive palivizumab-focused CDS and 10 to receive comprehensive CDS for premature infants in a 3-year longitudinal cluster-randomized trial with 2 baseline and 1 intervention RSV seasons.Results: There were 356 children eligible to receive palivizumab, with 194 in the palivizumab-focused group and 162 in the comprehensive CDS group. The proportion of doses administered to children in the palivizumab-focused intervention group increased from 68.4% and 65.5% in the two baseline seasons to 84.7% in the intervention season. In the comprehensive intervention group, proportions of doses administered declined during the baseline seasons (from 71.9% to 62.4%) with partial recovery to 67.9% during the intervention season. The palivizumab-focused group improved by 19.2 percentage points in the intervention season compared to the prior baseline season (p < 0.001), while the comprehensive intervention group only improved 5.5 percentage points (p = 0.288). The difference in change between study groups was significant (p = 0.05).Conclusions: Workflow and CDS tools integrated in an EHR may increase the administration of palivizumab. The support focused on palivizumab, rather than comprehensive intervention, was more effective at improving palivizumab administration.