Nicole Gray Weiskopf

Nicole Gray Weiskopf

Auto-generated profile, based on publicly available information

Nicole Gray Weiskopf

Oregon Health & Science University

Research Focus & Metrics

Academic Career Length

19Years (2008-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2013 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
NWNicole Gray Weiskopf
Nicole Gray Weiskopf
CWChunhua Weng
Chunhua Weng
Objective To review the methods and dimensions of data quality assessment in the context of electronic health record (EHR) data reuse for research.Ma

11 September 2016 in eGEMs (Generating Evidence & Methods to improve patient outcomes)
Verified
Journal Article
Open access
PDF file
MKMichael G. Kahn
Michael G. Kahn
Tiffany Jean Lee CallahanTiffany Jean Lee Callahan
Tiffany Jean Lee Callahan
JBJuliana Barnard
Juliana Barnard
ABAlan E. Bauck
Alan E. Bauck
JBJeffrey Brown
Jeffrey Brown
LSLisa Schilling
Lisa Schilling
Objective: Harmonized data quality (DQ) assessment terms, methods, and reporting practices can establish a common understanding of the strengths and limitations of electronic health record (EHR) data for operational analytics, quality improvement, and research. Existing published DQ terms were harmonized to a comprehensive unified terminology with definitions and examples and organized into a conceptual framework to support a common approach to defining whether EHR data is ‘fit’ for specific uses.Materials and Methods: DQ publications, informatics and analytics experts, managers of established DQ programs, and operational manuals from several mature EHR-based research networks were reviewed to identify potential DQ terms and categories. Two face-to-face stakeholder meetings were used to vet an initial set of DQ terms and definitions that were grouped into an overall conceptual framework. Feedback received from data producers and users was used to construct a draft set of harmonized DQ terms and categories. Multiple rounds of iterative refinement resulted in a set of terms and organizing framework consisting of DQ categories, subcategories, terms, definitions, and examples. The harmonized terminology and logical framework’s inclusiveness was evaluated against ten published DQ terminologies.Results: Existing DQ terms were harmonized and organized into a framework by defining three DQ categories: (1) Conformance (2) Completeness and (3) Plausibility and two DQ assessment contexts: (1) Verification and (2) Validation. Conformance and Plausibility categories were further divided into subcategories. Each category and subcategory was defined with respect to whether the data may be verified with organizational data, or validated against an accepted gold standard, depending on proposed context and uses. The coverage of the harmonized DQ terminology was validated by successfully aligning to multiple published DQ terminologies.Discussion: Existing DQ concepts, community input, and expert review informed the development of a distinct set of terms, organized into categories and subcategories. The resulting DQ terms successfully encompassed a wide range of disparate DQ terminologies. Operational definitions were developed to provide guidance for implementing DQ assessment procedures. The resulting structure is an inclusive DQ framework for standardizing DQ assessment and reporting. While our analysis focused on the DQ issues often found in EHR data, the new terminology may be applicable to a wide range of electronic health data such as administrative, research, and patient-reported data.Conclusion: A consistent, common DQ terminology, organized into a logical framework, is an initial step in enabling data owners and users, patients, and policy makers to evaluate and communicate data quality findings in a well-defined manner with a shared vocabulary. Future work will leverage the framework and terminology to develop reusable data quality assessment and reporting methods.

1 October 2013 in Journal of Biomedical Informatics
Verified
Journal Article
Open access
NWNicole G. Weiskopf
Nicole G. Weiskopf
GHGeorge Hripcsak
George Hripcsak
SSSushmita Swaminathan
Sushmita Swaminathan
CWChunhua Weng
Chunhua Weng
We demonstrate the importance of explicit definitions of electronic health record (EHR) data completeness and how different conceptualizations of completeness may impact findings from EHR-derived datasets. This study has important repercussions for researchers and clinicians engaged in the secondary use of EHR data. We describe four prototypical definitions of EHR completeness: documentation, breadth, density, and predictive completeness. Each definition dictates a different approach to the measurement of completeness. These measures were applied to representative data from NewYork-Presbyterian Hospital's clinical data warehouse. We found that according to any definition, the number of complete records in our clinical database is far lower than the nominal total. The proportion that meets criteria for completeness is heavily dependent on the definition of completeness used, and the different definitions generate different subsets of records. We conclude that the concept of completeness in EHR is contextual. We urge data consumers to be explicit in how they define a complete record and transparent about the limitations of their data.

30 June 2023 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
ALAbigail E Lewis
Abigail E Lewis
NWNicole Weiskopf
Nicole Weiskopf
ZAZachary B Abrams
Zachary B Abrams
RFRandi Foraker
Randi Foraker
ALAlbert M Lai
Albert M Lai
AGAditi Gupta
Aditi Gupta
Objective: We extended a 2013 literature review on electronic health record (EHR) data quality assessment approaches and tools to determine recent improvements or changes in EHR data quality assessment methodologies. Materials and Methods: We completed a systematic review of PubMed articles from 2013 to April 2023 that discussed the quality assessment of EHR data. We screened and reviewed papers for the dimensions and methods defined in the original 2013 manuscript. We categorized papers as data quality outcomes of interest, tools, or opinion pieces. We abstracted and defined additional themes and methods though an iterative review process. Results: We included 103 papers in the review, of which 73 were data quality outcomes of interest papers, 22 were tools, and 8 were opinion pieces. The most common dimension of data quality assessed was completeness, followed by correctness, concordance, plausibility, and currency. We abstracted conformance and bias as 2 additional dimensions of data quality and structural agreement as an additional methodology. Discussion: There has been an increase in EHR data quality assessment publications since the original 2013 review. Consistent dimensions of EHR data quality continue to be assessed across applications. Despite consistent patterns of assessment, there still does not exist a standard approach for assessing EHR data quality. Conclusion: Guidelines are needed for EHR data quality assessment to improve the efficiency, transparency, comparability, and interoperability of data quality assessment. These guidelines must be both scalable and flexible. Automation could be helpful in generalizing this process.

1 March 2014 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
APAdler Perotte
Adler Perotte
RPRimma Pivovarov
Rimma Pivovarov
KNKarthik Natarajan
Karthik Natarajan
NWNicole Weiskopf
Nicole Weiskopf
FWFrank Wood
Frank Wood
NENoémie Elhadad
Noémie Elhadad
Background and objective The volume of healthcare data is growing rapidly with the adoption of health information technology. We focus on automated ICD9 code as

8 May 2018 in Journal of General Internal Medicine
Verified
Journal Article
Closed access
PDF file
SVStephanie Veazie
Stephanie Veazie
KWKara Winchell
Kara Winchell
JGJennifer Gilbert
Jennifer Gilbert
RPRobin Paynter
Robin Paynter
IIIlya Ivlev
Ilya Ivlev
MHMark Helfand
Mark Helfand