In accordance with the People’s Republic of China’s (China) National Health Reform Plan of 2009, two of the nation’s leading hospitals, located in Beijing, have implemented electronic medical record (EMR) systems from different vendors.

Summary: Background: Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned.Objective: Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks.Method: A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR.Results: The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged.Conclusions: We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

A new survey instrument was developed and validated to measure clinician (nurse) satisfaction with electronic health record impact on clinical process. The Health Information Technology Reference-Based Evaluation Framework guided the selection of evaluation dimensions for the survey. Survey questions were gathered from existing health information technology satisfaction surveys that reflected individual evaluation concepts, such as efficiency or benefits. Decisions about data-gathering methods (e.g., item selection) were made based on reviews of literature and surveys of clinician satisfaction with health information technology and expert input. Preliminary instrument validation was accomplished using qualitative and statistical analysis of five repeated sets of responses from clinicians at the pilot site and field administrations repeated twice at electronic health record implementation and paper-based comparison sites and by analyzing convergent evidence from observations and interviews. Reliability was assessed on one sample: 30 graduate nursing students at the single pilot site. Validity was assessed on three separate samples: (1) graduate nursing students (n = 30), (2) field test at a site with electronic health record (n = 39 participants), and (3) field test at a paper-based site (n = 17). The implementation and comparison sites are Program of All-Inclusive Care for the Elderly that provide managed day care for frail elderly. Survey responses were assessed for test-retest reliability, internal consistency, and content and construct validity. The instrument design enables its administration before and after electronic health record implementation. Work to date suggests the instrument is reliable and valid; it is offered to electronic health record evaluators for further testing and application.

Background/Purpose: Adolescents from urban, socioeconomically disadvantaged communities of color encounter high rates of adverse childhood experiences. To address the resulting multidimensional problems, we developed an innovative approach, Experiential Participatory and Interactive Knowledge Elicitation (EPIKE), using remote experiential needs elicitation methods to generate design and content requirements for a mobile health (mHealth) psychoeducational intervention. Methods: At a community-based organization in a northeastern city, the research team developed EPIKE by incorporating elicitation of input on the graphics and conducting remotely recorded experiential meetings and iterative reviews of the design to produce an mHealth smartphone story application (app) prototype for the participants to critique. The 22 participants were 13- to 17-year-olds, predominantly African American and female, from underresourced communities. Results: The four goals of the design process were attained: 1) story development from participant input; 2) needs-elicitation that reflected the patient-centered care approach; 3) interactive story game creation that accommodates the participants’ emotional and cognitive developmental needs; 4) development of a game that adolescents can relate to and that which matches their comfort levels of emotional intensity. Conclusions: The EPIKE approach can be used successfully to identify the needs of adolescents across the digital divide to inform the design and development of mHealth apps.

Electronic health records (EHRs), intended to improve the clinical process, are understudied in home care. The researchers assessed clinician satisfaction, informed by workflow and patient outcomes, to identify EHR adoption challenges. The mixed methods study setting was a Philadelphia agency with 137 clinicians. Adoption challenges included: (a) hardware problems coupled with lack of field support; (b) inadequate training; and (c) mismatch of EHR usability/functionality and workflow resulting in decreased efficiency. Adoption facilitators were support for team communication and improved clinical data timeliness. Opportunities for improved adoption included sharing with front-line clinicians EHR data related to patient care and health outcomes.