Bibliometrics is the study of academic publishing that uses statistics to describe publishing trends and to highlight relationships between published works. Likened to epidemiology, researchers seek to answer questions about a field based on data about publications (e.g., authors, topics, funding) in the same way that an epidemiologist queries patient data to understand the health of a population. In this Eye Opener, the authors introduce bibliometrics and define its key terminology and concepts, including relational and evaluative bibliometrics. Readers are introduced to common bibliometric methods and their related strengths and weaknesses. The authors provide examples of bibliometrics applied in health professions education and propose potential future research directions. Health professions educators are consumers of bibliometric reports and can adopt its methodologies for future studies.

The learning environment (LE) is an important and frequently discussed topic in the health professions education literature. However, there is considerable inconsistency in how the LE is defined and described. The authors propose a definition of the LE and a conceptual framework to facilitate health professions educators in understanding, studying, and designing interventions to improve the LE. To arrive at this conceptual framework, the authors employed a living systems perspective that draws on various frameworks and theories, including ecological psychology, workplace learning, situated cognition, and sociomateriality theory. The conceptual framework identifies five overlapping and interactive core components that form two dimensions: the psychosocial dimension and material dimension. The psychosocial dimension comprises three components: the personal, social, and organizational. Intertwined with the psychosocial dimension at each level is the material dimension, which encompasses physical and virtual spaces. This theoretical lens can facilitate identifying and analyzing problems in the LE and guide development of interventions to mitigate them. The authors conclude with several practical suggestions for health professions educators, investigators, and editors.

Introduction The use of social media is rapidly changing how educational content is delivered and knowledge is translated for physicians and trainees. This scoping review aims to aggregate and report trends on how health professions educators harness the power of social media to engage physicians for the purposes of knowledge translation and education. Methods A scoping review was conducted by searching four databases (PubMed, Scopus, Embase, and ERIC) for publications emerging between 1990 to March 2018. Articles about social media usage for teaching physicians or their trainees for the purposes of knowledge translation or education were included. Relevant themes and trends were extracted and mapped for visualization and reporting, primarily using the Cook, Bordage, and Schmidt framework for types of educational studies (Description, Justification, and Clarification). Results There has been a steady increase in knowledge translation and education-related social media literature amongst physicians and their trainees since 1996. Prominent platforms include Twitter (n = 157), blogs (n = 104), Facebook (n = 103), and podcasts (n = 72). Dominant types of scholarship tended to be descriptive studies and innovation reports. Themes related to practice improvement, descriptions of the types of technology, and evidence-based practice were prominently featured. Conclusions Social media is ubiquitously used for knowledge translation and education targeting physicians and physician trainees. Some best practices have emerged despite the transient nature of various social media platforms. Researchers and educators may engage with physicians and their trainees using these platforms to increase uptake of new knowledge and affect change in the clinical environment.

To characterize recent evidence-based medicine (EBM) educational interventions for medical students and suggest future directions for EBM education. The authors searched the MEDLINE, Scopus, Educational Resource Information Center, and Evidence-Based Medicine Reviews databases for English-language articles published between 2006 and 2011 that featured medical students and interventions addressing multiple EBM skills. They extracted data on learner and instructor characteristics, educational settings, teaching methods, and EBM skills covered. The 20 included articles described interventions delivered in 12 countries in classroom (75%), clinic (25%), and/or online (20%) environments. The majority (60%) focused on clinical students, whereas 30% targeted preclinical students and 10% included both. EBM skills addressed included recognizing a knowledge gap (20%), asking a clinical question (90%), searching for information (90%), appraising information (85%), applying information (65%), and evaluating practice change (5%). Physicians were most often identified as instructors (60%); co-teachers included librarians (20%), allied health professionals (10%), and faculty from other disciplines (10%). Many studies (60%) included interventions at multiple points during one year, but none were longitudinal across students’ tenures. Teaching methods varied. Intervention efficacy could not be determined. Settings, learner levels and instructors, teaching methods, and covered skills differed across interventions. Authors writing about EBM interventions should include detailed descriptions and employ more rigorous research methods to allow others to draw conclusions about efficacy. When designing EBM interventions, educators should consider trends in medical education (e.g., online learning, interprofessional education) and in health care (e.g., patient-centered care, electronic health records).

Introduction Programmatic assessment was introduced as an approach to design assessment programmes with the aim to simultaneously optimize the decision-making and learning function of assessment. An integrative review was conducted to review and synthesize results from studies investigating programmatic assessment in health care professions education in practice. Methods The authors systematically searched PubMed, Web of Science, and ERIC to identify studies published since 2005 that reported empirical data on programmatic assessment. Characteristics of the included studies were extracted and synthesized, using descriptive statistics and thematic analysis. Results Twenty-seven studies were included, which used quantitative methods (n = 10), qualitative methods (n = 12) or mixed methods (n = 5). Most studies were conducted in clinical settings (77.8%). Programmatic assessment was found to enable meaningful triangulation for robust decision-making and used as a catalyst for learning. However, several problems were identified, including overload in assessment information and the associated workload, counterproductive impact of using strict requirements and summative signals, lack of a shared understanding of the nature and purpose of programmatic assessment, and lack of supportive interpersonal relationships. Thematic analysis revealed that the success and challenges of programmatic assessment were best understood by the interplay between quantity and quality of assessment information, and the influence of social and personal aspects on assessment perceptions. Conclusion Although some of the evidence may seem compelling to support the effectiveness of programmatic assessment in practice, tensions will emerge when simultaneously stimulating the development of competencies and assessing its result. The identified factors and inferred strategies provide guidance for navigating these tensions.

Purpose: Entrustable professional activities (EPAs) are a hot topic in undergraduate medical education (UME); however, the usefulness of EPAs as an assessment approach remains unclear. The authors sought to better understand the literature on EPAs in UME through the lens of the 2010 Ottawa Conference Criteria for Good Assessment. Method: The authors conducted a scoping review of the health professions literature (search updated February 2018), mapping publications to the Ottawa Criteria using a collaboratively designed charting tool. Results: Of the 1,089 publications found, 71 (6.5%) met inclusion criteria. All were published after 2013. Forty-five (63.4%) referenced the 13 Core Entrustable Professional Activities for Entering Residency developed by the Association of American Medical Colleges (AAMC). Forty (56.3%) were perspectives, 5 (7.0%) were reviews, and 26 (36.6%) were prospective empirical studies. The publications mapped to the Ottawa Criteria 158 times. Perspectives mapped more positively (83.7%) than empirical studies (76.7%). Reproducibility did not appear to be a strength of EPAs in UME; however, reproducibility, equivalence, educational effect, and catalytic effect all require further study. Inconsistent use of the term “EPA” and conflation of concepts (activity vs assessment vs advancement decision vs curricular framework) limited interpretation of published results. Overgeneralization of the AAMC’s work on EPAs has influenced the literature. Conclusions: Much has been published on EPAs in UME in a short time. Now is the time to move beyond opinion, clarify terms, and delineate topics so that well-designed empirical studies can demonstrate if and how EPAs should be implemented in UME.