Clinical lung ultrasound examinations are widely used in the primary assessment or monitoring of patients with dyspnoea or respiratory failure. Despite being increasingly implemented, there is no international consensus on education, assessment of competencies, and certification. Today, training is usually based on the concept of mastery learning, but is often unstructured and limited by bustle in a clinical daily life. The aim of the systematic review is to provide an overview of published learning studies in clinical lung ultrasound, and to collect evidence for future recommendations in lung ultrasound education and certification. According to PRISMA guidelines, three databases (PubMed, Embase, Cochrane Library) were searched, and two reviewers examined the results for eligibility. Included publications were described and assessed for level of evidence and risk of bias according to guidelines from Oxford Centre for Evidence-Based Medicine and Cochrane Collaboration Tool for Risk of Bias assessment. Of 7796 studies screened, 16 studies were included. Twelve pre- and post-test studies, three descriptive studies and one randomized controlled trial were identified. Seven studies included web-based or online modalities, while remaining used didactic or classroom-based lectures. Twelve (75%) studies provided hands-on sessions, and of these, 11 assessed participants’ hands-on skills. None of the studies used validated neither written nor practical assessment. The highest level of evidence score was 2 (n = 1), remaining scored 4 (n = 15). Risk of bias was assessed high in 11 of 16 studies (68.75%). All educational methods proved increased theoretical and practical knowledge obtained at the ultrasound courses, but the included studies were substantial heterogeneous in setup, learning-, and assessment methods, and outcome measures. On behalf of current published studies, it was not possible to construct clear guidelines for the future education and certification in clinical lung ultrasound, but the use of different hands-on training facilities tends to contribute to different aspects of the learning process. This systematic review proves a lack of learning studies within this content, and research with validated theoretical and practical tests for assessment is desired.

Background: The use of simulators in a training programme for technically challenging procedures has the advantages of lowering the risk of patient complications while helping the trainees with the initial part of their learning curve. Objectives: The aim of this study was to perform a systematic review of simulation-based training in flexible bronchoscopy and endobronchial ultrasound (EBUS). Methods: We identified 1,006 publications in the PubMed database and included publications on flexible bronchoscopy below the carina and EBUS involving hands-on simulation-based training. Publications were excluded if they were written in languages other than English, if paediatric airways were involved or if they were not journal articles. The screening process was performed by 2 individuals, and a third reviewer made the final decision in case of disagreement. Results: We included 30 publications. The studies included participants of varying experience and most commonly used a virtual reality simulator as a training modality. Assessment of the participants' skills was based on simulator metrics or on an assessment tool. Some studies included performance on patients for assessment of the operator after training on a simulator. Conclusions: Simulation-based training was demonstrated to be more efficient than the traditional apprenticeship model. Physical models and virtual reality simulators complement each other. Simulation-based education should be based on a mastery learning approach and structured as directed self-regulated learning in a distributed training programme.

Background: In a prehospital setting, the severity of respiratory symptoms in patients calling for an ambulance differ. The initial evaluation, diagnosing, and thereby management can be challenging because respiratory symptoms can be caused by disease in many organs. Ultrasound examinations can contribute with important information and support the clinical decision-making. However, ultrasound is user-dependent and requires sufficient knowledge and training. The aim of this study was to explore the quality of thoracic ultrasound examinations performed on patients by emergency medical technicians and paramedics in a prehospital, clinical setting. Methods: From November 2018 – April 2020, Danish emergency medical technicians and paramedics (n = 100) performed thoracic ultrasound examinations on patients with respiratory symptoms using a portable ultrasound device. The ultrasound examinations were stored and retrospectively assessed by a reviewer blinded to the patients’ symptoms and history, as well as the emergency medical technicians’ and paramedics’ findings. The image quality was scored from 1 to 5. The findings determined by the reviewer was then correlated with a questionnaire filled out by the emergency medical technicians and paramedics regarding ultrasonic findings and potential change in treatment or management of the patient. The agreement in percentage and as Cohen’s kappa was explored. Results: A total of 590 ultrasound examinations were assessed, resulting in a median image quality score of 3 (IQ1 = 4, IQ3 = 3). The overall agreement in percentage between the emergency medical technicians and paramedics and reviewer was high (87.7% for a normal scan, 89.9% for interstitial syndrome, 97.3% for possible pneumothorax, and 96.3% for pleural effusion). Cohen’s kappa varied from 0.01 for possible pneumothorax to 0.69 for pleural effusion. Based on the questionnaires (n = 406), the ultrasound examination entailed a change in treatment or visitation in 48 cases (11.7%) which in this study population encompasses a number-needed-to-scan of 8.5. Conclusion: Emergency medical technicians and paramedics perform focused thoracic ultrasound examinations with adequate image quality sufficient to determine if pathology is present or not. The emergency medical technicians’ and paramedics’ assessment correlates to some extent with an experienced reviewer and their findings are most reliable for the inclusion of a normal scan or inclusion of pleural effusion. Implementation could possibly impact the number of patients receiving correct prehospital treatment and optimal choice of receiving facility.

Objective: This systematic review aims to examine the use of standard-setting methods in the context of simulation-based training of surgical procedures. Summary of background: Simulation-based training is increasingly used in surgical education. However, it is important to determine which level of competency trainees must reach during simulation-based training before operating on patients. Therefore, pass/fail standards must be established using systematic, transparent, and valid methods. Methods: Systematic literature search was done in 4 databases (Ovid MEDLINE, Embase, Web of Science, and Cochrane Library). Original studies investigating simulation-based assessment of surgical procedures with the application of a standard setting were included. Quality of evidence was appraised using GRADE. Results: Of 24,299 studies identified by searches, 232 studies met the inclusion criteria. Publications using already established standard settings were excluded (N = 70), resulting in 162 original studies included in the final analyses. Most studies described how the standard setting was determined (N = 147, 91%) and most used the mean or median performance score of experienced surgeons (n = 65, 40%) for standard setting. We found considerable differences across most of the studies regarding study design, setup, and expert level classification. The studies were appraised as having low and moderate evidence. Conclusion: Surgical education is shifting toward competency-based education, and simulation-based training is increasingly used for acquiring skills and assessment. Most studies consider and describe how standard settings are established using more or less structured methods but for current and future educational programs, a critical approach is needed so that the learners receive a fair, valid, and reliable assessment.

Background: Point-of-care ultrasound is a focus oriented tool for differentiating among cardiopulmonary diseases. Its value in the hands of emergency physicians, with various ultrasound experience, remains uncertain. We tested the hypothesis that, in emergency department patients with signs of respiratory failure, a point-of-care cardiopulmonary ultrasound along with standard clinical examination, performed by emergency physicians with various ultrasound experience would increase the proportion of patients with presumptive diagnoses in agreement with final diagnoses at four hours after admission compared to standard clinical examination alone. Methods: In this prospective multicenter superiority trial in Danish emergency departments we randomly assigned patients presenting with acute signs of respiratory failure to intervention or control in a 1:1 ratio by block randomization. Patients received point-of-care cardiopulmonary ultrasound examination within four hours from admission. Ultrasound results were unblinded for the treating emergency physician in the intervention group. Final diagnoses and treatment were determined by blinded review of the medical record after the patients´ discharge. Results: From October 9, 2015 to April 5, 2017, we randomized 218 patients and included 211 in the final analyses. At four hours we found; no change in the proportion of patients with presumptive diagnoses in agreement with final diagnoses; intervention 79·25% (95% CI 70·3–86·0), control 77·1% (95% CI 68·0–84·3), an increased proportion of appropriate treatment prescribed; intervention 79·3% (95% CI 70·3–86·0), control 65·7% (95% CI 56·0–74·3) and of patients who spent less than 1 day in hospital; intervention n = 42 (39·6%, 25·8 38·4), control n = 25 (23·8%, 16·5–33·0). No adverse events were reported. Conclusions: Focused cardiopulmonary ultrasound added to standard clinical examination in patients with signs of respiratory failure had no impact on the diagnostic accuracy, but significantly increased the proportion of appropriate treatment prescribed and the proportion of patients who spent less than 1 day in hospital. Trial registration: https://clinicaltrials.gov/, number NCT 02550184.