To examine whether current validation methods of emergency department triage scales actually assess the instrument's validity. Optimal methods of emergency department triage scale validation are examined in developed countries and their application to developing countries is considered. Numerous limitations are embedded in the process of validating triage scales. Methods of triage scale validation in developed countries may not be appropriate and repeatable in developing countries. Even in developed countries there are problems in conceptualising validation methods. A new consensus building validation approach has been constructed and recommended for a developing country setting. The Delphi method, a consensual validation process, is advanced as a more appropriate alternative for validating triage scales in developing countries.
Despite the high burden of pediatric mortality from preventable conditions in low and middle income countries and the existence of multiple tools to prioritize critically ill children in low-resource settings, no analysis exists of the reliability and validity of these tools in identifying critically ill children in these scenarios. The authors performed a systematic search of the peer-reviewed literature published, for studies pertaining to for triage and IMCI in low and middle-income countries in English language, from January 01, 2000 to October 22, 2013. An updated literature search was performed on on July 1, 2015. The databases searched included the Cochrane Library, EMBASE, Medline, PubMed and Web of Science. Only studies that presented data on the reliability and validity evaluations of triage tool were included in this review. Two independent reviewers utilized a data abstraction tool to collect data on demographics, triage tool components and the reliability and validity data and summary findings for each triage tool assessed. Of the 4,717 studies searched, seven studies evaluating triage tools and 10 studies evaluating IMCI were included. There were wide varieties in method for assessing reliability and validity, with different settings, outcome metrics and statistical methods. Studies evaluating triage tools for pediatric patients in low and middle income countries are scarce. Furthermore the methodology utilized in the conduct of these studies varies greatly and does not allow for the comparison of tools across study sites.
Triage protocols standardize and improve patient care in accident and emergency departments (A&Es). Kenyatta National Hospital (KNH), the largest public tertiary hospital in East Africa, is resource-limited and was without A&E-specific triage protocols. We sought to standardize patient triage through implementation of the South African Triage Scale (SATS). We aimed to (1) assess the reliability of triage decisions among A&E healthcare workers following an educational intervention and (2) analyze the validity of the SATS in KNH’s A&E. Part 1 was a prospective, before and after trial utilizing an educational intervention and assessing triage reliability using previously validated vignettes administered to 166 healthcare workers. Part 2 was a triage chart review wherein we assessed the validity of the SATS in predicting patient disposition outcomes by inclusion of 2420 charts through retrospective, systematic sampling. Healthcare workers agreed with an expert defined triage standard for 64% of triage scenarios following an educational intervention, and had a 97% agreement allowing for a one-level discrepancy in the SATS score. There was “good” inter-rater agreement based on an intraclass correlation coefficient and quadratic weighted kappa. We analyzed 1209 pre-SATS and 1211 post-SATS patient charts and found a non-significant difference in undertriage and statistically significant decrease in overtriage rates between the pre- and post-SATS cohorts (undertriage 3.8 and 7.8%, respectively, p = 0.2; overtriage 70.9 and 62.3%, respectively, p < 0.05). The SATS had a sensitivity of 92.2% and specificity of 37.7% for predicting admission, death, or discharge in the A&E. Healthcare worker triage decisions using the SATS were more consistent with expert opinion following an educational intervention. The SATS also performed well in predicting outcomes with high sensitivity and satisfactory levels of both undertriage and overtriage, confirming the SATS as a contextually appropriate triage system at a major East African A&E.