To assess the strength of root cause analysis (RCA) recommendations and their perceived levels of effectiveness and sustainability. All RCAs related to sentinel events (SEs) undertaken between the years 2010 and 2015 in the public health system in Victoria, Australia were analysed. The type and strength of each recommendation in the RCA reports were coded by an expert patient safety classifier using the US Department of Veteran Affairs type and strength criteria. Thirty-six public health services. The proportion of RCA recommendations which were classified as ‘strong’ (more likely to be effective and sustainable), ‘medium’ (possibly effective and sustainable) or ‘weak’ (less likely to be effective and sustainable). There were 227 RCAs in the period of study. In these RCAs, 1137 recommendations were made. Of these 8% were ‘strong’, 44% ‘medium’ and 48% were ‘weak’. In 31 RCAs, or nearly 15%, only weak recommendations were made. In 24 (11%) RCAs five or more weak recommendations were made. In 165 (72%) RCAs no strong recommendations were made. The most frequent recommendation types were reviewing or enhancing a policy/guideline/documentation, and training and education. Only a small proportion of recommendations arising from RCAs in Victoria are ‘strong’. This suggests that insights from the majority of RCAs are not likely to inform practice or process improvements. Suggested improvements include more human factors expertise and independence in investigations, more extensive application of existing tools that assist teams to prioritize recommendations that are likely to be effective, and greater use of observational and simulation techniques to understand the underlying systems factors. Time spent in repeatedly investigating similar incidents may be better spent aggregating and thematically analysing existing sources of information about patient safety.
1 April 2010 in Human Factors: The Journal of the Human Factors and Ergonomics Society
Objective: This article aims to explore the nature and resolution of breakdowns in coordinated decision making in distributed safety-critical systems. Background: In safety-critical domains, people with different roles and responsibilities often must work together to make coordinated decisions while geographically distributed. Although there is likely to be a large degree of overlap in the shared mental models of these people on the basis of procedures and experience, subtle differences may exist. Method: Study 1 involves using Aviation Safety Reporting System reports to explore the ways in which coordinated decision making breaks down between pilots and air traffic controllers and the way in which the breakdowns are resolved. Study 2 replicates and extends those findings with the use of transcripts from the Apollo 13 National Aeronautics and Space Administration space mission. Results: Across both studies, breakdowns were caused in part by different types of lower-level breakdowns (or disconnects), which are labeled as operational, informational, or evaluative. Evaluative disconnects were found to be significantly harder to resolve than other types of disconnects. Conclusion: Considering breakdowns according to the type of disconnect involved appears to capture useful information that should assist accident and incident investigators. The current trend in aviation of shifting responsibilities and providing increasingly more information to pilots may have a hidden cost of increasing evaluative disconnects. Application: The proposed taxonomy facilitates the investigation of breakdowns in coordinated decision making and draws attention to the importance of considering subtle differences between participants’ mental models when considering complex distributed systems.
In normal flight operations, crews are faced with a variety of external threats and commit a range of errors that have the potential to impact negatively on the safety of airline operations. The effective management of these threats and errors therefore forms an essential element of enhancing performance and minimizing risk. Recent research has reinforced the need to examine a range of nontechnical or crew resource management skills that form threat and error countermeasures. This article provides an analysis of the predictors of threat and error management in normal flight operations within the context of a Southeast Asian airline. Through the structured observation of crews' performance during normal flight operations, data were collected in relation to a set of contextual factors and nontechnical skills. Crews' threat and error management actions were then analyzed in relation to these factors, and predictive models of threat and error management at various phases of flight were developed. The results ...