The integration of artificial intelligence transparency in time-critical decision support is complex and requires consideration of the impact on human-machine teaming. The relationships between transparency, trust, workload, and situational awareness are key to understanding this impact on performance. We detail the development of a novel design framework for transparency integration in Decision Support Systems. We selected the design thinking approach as the baseline for our framework as this focuses on developing empathy with users and rapid design iteration. We adapted this framework by introducing the concept of empathy for both human and machine agents. In this situation, “empathy” is providing a deep understanding of the model, its purpose and the underlying data for AI. We developed a structured problem definition focused on understanding the relationships between constructs and established solution themes to guide the designer. We demonstrate this transparency integration framework on a Transfer of Care Decision Support System.
12 May 2021 in Human Factors and Ergonomics in Manufacturing & Service Industries
The purpose of this study was to develop a method for validation of cognitive models consistent with the remote working situation arising from COVID‐19 restrictions in place in Spring 2020. We propose a framework for structuring validation tasks and applying a scoring system to determine initial model validity. We infer an objective validity level for cognitive models requiring no in‐person observations, and minimal reliance on remote usability and observational studies. This approach has been derived from the necessity of the COVID‐19 response, however, we believe this approach can lower costs and reduce timelines to initial validation in post‐Covid‐19 studies, enabling faster progress in the development of cognitive engineering systems. A three‐stage hybrid validation framework was developed based on existing validation methods and was adapted to enable compliance with the specific limitations derived from COVID‐19 response restrictions. This validation method includes elements of argument‐based validation combined with a cognitive walkthrough analysis, and reflexivity assessments. We conducted a case study of the proposed framework on a developmental cognitive model of cardiovascular surgery to demonstrate application of a real‐world validation task. This framework can be easily and quickly implemented by a small research team and provides a structured validation method to increase confidence in assumptions as well as to provide evidence to support validity claims in the early stages of model development.