The integration of artificial intelligence transparency in time-critical decision support is complex and requires consideration of the impact on human-machine teaming. The relationships between transparency, trust, workload, and situational awareness are key to understanding this impact on performance. We detail the development of a novel design framework for transparency integration in Decision Support Systems. We selected the design thinking approach as the baseline for our framework as this focuses on developing empathy with users and rapid design iteration. We adapted this framework by introducing the concept of empathy for both human and machine agents. In this situation, “empathy” is providing a deep understanding of the model, its purpose and the underlying data for AI. We developed a structured problem definition focused on understanding the relationships between constructs and established solution themes to guide the designer. We demonstrate this transparency integration framework on a Transfer of Care Decision Support System.
Current state-of-the-art artificial intelligence struggles with accurate interpretation of out-of-library (OOL) objects. One method proposed remedy is analogical reasoning (AR), which utilizes abductive reasoning to draw inferences on an unfamiliar scenario given knowledge about a similar familiar scenario. Currently, applications of visual AR gravitate toward analogy-formatted image problems rather than to computer vision data sets. The Image Recognition Through Analogical Reasoning Algorithm (IRTARA) approach described herein shows how AR can be leveraged to improve computer vision in OOL situations. IRTARA produces a word-based term frequency list that characterizes the OOL object of interest. To evaluate the quality of the results of IRTARA, both quantitative and qualitative assessments are used, including a baseline to compare the automated methods with human-generated results. Fifteen OOL objects were tested using IRTARA, which showed consistent results across all three evaluation methods on the objects that performed exceptionally well or poorly overall.
1 May 2022 in International Journal of Human–Computer Interaction
A Mobile-Based Ontology Integrated Decision Support System was built in an effort to improve the transparency in disaster situations. Using hypothetical chemical hazard scenarios, the decision-making accuracy and time taken by incident commanders using the Incident Command System was compared to incident commanders without the use of the system. The existing design of incident command systems limits the ability to manage workload and results in a limited span of knowledge. Sixteen firefighters were tested using the mobile-based ontology integrated decision support system. The results discussed in this study indicate that the information presented by the decision support system significantly improved commander’s decision-making. Potential applications of this research include Strengthening disaster risk reduction and management capacity through improved preparedness; Advancing regional and national initiatives for disaster response and risk reduction; and providing the foundation for future policies and procedures that can be easily implemented within the ICS framework.