We developed an experiment to elicit human trust dynamics in human–machine interaction contexts and established a quantitative model of human trust behavior with respect to these contexts. The proposed model describes human trust level as a function of experience, cumulative trust, and expectation bias. We estimated the model parameters using human subject data collected from two experiments. Experiment 1 was designed to excite human trust dynamics using multiple transitions in trust level. Five hundred and eighty-one individuals participated in this experiment. Experiment 2 was an augmentation of Experiment 1 designed to study and incorporate the effects of misses and false alarms in the general model. Three hundred and thirty-three individuals participated in Experiment 2. Beyond considering the dynamics of human trust in automation, this model also characterizes the effects of demographic factors on human trust. In particular, our results show that the effects of national culture and gender on trust are significant. For example, U.S. participants showed a lower trust level and were more sensitive to misses as compared with Indian participants. The resulting trust model is intended for the development of autonomous systems that can respond to changes in human trust level in real time.
The human operator is an integral part of a stable and safe power system. While there is increasing attention paid to automation improvements, the importance of understanding and training human operators may be understated. This paper discusses a project to enhance operator training programs by evaluating human performance relative to a reference operator model identified using optimal control theory. Along with establishing a simple computer-based operator workstation for future training purpose, this paper describes the optimal control response design methodology for a human-in-the-loop power system experiment. The overall system model is presented. An optimal controller synthesis methodology is applied to the model system and the optimal controller is designed. The performance of the optimal controller is then compared to human subject performance.
The Linac Coherent Light Source (LCLS) is the world’s first x-ray free electron laser. It is a scientific user facility operated by the SLAC National Accelerator Laboratory, at Stanford, for the U.S. Department of Energy. As beam time at LCLS is extremely valuable and limited, experimental efficiency—getting the most high quality data in the least time—is critical. Our overall project employs cognitive engineering methodologies with the goal of improving experimental efficiency and increasing scientific productivity at LCLS by refining experimental interfaces and workflows, simplifying tasks, reducing errors, and improving operator safety and stress. Here, we describe a multi-agent, multi-scale computational cognitive interaction model of instrument operations at LCLS. Our model simulates the aspects of human cognition at multiple cognitive and temporal scales, ranging from seconds to hours, and among agents playing multiple roles, including instrument operator, real time data analyst, and experiment manager. The model can roughly predict impacts stemming from proposed changes to operational interfaces and workflows. Example results demonstrate the model’s potential in guiding modifications to improve operational efficiency. We discuss the implications of our effort for cognitive engineering in complex experimental settings and outline future directions for research. The model is open source, and the videos of the supplementary material provide extensive detail.
We address a gap in Machine Learning–human alignment research by proposing that methods from Explainable AI (XAI) can be repurposed to quantitatively model human learning. To achieve alignment between human experts and Machine Learning (ML) models, we must first be able to explain the problem-solving strategies of human experts with the same rigor we apply to ML models. To demonstrate this approach, we model expertise in the complex domain of particle accelerator operations. Analyzing 14 years of operational text logs, we construct weighted graphs where nodes represent operational subtasks and edges capture their strategic relationships. We then examine these strategic models across four granularity levels. Our analysis reveals statistically significant changes with expertise at three of four graph levels. Remarkably, despite numerous possible ways to partition subtasks, operators across all expertise levels demonstrate a striking consistency in high-level strategy, partitioning the task into the same three functional communities. This suggests a shared “divide and conquer” cognitive framework. Expertise develops within this stable framework, as experts exhibit greater cognitive flexibility (forming more cross-community connections) and build more refined internal models. The primary contribution of this work is a methodology for creating a quantitative, interpretable baseline of expert human performance. This provides a “ground truth” for future research in alignment between humans and ML models, enabling a new approach to verification: the ML model’s representation of the task can be quantitatively compared against the human expert benchmark to measure their alignment. This paves the way for building safer, more interpretable partnerships between humans and ML models.