The development of systems thinking is considered a critical skill set for addressing interdisciplinary problems. This skill set is particularly important in the field of engineering, where engineers are often tasked with solving socio-technical problems that often require knowledge beyond their original discipline and practice in unfamiliar contexts. However, existing assessments often fail to accurately measure teachable knowledge or skills that constitute systems thinking. To investigate this issue, we compared students’ performance on two previously and independently peer-reviewed scenario-based assessments for systems thinking: The Village of Abeesee and the Lake Urmia Vignette. Twenty undergraduate engineering students participated in a multi-phase case study utilizing think aloud protocols and semi-structured interview methods to elicit the approaches students took thinking across the two instruments and past experiences that they felt prepared them to solve these ill-structured problems. We found that the way a scenario is presented to students impacts their subsequent problem-solving approach, which complicates assessment of systems thinking. Additionally, students identified only limited opportunities for the development of ill-structured problem-solving skills necessary for systems thinking. Our findings inform future work on improving systems thinking assessments and emphasize the importance of more intentionally supplying opportunities for students to practice solving ill-structured problems throughout the curriculum.
Health systems science (HSS) education is an increasingly important component of undergraduate medical education. Despite curricular advances, the ways in
Today’s medical professionals function within an increasingly complex landscape—one that is medical, scientific, social, cultural, political, ethical, and technological in nature. Responding to these complexities, U.S. medical education has emphasized Systems-Based Practice and Health Systems Science competencies to prepare learners to deliver excellent patient-centered care within dynamic clinical environments. Despite recognition of these competencies and broader calls for developing health systems citizens, operationalized and scaffolded learning and assessment across undergraduate medical education remain limited, with few validated assessment tools or defined learning trajectories to help novices become experts. In this conceptual synthesis article, the authors argue for the relevance of health systems thinking to everyday clinical situations and introduce a metacognitive systems thinking framework to conceptualize how professionals navigate systems-level complexities embedded in daily work. Drawing from the literature across disciplines, the framework highlights three related yet distinct processes: recognizing salient features of a complex situation (sensemaking), aligning and coordinating relevant knowledge, skills, and attitudes (integration), and making decisions and taking action in response (action). Emphasizing these as separable processes enables scaffolding learning and assessment as well as targeted formative feedback. The authors further integrate this framework with an evidence-centered design approach, associating concrete and measurable knowledge and skills with each process. This structure allows health systems thinking to be elicited and evaluated across diverse clinical scenarios (e.g., objective structured clinical examinations), supporting intentional development of systems-informed, reflective, and adaptive clinicians.