7 June 2025 in Computers in Human Behavior: Artificial Humans
SAStéphane Aroca-Ouellette
1 September 2015 in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
A cognitive systems engineering evaluation of an imagery analysis system was conducted to capture baseline performance and workload and compare it to performance with advanced filtering capabilities. Experienced Imagery Analysts searched for and annotated targets of interest in full-motion video in Army- relevant scenarios. Measures of performance included percent of primary targets found, time to find primary target, total targets found, and interactions with the system (via mouse clicks). Performance metrics were augmented with continuous physiological and behavioral measurements in order to capture more accurate cognitive state fluctuations during human-system interaction. The findings suggest that in time-pressured situations, analysts were able to identify more targets with the advanced filter capabilities than in the baseline condition. The findings were used to suggest specific design changes to address workflow deficiencies. The study also developed and implemented a multi-aspect approach to estimate operator functional state during system evaluation.
23 January 2025 in Attention, Perception, & Psychophysics
CCChloe Callahan-Flintoft
RHRussell A. Cohen Hoffing
Historically, electrophysiological correlates of scene processing have been studied with experiments using static stimuli presented for discrete timescales where participants maintain a fixed eye position. Gaps remain in generalizing these findings to real-world conditions where eye movements are made to select new visual information and where the environment remains stable but changes with our position and orientation in space, driving dynamic visual stimulation. Co-recording of eye movements and electroencephalography (EEG) is an approach to leverage fixations as time-locking events in the EEG recording under free-viewing conditions to create fixation-related potentials (FRPs), providing a neural snapshot in which to study visual processing under naturalistic conditions. The current experiment aimed to explore the influence of low-level image statistics—specifically, luminance and a metric of spatial frequency (slope of the amplitude spectrum)—on the early visual components evoked from fixation onsets in a free-viewing visual search and navigation task using a virtual environment. This research combines FRPs with an optimized approach to remove ocular artifacts and deconvolution modeling to correct for overlapping neural activity inherent in any free-viewing paradigm. The results suggest that early visual components—namely, the lambda response and N1—of the FRPs are sensitive to luminance and spatial frequency around fixation, separate from modulation due to underlying differences in eye-movement characteristics. Together, our results demonstrate the utility of studying the influence of image statistics on FRPs using a deconvolution modeling approach to control for overlapping neural activity and oculomotor covariates.
22 August 2025 in Cognitive Research: Principles and Implications
CCChloe Callahan-Flintoft
In military operations, rapid and accurate decision-making is crucial, especially in visually complex and high-pressure environments. This study investigates how eye and head movement metrics can infer changes in search behavior during a naturalistic shooting scenario in virtual reality (VR). Thirty-one participants performed a foraging search task using a head-mounted display (HMD) with integrated eye tracking. Participants searched for targets among distractors under varying levels of target discriminability (easy vs. hard) and time pressure (low vs. high). As expected, behavioral results indicated that increased discrimination difficulty and greater time pressure negatively impacted performance, leading to slower response times and reduced d-prime. Support vector classifiers assigned a search condition, discriminability and time pressure, to each trial based on eye and head movement features. Combined eye and head features produced the most accurate classification model for capturing tasked-induced changes in search behavior, with the combined model outperforming those based on eye or head features alone. While eye features demonstrated strong predictive power, the inclusion of head features significantly enhanced model performance. Across the ensemble of eye metrics, fixation-related features were the most robust for classifying target discriminability, while saccadic-related features played a similar role for time pressure. In contrast, models constrained to head metrics emphasized global movement (amplitude, velocity) for classifying discriminability but shifted toward kinematic intensity (acceleration, jerk) in time pressure condition. Together these results speak to the complementary role of eye and head movements in understanding search behavior under changing task parameters.