23 July 2014 in Frontiers in Neuroscience
Though several features of cognitive processing can be inferred from the discrete measurement (e.g., reaction time, accuracy, etc.) of participants’ conscious reports (e.g., verbal or key-press responses), it is becoming increasingly clear that a much richer understanding of these features can be captured from continuous measures of rapid, largely non-conscious behaviours like hand or eye movements. Here, using new experimental data, we describe in detail both the approach and analyses implemented in some of our previous studies that have used rapid reaching movements under cases of target uncertainty in order to probe the features, constraints and dynamics of stimulus-related processing in the brain. This work, as well as that of others, shows that when individuals are simultaneously presented with multiple potential targets—only one of which will be cued after reach onset—they produce initial reach trajectories that are spatially biased in accordance with the probabilistic distribution of targets. Such ‘spatial averaging’ effects are consistent with observations from neurophysiological studies showing that neuronal populations in sensorimotor brain structures represent multiple target choices in parallel and they compete for selection. These effects also confirm and help extend computational models aimed at understanding the underlying mechanisms that support action-target selection. We suggest that the use of this simple, yet powerful behavioural paradigm for providing a ‘real-time’ visualization of ongoing cognitive processes occurring at the neural level offers great promise for studying processes related to a wide range of psychological phenomena, such as decision-making and the representation of objects.
1 June 2018 in Journal of Vision
This study explores the role that vision plays in sequential object interactions. We used a head-mounted eye tracker and upper-limb motion capture to quantify visual behavior while participants performed two standardized functional tasks. By simultaneously recording eye and motion tracking, we precisely segmented participants' visual data using the movement data, yielding a consistent and highly functionally resolved data set of real-world object-interaction tasks. Our results show that participants spend nearly the full duration of a trial fixating on objects relevant to the task, little time fixating on their own hand when reaching toward an object, and slightly more time—although still very little—fixating on the object in their hand when transporting it. A consistent spatial and temporal pattern of fixations was found across participants. In brief, participants fixate an object to be picked up at least half a second before their hand arrives at the object and stay fixated on the object until they begin to transport it, at which point they shift their fixation directly to the drop-off location of the object, where they stay fixated until the object is successfully released. This pattern provides additional evidence of a common system for the integration of vision and object interaction in humans, and is consistent with theoretical frameworks hypothesizing the distribution of attention to future action targets as part of eye and hand-movement preparation. Our results thus aid the understanding of visual attention allocation during planning of object interactions both inside and outside the field of view.
30 December 2019 in PLOS ONE
Successful hand-object interactions require precise hand-eye coordination with continual movement adjustments. Quantitative measurement of this visuomotor behaviour could provide valuable insight into upper limb impairments. The Gaze and Movement Assessment (GaMA) was developed to provide protocols for simultaneous motion capture and eye tracking during the administration of two functional tasks, along with data analysis methods to generate standard measures of visuomotor behaviour. The objective of this study was to investigate the reproducibility of the GaMA protocol across two independent groups of non-disabled participants, with different raters using different motion capture and eye tracking technology. Twenty non-disabled adults performed the Pasta Box Task and the Cup Transfer Task. Upper body and eye movements were recorded using motion capture and eye tracking, respectively. Measures of hand movement, angular joint kinematics, and eye gaze were compared to those from a different sample of twenty non-disabled adults who had previously performed the same protocol with different technology, rater and site. Participants took longer to perform the tasks versus those from the earlier study, although the relative time of each movement phase was similar. Measures that were dissimilar between the groups included hand distances travelled, hand trajectories, number of movement units, eye latencies, and peak angular velocities. Similarities included all hand velocity and grip aperture measures, eye fixations, and most peak joint angle and range of motion measures. The reproducibility of GaMA was confirmed by this study, despite a few differences introduced by learning effects, task demonstration variation, and limitations of the kinematic model. GaMA accurately quantifies the typical behaviours of a non-disabled population, producing precise quantitative measures of hand function, trunk and angular joint kinematics, and associated visuomotor behaviour. This work advances the consideration for use of GaMA in populations with upper limb sensorimotor impairment.
28 November 2014 in Visual Cognition
Stimuli associated with positive rewards in one task often receive preferential processing in a subsequent task, even when those associations are no longer relevant. Here we use a rapid reaching task to investigate these biases. In Experiment 1 we first replicated the learning procedure of Raymond and O'Brien (2009), for a set of arbitrary shapes that varied in value (positive, negative) and probability (20%, 80%). In a subsequent task, participants rapidly reached toward one of two shapes, except now the previously learned associations were irrelevant. As in the previous studies, we found significant reach biases toward shapes previously associated with a high probable, positive outcome. Unexpectedly, we also found a bias toward shapes previously associated with a low probable, negative outcome. Closer inspection of the learning task revealed a potential second factor that might account for these results; since a low probable negative shape was always paired with a high probable negative shape, it was selected with disproportionate frequency. To assess how selection frequency and reward value might both contribute to reaching biases we performed a second experiment. The results of this experiment at a group level replicated the reach-bias toward positively rewarding stimuli, but also revealed a separate bias toward stimuli that had been more frequently selected. At the level of individual participants, we observed a variety of preference profiles, with some participants biased primarily by reward value, others by frequency, and a few actually biased away from both highly rewarding and high frequency targets. These findings highlight that: (1) rapid reaching provides a sensitive readout of preferential processing; (2) target reward value and target selection frequency are separate sources of bias; and (3) group-level analyses in complex decision-making tasks can obscure important and varied individual differences in preference profiles.
12 July 2025 in Scientific Reports
Intuitively, we know that how we perceive and act in the world is profoundly affected when the lights go out. But what happens to visuomotor control when our sense of touch is taken away? Notably this happens in Virtual Reality (VR) and for prosthesis users. We test this question by combining VR and hand-, motion- and eye-tracking to give and deprive full haptic feedback to individuals with normal hand function during a validated object interaction task. Returning haptic feedback in VR generated eye-hand coordination more similar to real-world interactions. Interestingly, VR users and prosthesis users have both reported reduced feelings of embodiment towards their limbs. Therefore, we also quantified the sense of embodiment which increased with haptic feedback. We further reported a correlation between eye-hand coordination and an individual’s sense of embodiment suggesting that the embodiment is experienced as the synchronized reception of sensory information and that eye-hand coordination measures are an objective way to quantify these experiences.
27 February 2014 in Journal of Vision
Symbolic numbers (e.g., “2”) acquire their meaning by becoming linked to the core nonsymbolic quantities they represent (e.g., two items). However, the extent to which symbolic and nonsymbolic information converges onto the same internal core representations of quantity remains a point of considerable debate. As nearly all previous work on this topic has employed perceptual tasks requiring the conscious reporting of numerical magnitudes, here we question the extent to which numerical processing via the visual–motor system might shed further light on the fundamental basis of how different number formats are encoded. We show, using a rapid reaching task and a detailed analysis of initial arm trajectories, that there are key differences in how the quantity information extracted from symbolic Arabic numerals and nonsymbolic collections of discrete items are used to guide action planning. In particular, we found that the magnitude derived from discrete dots resulted in movements being biased by an amount directly proportional to the actual quantities presented whereas the magnitude derived from numerals resulted in movements being biased only by the relative (e.g., larger than) quantities presented. In addition, we found that initial motor plans were more sensitive to changes in numerical quantity within small (1–3) than large (5–15) number ranges, irrespective of their format (dots or numerals). In light of previous work, our visual–motor results clearly show that the processing of numerical quantity information is both format and magnitude dependent.