7 February 2023 in Proceedings of the National Academy of Sciences
A canonical feature of sensory systems is that they adapt to prolonged or repeated inputs, suggesting the brain encodes the temporal context in which stimuli are embedded. Sensory adaptation has been observed in the central nervous systems of many animal species, using techniques sensitive to a broad range of spatiotemporal scales of neural activity. Two competing models have been proposed to account for the phenomenon. One assumes that adaptation reflects reduced neuronal sensitivity to sensory inputs over time (the “fatigue” account); the other posits that adaptation arises due to increased neuronal selectivity (the “sharpening” account). To adjudicate between these accounts, we exploited the well-known “tilt aftereffect”, which reflects adaptation to orientation information in visual stimuli. We recorded whole-brain activity with millisecond precision from human observers as they viewed oriented gratings before and after adaptation, and used inverted encoding modeling to characterize feature-specific neural responses. We found that both fatigue and sharpening mechanisms contribute to the tilt aftereffect, but that they operate at different points in the sensory processing cascade to produce qualitatively distinct outcomes. Specifically, fatigue operates during the initial stages of processing, consistent with tonic inhibition of feedforward responses, whereas sharpening occurs ~200 ms later, consistent with feedback or local recurrent activity. Our findings reconcile two major accounts of sensory adaptation, and reveal how this canonical process optimizes the detection of change in sensory inputs through efficient neural coding.
4 January 2022 in Journal of Vision
The sensitivity of the human visual system is thought to be shaped by environmental statistics. A major endeavor in vision science, therefore, is to uncover the image statistics that predict perceptual and cognitive function. When searching for targets in natural images, for example, it has recently been proposed that target detection is inversely related to the spatial similarity of the target to its local background. We tested this hypothesis by measuring observers’ sensitivity to targets that were blended with natural image backgrounds. Targets were designed to have a spatial structure that was either similar or dissimilar to the background. Contrary to masking from similarity, we found that observers were most sensitive to targets that were most similar to their backgrounds. We hypothesized that a coincidence of phase alignment between target and background results in a local contrast signal that facilitates detection when target-background similarity is high. We confirmed this prediction in a second experiment. Indeed, we show that, by solely manipulating the phase of a target relative to its background, the target can be rendered easily visible or undetectable. Our study thus reveals that, in addition to its structural similarity, the phase of the target relative to the background must be considered when predicting detection sensitivity in natural images.
14 July 2023 in PLOS Computational Biology
The mechanisms that enable humans to evaluate their confidence across a range of different decisions remain poorly understood. To bridge this gap in understanding, we used computational modelling to investigate the processes that underlie confidence judgements for perceptual decisions and the extent to which these computations are the same in the visual and auditory modalities. Participants completed two versions of a categorisation task with visual or auditory stimuli and made confidence judgements about their category decisions. In each modality, we varied both evidence strength, (i.e., the strength of the evidence for a particular category) and sensory uncertainty (i.e., the intensity of the sensory signal). We evaluated several classes of computational models which formalise the mapping of evidence strength and sensory uncertainty to confidence in different ways: 1) unscaled evidence strength models, 2) scaled evidence strength models, and 3) Bayesian models. Our model comparison results showed that across tasks and modalities, participants take evidence strength and sensory uncertainty into account in a way that is consistent with the scaled evidence strength class. Notably, the Bayesian class provided a relatively poor account of the data across modalities, particularly in the more complex categorisation task. Our findings suggest that a common process is used for evaluating confidence in perceptual decisions across domains, but that the parameter settings governing the process are tuned differently in each modality. Overall, our results highlight the impact of sensory uncertainty on confidence and the unity of metacognitive processing across sensory modalities. In this study, we investigated the computational processes that describe how people derive a sense of confidence in their decisions. In particular, we used computational models to describe how decision confidence is generated from different stimulus features, specifically evidence strength and sensory uncertainty, and determined whether the same computations generalise to both visual and auditory decisions. We tested a range of different computational models from three distinct theoretical classes, where each class of models instantiated different algorithmic hypotheses about the computations that are used to generate confidence. We found that a single class of models, in which confidence is derived from a subjective assessment of the strength of the evidence for a particular choice scaled by an estimate of sensory uncertainty, provided the best account of confidence for both visual and auditory decisions. Our findings suggest that the same type of algorithm is used for evaluating confidence across sensory modalities but that the ‘settings’ (or parameters) of this process are fine-tuned within each modality.
25 January 2025 in Consciousness and Cognition
Decision confidence plays a critical role in humans' ability to make adaptive decisions in a noisy perceptual world. Despite its importance, there is currently little consensus about the computations underlying confidence judgements in perceptual decisions. To better understand these mechanisms, we addressed the extent to which confidence is informed by a naturalistic prior distribution. Contrary to previous research, we did not require participants to internalise parameters of an arbitrary prior distribution. We instead used a novel psychophysical paradigm leveraging probability distributions of low-level image features in natural scenes, which are well-known to influence perception. Participants reported the subjective upright of naturalistic image patches, targets, and then reported their confidence in their orientation responses. We used computational modelling to relate the statistics of the low-level features in the targets to the average distribution of these features across many naturalistic images, a prior. Our results showed that participants' perceptual and importantly, their confidence judgments aligned with an internalised prior for image statistics. Overall, our study highlights the importance of naturalistic task designs that capitalise on existing, long-term priors to further understand the computational basis of confidence.
21 February 2023 in bioRxiv
Decision confidence plays a critical role in humans’ ability to make adaptive decisions in a noisy perceptual world. Despite its importance, there is currently little consensus about the computations underlying confidence judgements in perceptual decisions. In order to better understand these mechanisms, in this study we sought to address the extent to which confidence is informed by a naturalistic prior probability distribution. Contrary to previous research, we did not require participants to internalise the parameters of an arbitrary prior distribution. Instead we used a novel psychophysical paradigm which allowed us to capitalise on probability distributions of low-level image features in natural scenes, which are well-known to influence perception. Participants reported the subjective upright of naturalistic image target patches, and then reported their confidence in their orientation responses. We used computational modelling to relate the statistics of the low-level features in the targets to the distribution of these features across many natural images. As expected, we found that participants used an internalised prior of the regularities of low-level natural image statistics to inform their perceptual judgements. Critically, we also show that the same low-level image statistics predict participants’ confidence judgements. Overall, our study highlights the importance of using naturalistic task designs that capitalise on existing, long-term priors to further our understanding of the computational basis of confidence.
13 November 2019 in bioRxiv
Many decisions, from crossing a busy street to choosing a profession, require integration of discrete sensory events. Previous studies have shown that integrative decision-making favours more reliable stimuli, mimicking statistically optimal integration. It remains unclear, however, whether reliability biases are automatic or strategic. To address this issue, we asked observers to reproduce the average motion direction of two suprathreshold coherent motion signals, presented successively and varying in reliability. Although unbiased responses were both optimal and possible by virtue of task rules and suprathreshold motion coherence, we found robust behavioural biases favouring the more reliable stimulus. Using population-tuning modelling of brain activity recorded using electroencephalography, we characterised tuning to the average motion direction. In keeping with the behavioural biases, the tuning profiles also exhibited reliability biases. Taken together, our findings reveal that temporal integration of discrete sensory events is automatically and sub-optimally weighted according to stimulus reliability.