The timing of perceptual decisions depends on both deterministic and stochastic factors, as the gradual accumulation of sensory evidence (deterministic) is contaminated by sensory and/or internal noise (stochastic). When human observers view multistable visual displays, successive episodes of stochastic accumulation culminate in repeated reversals of visual appearance. Treating reversal timing as a “first-passage time” problem, we ask how the observed timing densities constrain the underlying stochastic accumulation. Importantly, mean reversal times (i.e., deterministic factors) differ enormously between displays/observers/stimulation levels, whereas the variance and skewness of reversal times (i.e., stochastic factors) keep characteristic proportions of the mean. What sort of stochastic process could reproduce this highly consistent “scaling property?” Here we show that the collective activity of a finite population of bistable units (i.e., a generalized Ehrenfest process) quantitatively reproduces all aspects of the scaling property of multistable phenomena, in contrast to other processes under consideration (Poisson, Wiener, or Ornstein-Uhlenbeck process). The postulated units express the spontaneous dynamics of attractor assemblies transitioning between distinct activity states. Plausible candidates are cortical columns, or clusters of columns, as they are preferentially connected and spontaneously explore a restricted repertoire of activity states. Our findings suggests that perceptual representations are granular, probabilistic, and operate far from equilibrium, thereby offering a suitable substrate for statistical inference.
1 January 2013 in Frontiers in Computational Neuroscience
We report that multi-stable perception operates in a consistent, dynamical regime, balancing the conflicting goals of stability and sensitivity. When a multi-stable visual display is viewed continuously, its phenomenal appearance reverses spontaneously at irregular intervals. We characterized the perceptual dynamics of individual observers in terms of four statistical measures: the distribution of dominance times (mean and variance) and the novel, subtle dependence on prior history (correlation and time-constant). The dynamics of multi-stable perception is known to reflect several stabilizing and destabilizing factors. Phenomenologically, its main aspects are captured by a simplistic computational model with competition, adaptation, and noise. We identified small parameter volumes (~3% of the possible volume) in which the model reproduced both dominance distribution and history-dependence of each observer. For 21 of 24 data sets, the identified volumes clustered tightly (~15% of the possible volume), revealing a consistent `operating regime' of multi-stable perception. The `operating regime' turned out to be marginally stable or, equivalently, near the brink of an oscillatory instability. The chance probability of the observed clustering was <0.02. To understand the functional significance of this empirical `operating regime', we compared it to the theoretical `sweet spot' of the model. We computed this `sweet spot' as the intersection of the parameter volumes in which the model produced stable perceptual outcomes and in which it was sensitive to input modulations. Remarkably, the empirical `operating regime' proved to be largely coextensive with the theoretical `sweet spot'. This demonstrated that perceptual dynamics was not merely consistent but also functionally optimized (in that it balances stability with sensitivity). Our results imply that multi-stable perception is not a laboratory curiosity, but reflects a functional optimization of perceptual dynamics
Neural adaptation plays an important role in multistable perception, but its effects are difficult to discern in sequences of perceptual reversals. Investigating the multistable appearance of kinetic depth and binocular rivalry displays, we introduce cumulative history as a novel statistical measure of adaptive state. We show that cumulative history—an integral of past perceptual states, weighted toward the most recent states—significantly and consistently correlates with future dominance durations: the larger the cumulative history measure, the shorter are future dominance times, revealing a robust effect of neural adaptation. The characteristic time scale of cumulative history, which may be computed by Monte Carlo methods, correlates with average dominance durations, as expected for a measure of neural adaptation. When the cumulative histories of two competing percepts are balanced, perceptual reversals take longer and their outcome becomes random, demonstrating that perceptual reversals are fluctuation-driven in the absence of adaptational bias. Our findings quantify the role of neural adaptation in multistable perception, which accounts for approximately 10% of the variability of reversal timing.
Many ambiguous patterns elicit spontaneous alternations of phenomenal appearance. Attention is known to influence these phenomenal reversals, as do several other factors. We asked whether a shift of attention individually prompts each reversal of phenomenal appearance. By combining intermittent presentation with a proven method of attention control, we monitored phenomenal alternations in the complete absence of attention shifts. We found that reversals become less frequent but continue even when observers neither report on nor shift attention to an ambiguous pattern. The statistical variability of reversals remains unaffected. We conclude that reversals of phenomenal appearance are not prompted externally by attention shifts, but internally by an intrinsic instability of the neural representation of ambiguous patterns.
It is well known that pauses in the presentation of an ambiguous display may stabilize its perceptual appearance. Here we show that this stabilization depends on an extended history spanning several dominance periods, not merely on the most recent period. Specifically, appearance after a pause often reflects less recent (but longer) dominance periods rather than more recent (but shorter) periods. Our results imply the existence of a short-tem memory for perceptual appearance that builds up over seconds, decays over minutes, and is robust to perceptual reversals. Although this memory is most evident in paused displays, it influences perceptual reversals also when display presentation continues: while the memory of one appearance prevails over that of the other, successive dominance durations are positively correlated. This highly unusual successive dependence suggests that multi-stable perception is not the memoryless ‘renewal process’ as which it has long been regarded. Instead, a short-term memory of appearance must be added to the multiple processes that jointly produce reversals of perceptual appearance.