I use a model to show how simple, bottom-up, neural mechanisms in primary visual cortex can qualitatively explain the preattentive component of complex psychophysical phenomena of visual search for a target among distracters. Depending on the image features, the speed of search ranges from fast, when a target pops-out or is instantaneously detectable, to very slow, and it can be asymmetric with respect to switches between the target and distracter objects. It has been unclear which neural mechanisms or even cortical areas control the ease of search, and no physiological correlate has been found for search asymmetry. My model suggests that contextual influences in V1 play a significant role.

Human observers are typically unaware of the eye of origin of visual inputs. This study shows that an eye of origin or ocular singleton, e.g., an item in the left eye among background items in the right eye, can nevertheless attract attention automatically. Observers searched for a uniquely oriented bar, i.e., an orientation singleton, in a background of horizontal bars. Their reports of the tilt direction of the search target in a brief (200 ms) display were more accurate in a dichoptic congruent (DC) condition, when the target was also an ocular singleton, than in a monocular (M) condition, when all bars were presented to the same single eye, or a dichoptic incongruent (DI) condition, when an ocular singleton was a background bar. The better performance in DC did not depend on the ability of the observers to report the presence of an ocular singleton by making forced choices in the same stimuli (though without the orientation singleton). This suggests that the ocular singleton exogenously cued attention to its location, facilitating the identification of the tilt singleton in the DC condition. When the search display persisted without being masked, observers' reaction times (RTs) for reporting the location of the search target were shorter in the DC, and longer in the DI, than the M condition, regardless of whether the observers were aware that different conditions existed. In an analogous design, similar RT patterns were observed for the task of finding an orientation contrast texture border. These results suggest that in typical trials, attention was more quickly attracted to or initially distracted from the target in the DC or DI condition, respectively. Hence, an ocular singleton, though elusive to awareness, can effectively compete for attention with an orientation singleton (tilted 20 or 50 degrees from background bars in the current study). Similarly, it can also make a difficult visual search easier by diminishing the set size effect. Since monocular neurons with the eye of origin information are abundant in the primary visual cortex (V1) and scarce in other cortical areas, and since visual awareness is believed to be absent or weaker in V1 than in other cortical areas, our results provide a hallmark of the role of V1 in creating a bottom-up saliency map to guide attentional selection.

Early vision is best understood in terms of two key information bottlenecks along the visual pathway -- the optic nerve and, more severely, attention. Two effective strategies for sampling and representing visual inputs in the light of the bottlenecks are (1) data compression with minimum information loss and (2) data deletion. This paper reviews two lines of theoretical work which understand processes in retina and primary visual cortex (V1) in this framework. The first is an efficient coding principle which argues that early visual processes compress input into a more efficient form to transmit as much information as possible through channels of limited capacity. It can explain the properties of visual sampling and the nature of the receptive fields of retina and V1. It has also been argued to reveal the independent causes of the inputs. The second theoretical tack is the hypothesis that neural activities in V1 represent the bottom up saliencies of visual inputs, such that information can be selected for, or discarded from, detailed or attentive processing. This theory links V1 physiology with pre-attentive visual selection behavior. By making experimentally testable predictions, the potentials and limitations of both sets of theories can be explored.

The activities of neurons in primary visual cortex have been shown to be significantly influenced by stimuli outside their classical receptive fields. We propose that these contextual influences serve pre-attentive visual segmentation by causing relatively higher neural responses to important or conspicuous image locations, making them more salient for perceptual pop-out. These locations include boundaries between regions, smooth contours, and pop-out targets against backgrounds. The mark of these locations is the breakdown of spatial homogeneity in the input. for instance, at the border between two texture regions of equal mean luminance. This breakdown causes changes in contextual influences, often resulting in higher responses at the border than at surrounding locations. This proposal is implemented in a biologically based model of VI in which contextual influences are mediated by intra-cortical horizontal connections. The behavior of the model is demonstrated using examples of texture segmentation, figure-ground segregation, target-distractor asymmetry, and contour enhancement, and is compared with psychophysical and physiological data. The model predicts (1) how neural responses should be tuned to the orientation of nearby texture borders, (2) a set of qualitative constraints on the structure of the intracortical connections, and (3) stimulus-dependent biases in estimating the locations of the region borders by pre-attentive vision.

A unique vertical bar among horizontal bars is salient and pops out perceptually. Physiological data have suggested that mechanisms in the primary visual cortex (V1) contribute to the high saliency of such a unique basic feature, but indicated little regarding whether V1 plays an essential or peripheral role in input-driven or bottom-up saliency. Meanwhile, a biologically based V1 model has suggested that V1 mechanisms can also explain bottom-up saliencies beyond the pop-out of basic features, such as the low saliency of a unique conjunction feature such as a red vertical bar among red horizontal and green vertical bars, under the hypothesis that the bottom-up saliency at any location is signaled by the activity of the most active cell responding to it regardless of the cell's preferred features such as color and orientation. The model can account for phenomena such as the difficulties in conjunction feature search, asymmetries in visual search, and how background irregularities affect ease of search. In this paper, we report nontrivial predictions from the V1 saliency hypothesis, and their psychophysical tests and confirmations. The prediction that most clearly distinguishes the V1 saliency hypothesis from other models is that task-irrelevant features could interfere in visual search or segmentation tasks which rely significantly on bottom-up saliency. For instance, irrelevant colors can interfere in an orientation-based task, and the presence of horizontal and vertical bars can impair performance in a task based on oblique bars. Furthermore, properties of the intracortical interactions and neural selectivities in V1 predict specific emergent phenomena associated with visual grouping. Our findings support the idea that a bottom-up saliency map can be at a lower visual area than traditionally expected, with implications for top-down selection mechanisms. Only a fraction of visual input can be selected for attentional scrutiny, often by focusing on a limited extent of the visual space. The selected location is often determined by the bottom-up visual inputs rather than the top-down intentions. For example, a red dot among green ones automatically attracts attention and is said to be salient. Physiological data have suggested that the primary visual cortex (V1) in the brain contributes to creating such bottom-up saliencies from visual inputs, but indicated little on whether V1 plays an essential or peripheral role in creating a saliency map of the input space to guide attention. Traditional psychological frameworks, based mainly on behavioral data, have implicated higher-level brain areas for the saliency map. Recently, it has been hypothesized that V1 creates this saliency map, such that the image location whose visual input evokes the highest response among all V1 output neurons is most likely selected from a visual scene for attentional processing. This paper derives nontrivial predictions from this hypothesis and presents their psychophysical tests and confirmations. Our findings suggest that bottom-up saliency is computed at a lower brain area than previously expected, and have implications on top-down attentional mechanisms.