Inhibition of return (IOR) is a mechanism of the attention system involving bias toward novel stimuli and delayed generation of responses to targets at previously attended locations. According to the two-component theory, IOR consists of a perceptual component and an oculomotor component (oculomotor IOR [O-IOR]) depending on whether the eye movement system is activated. Previous studies have shown that multisensory integration weakens IOR when paying attention to both visual and auditory modalities. However, it remains unclear whether the O-IOR effect attenuated by multisensory integration also occurs when the oculomotor system is activated. Here, using two eye movement experiments, we investigated the effect of multisensory integration on O-IOR using the exogenous spatial cueing paradigm. In Experiment 1, we found a greater visual O-IOR effect compared with audiovisual and auditory O-IOR in divided modality attention. The relative multisensory response enhancement (rMRE) and violations of Miller's bound showed a greater magnitude of multisensory integration in the cued location compared with the uncued location. In Experiment 2, the magnitude of the audiovisual O-IOR effect was significantly less than that of the visual O-IOR in single visual modality selective attention. Implications for the effect of multisensory integration on O-IOR were discussed under conditions of oculomotor system activation, shedding new light on the two-component theory of IOR.
Attention contains three functional network subcomponents of alerting, orienting, and executive control. The attention network test (ANT) is usually used to measure the efficiency of three attention subcomponents. Previous researches have focused on examining the unimodal attention with visual or auditory ANT paradigms. However, it is still unclear how an auditory stimulus influences the visual attention networks. This study investigated the effects of bilateral auditory stimuli (Experiment 1) and ipsilateral auditory stimulus (Experiment 2) on the visual attention subcomponents. We employed an ANT paradigm and manipulated the target modality types, including visual and audiovisual modalities. The participants were instructed to distinguish the direction of the central arrow surrounded by distractor arrows. In Experiment 1, we found that the simultaneous bilateral auditory stimuli reduced the efficiency of visual alerting and orienting, but had no significant effect on the efficiency of visual executive control. In Experiment 2, the ipsilateral auditory stimulus reduced the efficiency of visual executive control, but had no significant effect on the efficiency of visual alerting and orienting. We also observed a reduced relative multisensory response enhancement (rMRE) effect in cue condition relative to no cue condition (Experiment 1), and an increased rMRE effect in congruent condition compared with incongruent condition (Experiment 2). These results firstly provide evidence for the alerting, orienting and executive control effects in audiovisual condition. And the bilateral and ipsilateral auditory stimuli have different effects on the subcomponents of visual attention.
Introduction: Previous studies have investigated the effect of spatial and temporal attention on visual or auditory stimulus processing. The visual and auditory information received simultaneously from different modalities must be integrated by several systems to produce coherent cognition in the brain. However, how spatial and temporal attention modulates audiovisual (AV) stimuli processing is still unclear.Methods: The aim of this study was to compare the modulatory effects of spatial attention versus temporal attention on audiovisual stimuli processing using event-related potentials (ERPs) with high temporal resolution. Spatial attention was triggered by a visual spatial cue (usually an arrow), and temporal attention was triggered by a visual temporal cue (two concentric circles).Results: Behavioral responses to audiovisual stimuli in the spatial attention condition were faster than those in the temporal attention condition, and the false alarm rate in the spatial attention condition was lower than that in the temporal attention condition. The ERP results show that the amplitude of N2 elicited by AV stimuli in the right temporal and right occipital areas in the spatial attention condition was greater than that in the temporal attention condition.Discussion: These results indicate that spatial and temporal attention have a differential effect on AV stimuli processing in the right occipitotemporal area.
The present study sought to investigate whether working memory (WM) load influences the spatial congruency effect in audiovisual (AV) integration using simple stimuli. Participants completed an AV localization task under three WM load conditions (0-back, 1-back, 2-back), Spatially congruent AV stimuli consistently facilitated responses regardless of working memory (WM) load. Statistical analyses found no significant interactions between WM load and audiovisual integration for reaction time (RT), accuracy, sensitivity (d’), or auditory enhancement effects (p < 0.05). Critically, Bayesian analysis in the present study provided strong evidence against the existence of such an interaction (BF ≈ 0.0001), although independent replication is warranted to confirm this finding. These findings indicate that spatially congruent AV integration is robust across different levels of working memory load, suggesting that it occurs at a low-level perceptual stage and is automatic.