The superior colliculus (SC) has been implicated in the mediation of residual visual function in hemianopic patients, and has been shown to be capable of using multiple sensory cues to facilitate its localization functions. The aim of the present study was to examine the possibility that the SC could effect covert visual processes, via multisensory integration of auditory and visual stimuli in patients with visual field loss. To this aim hard-to-localize auditory targets were presented alone (unimodal condition) or with a visual stimulus (cross-modal condition) in either hemifield and at various spatial (0°, 16°, 32°) and temporal (0 ms, 500 ms) disparities. The results showed substantial field-specific differences. As expected, a visual stimulus in the intact hemifield induced a strong visual bias in auditory localization independent of the spatial disparities, and did so even when the two stimuli were temporally offset. In these spatially disparate conditions, the localization accuracy was markedly reduced. In the blind hemifield, however, the visual stimulus affected auditory localization only when it was coincident with that target in both space and time. In this circumstance auditory localization performance was markedly enhanced. This result strongly suggests that covert visual processes remain active in hemianopia, though they differ from those in the normal hemifield. A likely explanation of these differences is that enhancement and visual bias depend on different neural pathways: with the former dependent on circuits involving the superior colliculus, a structure involved in the integration of cues from multiple senses to facilitate orientation/localization; and the latter dependent on geniculo-striate circuits that facilitate more detailed analyses of the visual scene. Overall the present results not only enhance our understanding of the impact of covert visual processes in hemianopic patients, but also enhance our knowledge of how different brain regions areas contribute to processing cross-modal information.

Several recent multisensory studies show that sounds can influence visual processing. Some visual judgments can be enhanced for visual stimuli near a sound occurring around the same time. A recent TMS study (Romei et al. 2009) indicates looming sounds might influence visual cortex particularly strongly. But unlike most previous behavioral studies of possible audio–visual exogenous effects, TMS phosphene thresholds rather than judgments of external visual stimuli were measured. Moreover, the visual hemifield assessed relative to the hemifield of the sound was not varied. Here, we compared the impact of looming sounds to receding or “static” sounds, using auditory stimuli adapted from Romei et al. (2009), but now assessing any influence on visual orientation discrimination for Gabor patches (well-known to involve early visual cortex) when appearing in the same hemifield as the sound or on the opposite side. The looming sounds that were effective in Romei et al. (2009) enhanced visual orientation sensitivity (d′) here on the side of the sound, but not for the opposite hemifield. This crossmodal, spatially specific effect was stronger for looming than receding or static sounds. Similarly to Romei et al. (2009), the differential effect for looming sounds was eliminated when using white noise rather than structured sounds. Our new results show that looming structured sounds can specifically benefit visual orientation sensitivity in the hemifield of the sound, even when the sound provides no information about visual orientation itself.

Multisensory integration is a powerful mechanism for maximizing sensitivity to sensory events. We examined its effects on auditory localization in healthy human subjects. The specific objective was to test whether the relative intensity and location of a seemingly irrelevant visual stimulus would influence auditory localization in accordance with the inverse effectiveness and spatial rules of multisensory integration that have been developed from neurophysiological studies with animals [Stein and Meredith, 1993 The Merging of the Senses (Cambridge, MA: MIT Press)]. Subjects were asked to localize a sound in one condition in which a neutral visual stimulus was either above threshold (supra-threshold) or at threshold. In both cases the spatial disparity of the visual and auditory stimuli was systematically varied. The results reveal that stimulus salience is a critical factor in determining the effect of a neutral visual cue on auditory localization. Visual bias and, hence, perceptual translocation of the auditory stimulus appeared when the visual stimulus was supra-threshold, regardless of its location. However, this was not the case when the visual stimulus was at threshold. In this case, the influence of the visual cue was apparent only when the two cues were spatially coincident and resulted in an enhancement of stimulus localization. These data suggest that the brain uses multiple strategies to integrate multisensory information.

Vision loss has severe impacts on physical, social and emotional well-being. The education of blind children poses issues as many scholar disciplines (e.g., geometry, mathematics) are normally taught by heavily relying on vision. Touch-based assistive technologies are potential tools to provide graphical contents to blind users, improving learning possibilities and social inclusion. Raised-lines drawings are still the golden standard, but stimuli cannot be reconfigured or adapted and the blind person constantly requires assistance. Although much research concerns technological development, little work concerned the assessment of programmable tactile graphics, in educative and rehabilitative contexts. Here we designed, on programmable tactile displays, tests aimed at assessing spatial memory skills and shapes recognition abilities. Tests involved a group of blind and a group of low vision children and adolescents in a four-week longitudinal schedule. After establishing subject-specific difficulty levels, we observed a significant enhancement of performance across sessions and for both groups. Learning effects were comparable to raised paper control tests: however, our setup required minimal external assistance. Overall, our results demonstrate that programmable maps are an effective way to display graphical contents in educative/rehabilitative contexts. They can be at least as effective as traditional paper tests yet providing superior flexibility and versatility.