Current theories of auditory pitch perception propose that cochlear place (spectral) and activity timing pattern (temporal) information are somehow combined within the brain to produce holistic pitch percepts, yet the neural mechanisms for integrating these two kinds of information remain obscure. To examine this process in more detail, stimuli made up of three pure tones whose components are individually resolved by the peripheral auditory system, but that nonetheless elicit a holistic, “missing fundamental” pitch percept, were played to human listeners. A technique was used to separate neural timing activity related to individual components of the tone complexes from timing activity related to an emergent feature of the complex (the envelope), and the region of the tonotopic map where information could originate from was simultaneously restricted by masking noise. Pitch percepts were mirrored to a very high degree by a simple combination of component-related and envelope-related neural responses with similar timing that originate within higher-frequency regions of the tonotopic map where stimulus components interact. These results suggest a coding scheme for holistic pitches whereby limited regions of the tonotopic map (spectral places) carrying envelope- and component-related activity with similar timing patterns selectively provide a key source of neural pitch information. A similar mechanism of integration between local and emergent object properties may contribute to holistic percepts in a variety of sensory systems.
We recorded human auditory cortical activity during the perception of long, changing acoustic signals and analyzed information provided by dynamic neural population measures over a large range of time intervals (~24 ms–5 s). Participants listened to musical scales that were amplitude modulated at a rate of 41.5 Hz, generating an ongoing, stimulus-related oscillatory brain signal, the auditory steady-state response (aSSR). The aSSR generated energy at the amplitude modulation rate that was recorded using magnetoencephalography. As in previous work, the timing (phase) of this response varied with stimulus carrier frequency over the entire course of minute-long tone sequences (‘phase tracking’ of carrier frequency). The length of the time interval over which phase was calculated was systematically varied; significant phase tracking was regularly observed at analysis intervals of <50 ms in length. The right auditory cortex exhibited better phase tracking performance than the left at analysis intervals of 24–240 ms, and frequency dependent phase delays were consistently larger than those predicted by cochlear mechanics. Based on these empirical data, a model of the neural populations responsible for phase tracking suggests that it is produced by a subpopulation (∼25%) of the cells generating the aSSR.
Neuroimaging studies of speech processing increasingly rely on artificial speech-like sounds whose perceptual status as speech or non-speech is assigned by simple subjective judgments; brain activation patterns are interpreted according to these status assignments. The naïve perceptual status of one such stimulus, spectrally-rotated speech (not consciously perceived as speech by naïve subjects), was evaluated in discrimination and forced identification experiments. Discrimination of variation in spectrally-rotated syllables in one group of naïve subjects was strongly related to the pattern of similarities in phonological identification of the same stimuli provided by a second, independent group of naïve subjects, suggesting either that (1) naïve rotated syllable perception involves phonetic-like processing, or (2) that perception is solely based on physical acoustic similarity, and similar sounds are provided with similar phonetic identities. Analysis of acoustic (Euclidean distances of center frequency values of formants) and phonetic similarities in the perception of the vowel portions of the rotated syllables revealed that discrimination was significantly and independently influenced by both acoustic and phonological information. We conclude that simple subjective assessments of artificial speech-like sounds can be misleading, as perception of such sounds may initially and unconsciously utilize speech-like, phonological processing.