By Fourier's theorem1, signals can be decomposed into a sum of sinusoids of different frequencies. This is especially relevant for hearing, because the inner ear performs a form of mechanical Fourier transform by mapping frequencies along the length of the cochlear partition. An alternative signal decomposition, originated by Hilbert2, is to factor a signal into the product of a slowly varying envelope and a rapidly varying fine time structure. Neurons in the auditory brainstem3,4,5,6 sensitive to these features have been found in mammalian physiological studies. To investigate the relative perceptual importance of envelope and fine structure, we synthesized stimuli that we call ‘auditory chimaeras’, which have the envelope of one sound and the fine structure of another. Here we show that the envelope is most important for speech reception, and the fine structure is most important for pitch perception and sound localization. When the two features are in conflict, the sound of speech is heard at a location determined by the fine structure, but the words are identified according to the envelope. This finding reveals a possible acoustic basis for the hypothesized ‘what’ and ‘where’ pathways in the auditory cortex7,8,9,10.

/pdf/chimaeric-sounds-reveal-dichotomies-in-auditory-perception-4ck9rp9e96.pdf

Chimaeric sounds reveal dichotomies in auditory perception

Joris, P. X., C. E. Schreiner, and A. Rees. Neural Processing of Amplitude-Modulated Sounds. Physiol Rev 84: 541–577, 2004; 10.1152/physrev.00029.2003.—Amplitude modulation (AM) is a temporal featu...

https://www.physiology.org/doi/pdf/10.1152/physrev.00029.2003

Neural processing of amplitude-modulated sounds.

1. Spike rates of cells in the cat's lateral superior olive (LSO) depend on interaural level differences (ILDs) and envelope interaural time differences (ITDs) of amplitude-modulated tones presented to both ears. We previously proposed that these sensitivities arise from a common mechanism, which is the IE binaural interaction (Inhibited by the contralateral and Excited by the ipsilateral ear). As a further test of that proposal and to gain a better understanding of the importance of this ITD-sensitivity, responses to monaural and binaural modulation are compared here over a range of modulation frequencies. 2. At low modulation frequencies, LSO-IE cells respond maximally when the envelopes of the amplitude-modulated stimuli at the two ears are out-of-phase by a half-cycle. This phase difference changes in a systematic way, which varies from cell to cell, when modulation frequency is increased. Mean interaural phase, measured over a range of modulation frequencies, was subjected to a characteristic delay analysis. Two measures were extracted: characteristic delay, which reflects differences in conduction delay between ipsi- and contralateral pathways, and characteristic phase, which reflects their sign of interaction. Most characteristic delays were within the physiological range of ITDs. There was a small bias toward positive delays, indicating a longer conduction time for the contralateral pathway. Characteristic phases were tightly distributed approximately 0.5 cycles, consistent with the proposed IE mechanism for ITD-sensitivity. 3. Increases in the modulation frequency of binaural stimuli beyond approximately 300 Hz consistently caused a profound decrease in average spike rate, as well as a decrease in the modulation of spike rate by ITD. The upper limit of ITD-sensitivity was 800 Hz. Sensitivity to envelope ITDs therefore is limited to a much lower range of frequencies than sensitivity to ITDs in fine-structure, e.g., as found in the medial superior olive (MSO), which operates up to several kilo Hertz. 4. A small sample of high-frequency EE cells (excited by both ears) in MSO also was tested with binaural amplitude-modulated stimuli. MSO-EE cells showed weak envelope ITD-sensitivity over a limited range of modulation frequencies. Consistent with the EE interaction, characteristic phases clustered approximately 0 cycles. 5. Mean interaural phase was compared with the phase of responses to monaural modulation. The difference between the ipsilateral and contralateral phases correlated well with the phase measured binaurally, both for LSO and MSO cells. 6. Many features of LSO-IE responses were mimicked by the simplest possible computer model, consisting of subtraction and rectification of low-pass filtered envelope waveforms. Differences between model and physiological results are suggestive of a temporal limitation in the binaural interaction that creates the ITD-sensitivity. 7. These results provide additional evidence for LSO ITD-sensitivity paralleling human psychophysical results. The stimulus boundaries within which ITD-sensitivity occurs suggest that it has a limited role in free-field conditions. It is traditionally thought that, to contribute to the perceived change in spatial location of a sound source, the LSO needs to show a change in overall firing rate summed across cells. This is achieved with small ILDs, but requires large ITDs, because the latter cue is less potent in single cells and has varied effects across cells by virtue of differences in characteristic delay.

Envelope coding in the lateral superior olive. II. Characteristic delays and comparison with responses in the medial superior olive.

In humans, horizontal sound localization of low-frequency sounds is mainly based on interaural time differences (ITDs). Traditionally, it was assumed that ITDs are converted into a topographic (or ...

Evidence for Opponent-Channel Coding of Interaural Time Differences in Human Auditory Cortex

Differences in the time-of-arrival of sounds at the two ears, or interaural temporal disparities (ITDs), constitute one of the major binaural cues that underlie our ability to localize sounds in space. In addition, ITDs contribute to our ability to detect and to discriminate sounds, such as speech, in noisy environments. For low-frequency signals, ITDs are conveyed primarily by "cycle-by-cycle" disparities present in the fine-structure of the waveform. For high-frequency signals, ITDs are conveyed by disparities within the time-varying amplitude, or envelope, of the waveform. The results of laboratory studies conducted over the past few decades indicate that ITDs within the envelopes of high-frequency are less potent than those within the fine-structure of low-frequency stimuli. This is true for both measures of sensitivity to changes in ITD and for measures of the extent of the perceived lateral displacement of sounds containing ITDs. Colburn and Esquissaud (1976) hypothesized that it is differences in the specific aspects of the waveform that are coded neurally within each monaural (single ear) channel that account for the greater potency of ITDs at low frequencies rather than any differences in the more central binaural mechanisms that serve these different frequency regions. In this review, the results of new studies are reported that employed special high-frequency "transposed" stimuli that were designed to provide the high-frequency channels of the binaural processor with envelope-based information that mimics waveform-based information normally available only in low-frequency channels. The results demonstrate that these high-frequency transposed stimuli (1) yield sensitivity to ITDs that approaches, or is equivalent to, that obtained with "conventional" low-frequency stimuli and (2) yield large extents of laterality that are similar to those measured with conventional low-frequency stimuli. These findings suggest that by providing the high-frequency channels of the binaural processor with information that mimics that normally available only at low frequencies, the potency of ITDs in the two frequency regions can be made to be similar, if not identical. These outcomes provide strong support for Colburn and Esquissaud's (1976) hypothesis. The use of high-frequency transposed stimuli, in both behavioral and physiological investigations offers the promise of new and important insights into the nature of binaural processing.

Julian Ashton

Papers

The effect of carrier and modulation frequency on lateralization based on interaural phase and interaural group delay