PubMed Health⌕ Search

Biomedical subjects

Charles E Schroeder

Publications and source records attributed to Charles E Schroeder.

10 recordsLinked to original sources

Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment.

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

Adult↗

Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex.

We examined effects of eye position on auditory cortical responses in macaques. Laminar current-source density (CSD) and multiunit activity (MUA) profiles were sampled with linear array multielectrodes. Eye position significantly modulated auditory-evoked CSD amplitude in 24/29 penetrations (83%), across A1 and belt regions; 4/24 cases also showed significant MUA AM. Eye-position effects occurred mainly in the supragranular laminae and lagged the co-located auditory response by, on average, 38 ms. Effects in A1 and belt regions were indistinguishable in amplitude, laminar profile, and latency. The timing and laminar profile of the eye-position effects suggest that they are not combined with auditory signals at a subcortical stage of the lemniscal auditory pathways and simply "fed-forward" into cortex. Rather, these effects may be conveyed to auditory cortex by feedback projections from parietal or frontal cortices, or alternatively, they may be conveyed by nonclassical feedforward projections through auditory koniocellular (calbindin positive) neurons.

Acoustic Stimulation↗

Neural dynamics and the fundamental mechanisms of event-related brain potentials.

Event-related potentials (ERPs) provide a critical link between the hemodynamic response, as measured by functional magnetic resonance imaging, and the dynamics of the underlying neuronal activity. Single-trial ERP recordings capture the oscillatory activity that are hypothesized to underlie both communication between brain regions and amplified processing of behaviorally relevant stimuli. However, precise interpretations of ERPs are precluded by uncertainty about their neural mechanisms. One influential theory holds that averaged sensory ERPs are generated by partial phase resetting of ongoing electroencephalographic oscillations, while another states that ERPs result from stimulus-evoked neural responses. We formulated critical predictions of each theory and tested these using direct, intracortical analyses of neural activity in monkeys. Our findings support a predominant role for stimulus-evoked activity in sensory ERP generation, and they outline both logic and methodology necessary for differentiating evoked and phase resetting contributions to cognitive and motor ERPs in future studies.

Animals↗

Estimation of single-trial multicomponent ERPs: differentially variable component analysis (dVCA).

A Bayesian inference framework for estimating the parameters of single-trial, multicomponent, event-related potentials is presented. Single-trial recordings are modeled as the linear combination of ongoing activity and multicomponent waveforms that are relatively phase-locked to certain sensory or motor events. Each component is assumed to have a trial-invariant waveform with trial-dependent amplitude scaling factors and latency shifts. A Maximum a Posteriori solution of this model is implemented via an iterative algorithm from which the component's waveform, single-trial amplitude scaling factors and latency shifts are estimated. Multiple components can be derived from a single-channel recording based on their differential variability, an aspect in contrast with other component analysis techniques (e.g., independent component analysis) where the number of components estimated is equal to or smaller than the number of recording channels. Furthermore, we show that, by subtracting out the estimated single-trial components from each of the single-trial recordings, one can estimate the ongoing activity, thus providing additional information concerning task-related brain dynamics. We test this approach, which we name differentially variable component analysis (dVCA), on simulated data and apply it to an experimental dataset consisting of intracortically recorded local field potentials from monkeys performing a visuomotor pattern discrimination task.

Algorithms↗

Auditory cortical neurons respond to somatosensory stimulation.

The prevailing hierarchical model of cortical sensory processing holds that early processing is specific to individual modalities and that combination of information from different modalities is deferred until higher-order stages of processing. In this paper, we present physiological evidence of multisensory convergence at an early stage of cortical auditory processing. We used multi-neuron cluster recordings, along with a limited sample of single-unit recordings, to determine whether neurons in the macaque auditory cortex respond to cutaneous stimulation. We found coextensive cutaneous and auditory responses in caudomedial auditory cortex, an area lying adjacent to A1, and at the second stage of the auditory cortical hierarchy. Somatosensory-auditory convergence in auditory cortex may underlie effects observed in human studies. Convergence of inputs from different sensory modalities at very early stages of cortical sensory processing has important implications for both our developing understanding of multisensory processing and established views of unisensory processing.

Acoustic Stimulation↗

Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing.

Recent findings in both monkeys and humans indicate that multisensory convergence occurs in low-level cortical structures generally believed to be unisensory in function. In an in-depth treatment of this theme, this paper reviews anatomical and physiological findings relating to the convergence of visual, somatosensory and auditory signals at early stages of auditory cortical processing. We discuss the potential anatomical sources of the input, and the types of known projections, and attempt to integrate this information with the current hierarchical model of auditory processing. Finally, we consider the functional implications of multisensory integration in early sensory processing.

Animals↗

The spatiotemporal dynamics of illusory contour processing: combined high-density electrical mapping, source analysis, and functional magnetic resonance imaging.

Because environmental information is often suboptimal, visual perception must frequently rely on the brain's reconstruction of contours absent from retinal images. Illusory contour (IC) stimuli have been used to investigate these "filling-in" processes. Intracranial recordings and neuroimaging studies show IC sensitivity in lower-tier area V2, and to a lesser extent V1. Some interpret these data as evidence for feedforward processing of IC stimuli, beginning at lower-tier visual areas. On the basis of lesion, visual evoked potentials (VEP), and neuroimaging evidence, others contend that IC sensitivity is a later, higher-order process. Whether IC sensitivity seen in lower-tier areas indexes feedforward or feedback processing remains unresolved. In a series of experiments, we addressed the spatiotemporal dynamics of IC processing. Centrally presented IC stimuli resulted in early VEP modulation (88-100 msec) over lateral-occipital (LOC) scalp--the IC effect. The IC effect followed visual response onset by 40 msec. Scalp current density topographic mapping, source analysis, and functional magnetic resonance imaging results all localized the IC effect to bilateral LOC areas. We propose that IC sensitivity described in V2 and V1 may reflect predominantly feedback modulation from higher-tier LOC areas, where IC sensitivity first occurs. Two additional observations further support this proposal. The latency of the IC effect shifted dramatically later (approximately 120 msec) when stimuli were laterally presented, indicating that retinotopic position alters IC processing. Immediately preceding the IC effect, the VEP modulated with inducer eccentricity--the configuration effect. We interpret this to represent contributions from global stimulus parameters to scene analysis. In contrast to the IC effect, the topography of the configuration effect was restricted to central parieto-occipital scalp.

Adult↗

Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study.

Integration of information from multiple senses is fundamental to perception and cognition, but when and where this is accomplished in the brain is not well understood. This study examined the timing and topography of cortical auditory-visual interactions using high-density event-related potentials (ERPs) during a simple reaction-time (RT) task. Visual and auditory stimuli were presented alone and simultaneously. ERPs elicited by the auditory and visual stimuli when presented alone were summed ('sum' ERP) and compared to the ERP elicited when they were presented simultaneously ('simultaneous' ERP). Divergence between the 'simultaneous' and 'sum' ERP indicated auditory-visual (AV) neural response interactions. There was a surprisingly early right parieto-occipital AV interaction, consistent with the finding of an earlier study [J. Cogn. Neurosci. 11 (1999) 473]. The timing of onset of this effect (46 ms) was essentially simultaneous with the onset of visual cortical processing, as indexed by the onset of the visual C1 component, which is thought to represent the earliest cortical visual evoked potential. The coincident timing of the early AV interaction and C1 strongly suggests that AV interactions can affect early visual sensory processing. Additional AV interactions were found within the time course of sensory processing (up to 200 ms post stimulus onset). In total, this system of AV effects over the scalp was suggestive of both activity unique to multisensory processing, and the modulation of 'unisensory' activity. RTs to the stimuli when presented simultaneously were significantly faster than when they were presented alone. This RT facilitation could not be accounted for by probability summation, as evidenced by violation of the 'race' model, providing compelling evidence that auditory-visual neural interactions give rise to this RT effect.

Acoustic Stimulation↗

The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex.

Two fundamental requirements for multisensory integration are convergence of unisensory (e.g. visual and auditory) inputs and temporal alignment of the neural responses to convergent inputs. We investigated the anatomic mechanisms of multisensory convergence by examining three areas in which convergence occurs, posterior auditory association cortex, superior temporal polysensory area (STP) and ventral intraparietal sulcus area (VIP). The first of these was recently shown to be a site of multisensory convergence and the latter two are more well known as 'classic' multisensory regions. In each case, we focused on defining the laminar profile of response to the unisensory inputs. This information is useful because two major types of connection, feedforward and feedback, have characteristic differences in laminar termination patterns, which manifest physiologically. In the same multisensory convergence areas we also examined the timing of the unisensory inputs using the same standardized stimuli across all recordings. Our findings indicate that: (1) like somatosensory input [J. Neurophysiol., 85 (2001) 1322], visual input is available at very early stages of auditory processing, (2) convergence occurs through feedback, as well as feedforward anatomical projections and (3) input timing may be an asset, as well as a constraint in multisensory processing.

Acoustic Stimulation↗

Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study.

Using high-field (3 Tesla) functional magnetic resonance imaging (fMRI), we demonstrate that auditory and somatosensory inputs converge in a subregion of human auditory cortex along the superior temporal gyrus. Further, simultaneous stimulation in both sensory modalities resulted in activity exceeding that predicted by summing the responses to the unisensory inputs, thereby showing multisensory integration in this convergence region. Recently, intracranial recordings in macaque monkeys have shown similar auditory-somatosensory convergence in a subregion of auditory cortex directly caudomedial to primary auditory cortex (area CM). The multisensory region identified in the present investigation may be the human homologue of CM. Our finding of auditory-somatosensory convergence in early auditory cortices contributes to mounting evidence for multisensory integration early in the cortical processing hierarchy, in brain regions that were previously assumed to be unisensory.

Acoustic Stimulation↗