PubMed Health⌕ Search
Home/Archive/PubMed

PubMed · 11919005

Processing of changes in visual speech in the human auditory cortex.

Riikka Möttönen·Christina M Krause·Kaisa Tiippana·Mikko Sams
View original source ↗Export metadata ↓

Abstract

Seeing a talker's articulatory gestures may affect the observer's auditory speech percept. Observing congruent articulatory gestures may enhance the recognition of speech sounds [J. Acoust. Soc. Am. 26 (1954) 212], whereas observing incongruent gestures may change the auditory percept phonetically as occurs in the McGurk effect [Nature 264 (1976) 746]. For example, simultaneous acoustic /ba/ and visual /ga/ are usually heard as /da/. We studied cortical processing of occasional changes in audiovisual and visual speech stimuli with magnetoencephalography. In the audiovisual experiment congruent (acoustic /iti/, visual /iti/) and incongruent (acoustic /ipi/, visual /iti/) audiovisual stimuli, which were both perceived as /iti/, were presented among congruent /ipi/ (acoustic /ipi/, visual /ipi/) stimuli. In the visual experiment only the visual components of these stimuli were presented. A visual change both in audiovisual and visual experiments activated supratemporal auditory cortices bilaterally. The auditory cortex activation to a visual change occurred later in the visual than in the audiovisual experiment, suggesting that interaction between modalities accelerates the detection of visual change in speech.

Explore related subjects

Acoustic StimulationAdultAuditory CortexDiscrimination LearningFemaleGesturesHumansMagnetic Resonance ImagingMagnetoencephalographyMaleMiddle AgedPhotic StimulationPsychoacousticsRecognition, PsychologySpeech PerceptionTime FactorsVisual PerceptionJournal ArticleResearch Support, Non-U.S. Gov't

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Riikka Möttönen, Christina M Krause, Kaisa Tiippana, Mikko Sams. 2002. Processing of changes in visual speech in the human auditory cortex.. https://doi.org/10.1016/s0926-6410(02)00053-8

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

PubMed2003

The effect of musical training on music processing: a functional magnetic resonance imaging study in humans.

Previous studies have demonstrated changes in neuronal activity in trained musicians relative to controls while performing various music processing tasks. In this study the neural correlates of the effect of music training on two aspects of music processing, melody and harmony, are investigated using functional magnetic resonance imaging (fMRI). Fifteen subjects, seven with continuous musical training from early childhood to adulthood and eight without, underwent a passive fMRI listening paradigm designed to test the effects of melodic and harmonic processing. Melodic processing activated the most anterior part of the superior temporal gyrus for both musicians and non-musicians, while harmonic processing activated different visual association areas for musicians relative to non-musicians. The inferior parietal lobules were recruited only by musicians for both tasks. We conclude that musical training results in the recruitment of different neural networks for these aspects of music processing.

Acoustic Stimulation↗
PubMed2003

Magnetoencephalographic study of the cortical activity elicited by human voice.

In an attempt to identify voice-specific neural activities in auditory cortex in humans, we recorded cortical magnetic responses. Volunteers were instructed to listen to vocal and instrumental sounds matched in fundamental-frequency, duration, temporal envelope and average root mean square power. The stimuli were sounds produced by four singers and four musical instruments at each of two fundamental frequencies: 220 Hz (musical note A3) and 261.9 Hz (C3). Two components of the evoked responses were analyzed, one at approximately 100 ms (N1m) and the other 400 ms after the stimulus onset (sustained field, SF). The source locations of equivalent current dipoles for both components were estimated around the Heschl's gyrus in both hemispheres. Compared with the instrumental sound, the source strength of the SF component for the voice was significantly larger.

Acoustic Stimulation↗
PubMed2003

Deficient speech-sound processing, as shown by the electrophysiologic brain mismatch negativity response, and naming ability in prematurely born children.

Very low birth weight (VLBW, <1500 g) preterm birth has been associated with anatomic abnormalities in brain development and cognitive and language disorders. We examined object naming ability, and an electrophysiologic index of auditory sensory discrimination of speech sounds (the mismatch negativity, MMN) in 4-year-old VLBW prematurely born children. We found that half of the VLBW children were inferior to their controls in the object naming ability. Also the MMN amplitudes were smaller in the preterm group as compared with the controls. Further, the MMN amplitude varied as a function of children's performance on object naming, such that the weaker object-naming performance of the preterm group was paralleled by the diminished MMN amplitudes. Therefore, difficulties in auditory discrimination seem to be implicated in language difficulties encountered in VLBW prematurely born children.

Acoustic Stimulation↗