PubMed Health⌕ Search

PubMed · 15641902

Modality-constrained statistical learning of tactile, visual, and auditory sequences.

Abstract

The authors investigated the extent to which touch, vision, and audition mediate the processing of statistical regularities within sequential input. Few researchers have conducted rigorous comparisons across sensory modalities; in particular, the sense of touch has been virtually ignored. The current data reveal not only commonalities but also modality constraints affecting statistical learning across the senses. To be specific, the authors found that the auditory modality displayed a quantitative learning advantage compared with vision and touch. In addition, they discovered qualitative learning biases among the senses: Primarily, audition afforded better learning for the final part of input sequences. These findings are discussed in terms of whether statistical learning is likely to consist of a single, unitary mechanism or multiple, modality-constrained ones.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Christopher M Conway, Morten H Christiansen. 2005. Modality-constrained statistical learning of tactile, visual, and auditory sequences.. https://doi.org/10.1037/0278-7393.31.1.24

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception.

Observing a speaker's mouth profoundly influences speech perception. For example, listeners perceive an "illusory" "ta" when the video of a face producing /ka/ is dubbed onto an audio /pa/. Here, we show how cortical areas supporting speech production mediate this illusory percept and audiovisual (AV) speech perception more generally. Specifically, cortical activity during AV speech perception occurs in many of the same areas that are active during speech production. We find that different perceptions of the same syllable and the perception of different syllables are associated with different distributions of activity in frontal motor areas involved in speech production. Activity patterns in these frontal motor areas resulting from the illusory "ta" percept are more similar to the activity patterns evoked by AV(/ta/) than they are to patterns evoked by AV(/pa/) or AV(/ka/). In contrast to the activity in frontal motor areas, stimulus-evoked activity for the illusory "ta" in auditory and somatosensory areas and visual areas initially resembles activity evoked by AV(/pa/) and AV(/ka/), respectively. Ultimately, though, activity in these regions comes to resemble activity evoked by AV(/ta/). Together, these results suggest that AV speech elicits in the listener a motor plan for the production of the phoneme that the speaker might have been attempting to produce, and that feedback in the form of efference copy from the motor system ultimately influences the phonetic interpretation.

Auditory Perception↗

Top-down processes during auditory phoneme categorization in dyslexia: a PET study.

While persistence of subtle phonological deficits in dyslexic adults is well documented, deficit of categorical perception of phonemes has received little attention so far. We studied learning of phoneme categorization during an activation H(2)O(15) PET experiment in 14 dyslexic adults and 16 normal readers with similar age, handedness and performance IQ. Dyslexic subjects exhibited typical, marked impairments in reading and phoneme awareness tasks. During the PET experiment, subjects performed a discrimination task involving sine wave analogues of speech first presented as pairs of electronic sounds and, after debriefing, as syllables /ba/ and /da/. Discrimination performance and brain activation were compared between the acoustic mode and the speech mode of the task which involved physically identical stimuli; signal changes in the speech mode relative to the acoustic mode revealed the neural counterparts of phonological top-down processes that are engaged after debriefing. Although dyslexic subjects showed good abilities to learn discriminating speech sounds, their performance remained lower than those of normal readers on the discrimination task over the whole experiment. Activation observed in the speech mode in normal readers showed a strongly left-lateralized pattern involving the superior temporal, inferior parietal and inferior lateral frontal cortex. Frontal and parietal subparts of these left-sided regions were significantly more activated in the control group than in the dyslexic group. Activations in the right frontal cortex were larger in the dyslexic group than in the control group for both speech and acoustic modes relative to rest. Dyslexic subjects showed an unexpected large deactivation in the medial occipital cortex for the acoustic mode that may reflect increased effortful attention to auditory stimuli.

Auditory Perception↗