Biomedical subjects

Paul Bertelson

Publications and source records attributed to Paul Bertelson.

5 recordsLinked to original sources

PubMed2003

Multisensory integration, perception and ecological validity.

Studies of multimodal integration have relied to a large extent on conflict situations, in which two sensory modalities receive incongruent data concerning one aspect of the source. Exposure to such situations produces immediate crossmodal biases as well as longer lasting aftereffects, revealing recalibrations of data-to-percept matches. In the natural environment, such phenomena might be adaptive, by reducing the perturbing effects of factors like noise or growth-induced changes in receptor organs, and by enriching the percept. However, experimental results generalize to real life only when they reflect automatic perceptual processes, and not response strategies adopted to satisfy the particular demands of laboratory tasks. Here, we focus on this issue and review ways of addressing it that have been developed recently.

Journal Article↗

PubMed2003

The aftereffects of ventriloquism: are they sound-frequency specific?

Exposing different sense modalities (like sight, hearing or touch) to repeated simultaneous but spatially discordant stimulations generally causes recalibration of localization processes in one or both of the involved modalities, which is manifested through aftereffects. These provide opportunities for determining the extent of the changes induced by the exposure. Taking the so-called ventriloquism situation, in which synchronized sounds and light flashes are delivered in different locations, we examine if auditory recalibration produced by exposing tones of one frequency to attraction by discordant light flashes generalizes to different frequencies. Contrary to an earlier report, generalization was obtained across two octaves. This result did not depend on which modality attention was forced on through catch trials during exposure. Implications concerning the functional site of recalibration are briefly discussed.

Adaptation, Physiological↗

PubMed2003

Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment.

In the well-known visual bias of auditory location (alias the ventriloquist effect), auditory and visual events presented in separate locations appear closer together, provided the presentations are synchronized. Here, we consider the possibility of the converse phenomenon: crossmodal attraction on the time dimension conditional on spatial proximity. Participants judged the order of occurrence of sound bursts and light flashes, respectively, separated in time by varying stimulus onset asynchronies (SOAs) and delivered either in the same or in different locations. Presentation was organized using randomly mixed psychophysical staircases, by which the SOA was reduced progressively until a point of uncertainty was reached. This point was reached at longer SOAs with the sounds in the same frontal location as the flashes than in different places, showing that apparent temporal separation is effectively longer in the first condition. Together with a similar one obtained recently in a case of tactile-visual discrepancy, this result supports a view in which timing and spatial layout of the inputs play to some extent inter-changeable roles in the pairing operation at the base of crossmodal interaction.

Acoustic Stimulation↗

PubMed2003

Temporal ventriloquism: crossmodal interaction on the time dimension. 2. Evidence from sensorimotor synchronization.

In two experiments, we measured audio-visual crossmodal attraction on the time dimension, using a sensorimotor synchronization task. Synchronization performance made it possible to split up the total crossmodal attraction (demonstrated in earlier studies through inter-modal temporal order judgments) into its modality-specific components, the auditory bias of the visual event's perceived time of occurrence and the visual bias of the auditory event's perceived time of occurrence. Participants were asked to produce tapping movements in synchrony with a sequence of isochronously repeated pacing signals. In Experiment 1, pacing signals were light flashes, each preceded or followed, at one of several stimulus onset asynchronies (SOAs), by an auditory distracter that the participant was instructed to ignore. The timing of the tap was, in spite of that instruction, strongly biased toward the distracter. In Experiment 2, the converse task was used. The pacing signals were auditory and the to be ignored distracters, light flashes. The timing of the taps was biased significantly here also toward the distracter, but to a much lesser extent. Taken together, these results clearly demonstrate that audition plays a bigger role than vision in temporal ventriloquism and is probably generally superior to vision for processing the temporal dimension of events.

Acoustic Stimulation↗

PubMed2003

Visual recalibration of auditory speech identification: a McGurk aftereffect.

The kinds of aftereffects, indicative of cross-modal recalibration, that are observed after exposure to spatially incongruent inputs from different sensory modalities have not been demonstrated so far for identity incongruence. We show that exposure to incongruent audiovisual speech (producing the well-known McGurk effect) can recalibrate auditory speech identification. In Experiment 1, exposure to an ambiguous sound intermediate between /aba/ and /ada/ dubbed onto a video of a face articulating either /aba/ or /ada/ increased the proportion of /aba/ or /ada/ responses, respectively, during subsequent sound identification trials. Experiment 2 demonstrated the same recalibration effect or the opposite one, fewer /aba/ or /ada/ responses, revealing selective speech adaptation, depending on whether the ambiguous sound or a congruent nonambiguous one was used during exposure. In separate forced-choice identification trials, bimodal stimulus pairs producing these contrasting effects were identically categorized, which makes a role of postperceptual factors in the generation of the effects unlikely.

Auditory Perception↗