Biomedical subjects

Ying Choon Wu

Publications and source records attributed to Ying Choon Wu.

3 recordsLinked to original sources

PubMed2007

How iconic gestures enhance communication: an ERP study.

EEG was recorded as adults watched short segments of spontaneous discourse in which the speaker's gestures and utterances contained complementary information. Videos were followed by one of four types of picture probes: cross-modal related probes were congruent with both speech and gestures; speech-only related probes were congruent with information in the speech, but not the gesture; and two sorts of unrelated probes were created by pairing each related probe with a different discourse prime. Event-related potentials (ERPs) elicited by picture probes were measured within the time windows of the N300 (250-350 ms post-stimulus) and N400 (350-550 ms post-stimulus). Cross-modal related probes elicited smaller N300 and N400 than speech-only related ones, indicating that pictures were easier to interpret when they corresponded with gestures. N300 and N400 effects were not due to differences in the visual complexity of each probe type, since the same cross-modal and speech-only picture probes elicited N300 and N400 with similar amplitudes when they appeared as unrelated items. These findings extend previous research on gesture comprehension by revealing how iconic co-speech gestures modulate conceptualization, enabling listeners to better represent visuo-spatial aspects of the speaker's meaning.

Adult↗

PubMed2005

Meaningful gestures: electrophysiological indices of iconic gesture comprehension.

To assess semantic processing of iconic gestures, EEG (29 scalp sites) was recorded as adults watched cartoon segments paired with soundless videos of congruous and incongruous gestures followed by probe words. Event-related potentials time-locked to the onset of gestures and probe words were measured in two experiments. In Experiment 1, participants judged the congruency between gestures and cartoons. Gestures elicited an N400-like component (gesture N450) that was larger for incongruent than congruent items, as well as a late positivity that was larger for congruent items. In Experiment 2, participants assessed the relatedness between probe words and preceding cartoon-gesture pairs. N450 effects to gestures were observed without overlapping positivity. These findings suggest that iconic gestures are subject to semantic processes analogous to those evoked by other meaningful representations, such as pictures and words.

Adult↗

PubMed2005

Right hemisphere activation of joke-related information: an event-related brain potential study.

Two studies tested the hypothesis that the right hemisphere engages in relatively coarse semantic coding that aids high-level language tasks such as joke comprehension. Scalprecorded event-related brain potentials (ERPs) were collected as healthy adults read probe words (CRAZY) preceded either by jokes or nonfunny controls ("Everyone had so much fun jumping into the swimming pool, we decided to put in a little water/platform"). Probes were related to the meaning of the jokes, but not the controls. In Experiment 1a, with central presentation, probes following jokes (related) elicited less negative ERPs 300-700 msec postonset (N400) than did probes following nonfunny controls (unrelated). This finding suggests related probes were primed by the jokes. In addition, unrelated probes elicited a larger anterior positivity 700-900 msec than did related, as irrelevant stimuli impacted control processes invoked by task demands. In Experiment 1b, probes (CRAZY) were preceded only by sentence-final words from jokes (water) or controls (platform). No ERP effects were observed in Experiment 1b, suggesting the N400 priming effect and the anterior positivity observed in Experiment 1a ref lect semantic activations at the discourse level. To assess hemispheric differences in semantic activations, in Experiment 2, ERPs were recorded as participants read probe words presented in their left and right visual fields (LVF and RVF, respectively). Probes elicited a smaller N400 component when preceded by jokes than controls. This N400 priming effect was larger with presentation to the LVF, suggesting joke-relevant information was more active in the right hemisphere. The anterior positivity was observed with RVF but not LVF presentation, suggesting an important role for the left hemisphere in controlled retrieval in language comprehension.

Acoustic Stimulation↗