Biomedical subjects

Dominic W Massaro

Publications and source records attributed to Dominic W Massaro.

6 recordsLinked to original sources

PubMed2006

Read my lips: The importance of the face in a computer-animated tutor for vocabulary learning by children with autism.

A computer-animated tutor, Baldi, has been successful in teaching vocabulary and grammar to children with autism and those with hearing problems. The present study assessed to what extent the face facilitated this learning process relative to the voice alone. Baldi was implemented in a Language Wizard/Tutor, which allows easy creation and presentation of a vocabulary lesson involving the association of pictures and spoken words. The lesson plan included both the receptive identification of pictures and the production of spoken words. A within-subject design with five children with autism followed an alternating treatment in which each child continuously learned to criterion sets of words with and without the face. The rate of learning was significantly faster and the retention was better with the face. The research indicates that at least some children with autism benefit from the face in learning new language within an automated program.

Adolescent↗

PubMed2004

Using visible speech to train perception and production of speech for individuals with hearing loss.

The main goal of this study was to implement a computer-animated talking head, Baldi, as a language tutor for speech perception and production for individuals with hearing loss. Baldi can speak slowly; illustrate articulation by making the skin transparent to reveal the tongue, teeth, and palate; and show supplementary articulatory features, such as vibration of the neck to show voicing and turbulent airflow to show frication. Seven students with hearing loss between the ages of 8 and 13 were trained for 6 hours across 21 weeks on 8 categories of segments (4 voiced vs. voiceless distinctions, 3 consonant cluster distinctions, and 1 fricative vs. affricate distinction). Training included practice at the segment and the word level. Perception and production improved for each of the 7 children. Speech production also generalized to new words not included in the training lessons. Finally, speech production deteriorated somewhat after 6 weeks without training, indicating that the training method rather than some other experience was responsible for the improvement that was found.

Adolescent↗

PubMed2004

Mandarin speech perception by ear and eye follows a universal principle.

In this study, the nature of speech perception of native Mandarin Chinese was compared with that of American English speakers, using synthetic visual and auditory continua (from /ba/ to /da/) in an expanded factorial design. In Experiment 1, speakers identified synthetic unimodal and bimodal speech syllables as either /ba/ or /da/. In Experiment 2, Mandarin speakers were given nine possible response alternatives. Syllable identification was influenced by both visual and auditory sources of information for both Mandarin and English speakers. Performance was better described by the fuzzy logical model of perception than by an auditory dominance model or a weighted-averaging model. Overall, the results are consistent with the idea that although there may be differences in information (which reflect differences in phonemic repertoires, phonetic realizations of the syllables, and the phonotactic constraints of languages), the underlying nature of audiovisual speech processing is similar across languages.

Adolescent↗

PubMed2003

Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism.

Using our theoretical framework of multimodal processing, we developed and evaluated a computer-animated tutor, Baldi, to teach vocabulary and grammar for children with autism. Baldi was implemented in a Language Wizard/Player, which allows easy creation and presentation of a language lesson involving the association of pictures and spoken words. The lesson plan includes both the identification of pictures and the production of spoken words. In Experiment 1, eight children were given initial assessment tests, tutorials, and reassessment tests 30 days following mastery of the vocabulary items. All of the students learned a significant number of new words and grammar. A second within-subject design with six children followed a multiple baseline design and documented that the program was responsible for the learning and generalization of new words. The research indicates that children with autism are capable of learning new language within an automated program centered around a computer-animated agent, multimedia, and active participation and can transfer and use the language in a natural, untrained environment.

Autistic Disorder↗

PubMed2003

Perceiving prosody from the face and voice: distinguishing statements from echoic questions in English.

We examined the processing of potential auditory and visual cues that differentiate statements from echoic questions. In Experiment 1, four natural speech statement-question pairs were identified by participants, and then analyzed to determine which characteristics were ecologically valid. These characteristics were tested in subsequent experiments to determine if they were also functionally valid. In Experiment 2, the characteristics of the most discriminable utterance pair were successfully extended to the other utterance pairs. For Experiment 3, an auditory continuum (varying in F0, amplitude, duration) was crossed with a visual continuum (varying in eyebrow raise, head tilt), using synthetic speech and a computer-animated head. Participants judged five levels along each of these two speech continua between a prototypical statement and prototypical question, in an expanded factorial design. Experiments 4 and 5 were unable to appreciably enhance the weak visual effect relative to the strong auditory effect (from Experiment 3). Overall, we found that both auditory and visual cues reliably conveyed statement and question intonation, were successfully synthesized, and generalized to other utterances. However, the weak visual effect relative to the robustly strong auditory effect precluded optimal integration and conclusive examination of information processing through model-fitting.

Adolescent↗

PubMedDate not supplied

Visual-auditory integration during speech imitation in autism.

Children with autistic spectrum disorder (ASD) may have poor audio-visual integration, possibly reflecting dysfunctional 'mirror neuron' systems which have been hypothesised to be at the core of the condition. In the present study, a computer program, utilizing speech synthesizer software and a 'virtual' head (Baldi), delivered speech stimuli for identification in auditory, visual or bimodal conditions. Children with ASD were poorer than controls at recognizing stimuli in the unimodal conditions, but once performance on this measure was controlled for, no group difference was found in the bimodal condition. A group of participants with ASD were also trained to develop their speech-reading ability. Training improved visual accuracy and this also improved the children's ability to utilize visual information in their processing of speech. Overall results were compared to predictions from mathematical models based on integration and non-integration, and were most consistent with the integration model. We conclude that, whilst they are less accurate in recognizing stimuli in the unimodal condition, children with ASD show normal integration of visual and auditory speech stimuli. Given that training in recognition of visual speech was effective, children with ASD may benefit from multi-modal approaches in imitative therapy and language training.

Adolescent↗