PubMed Health⌕ Search

Biomedical subjects

Jason M Gold

Publications and source records attributed to Jason M Gold.

6 recordsLinked to original sources

An ideal observer analysis of variability in visual-only speech.

Normal-hearing observers typically have some ability to "lipread," or understand visual-only speech without an accompanying auditory signal. However, talkers vary in how easy they are to lipread. Such variability could arise from differences in the visual information available in talkers' speech, human perceptual strategies that are better suited to some talkers than others, or some combination of these factors. A comparison of human and ideal observer performance in a visual-only speech recognition task found that although talkers do vary in how much physical information they produce during speech, human perceptual strategies also play a role in talker variability.

Communication Methods, Total↗

The spatiotemporal properties of visual completion measured by response classification.

A constant problem faced by the visual system is the identification of partly occluded objects within the visual scene. Recent experiments have demonstrated that the visual system engages in a process of visual completion, where the hidden parts of objects are filled into the visual representation. Recent experiments have also suggested that there may be a time course to this completion process. Here, we examined the spatiotemporal properties of visual completion by having observers classify figures defined by either luminance-defined or illusory contours and then correlating their decisions with externally added spatiotemporal visual noise. This "response classification" technique allowed us to derive a spatiotemporal correlation map (a "classification movie") that revealed the locations used by observers at each point in space and time during the stimulus presentation. We found that observers gradually became more influenced by noise at locations corresponding to illusory contours across the first 175 ms of stimulus presentation. Our results are consistent with the idea that there is a time course to the completion process on the order of approximately 175 ms.

Artifacts↗

Visual noise reveals category representations.

How are categories represented in human memory? Exemplar models assume that a category is represented by individual instances from that category that have been experienced. More generally, a category might be represented by multiple templates stored in memory. A new item is classified according to its similarity to these templates. Prototype models represent a category with a single summary abstraction (i.e., a single template), often the central tendency of the experienced items. A new item is classified according to its similarity to these category prototypes. Here, we show how a technique for correlating observers' responses with external noise can be used not only to distinguish single- from multiple-template representations, but also to induce the form of these templates. The technique is applied to two tasks requiring categorization of simple visual patterns; the results demonstrate that observers used multiple traces to represent their categories, and thus highlight the procedure's potential for use in more complex settings.

Humans↗

Visual memory decay is deterministic.

After observers see an object or pattern, their visual memory of what they have seen decays slowly over time. Nearly all current theories of vision assume that decay of short-term memory occurs because visual representations are progressively and randomly corrupted as time passes. We tested this assumption using psychophysical noise-masking methods, and we found that visual memory decays in a completely deterministic fashion. This surprising finding challenges current ideas about visual memory and sets a goal for future memory research: to characterize the deterministic "forgetting function" that describes how memories decay over time.

Choice Behavior↗

Inversion leads to quantitative, not qualitative, changes in face processing.

Humans are remarkably adept at recognizing objects across a wide range of views. A notable exception to this general rule is that turning a face upside down makes it particularly difficult to recognize. This striking effect has prompted speculation that inversion qualitatively changes the way faces are processed. Researchers commonly assume that configural cues strongly influence the recognition of upright, but not inverted, faces. Indeed, the assumption is so well accepted that the inversion effect itself has been taken as a hallmark of qualitative processing differences. Here, we took a novel approach to understand the inversion effect. We used response classification to obtain a direct view of the perceptual strategies underlying face discrimination and to determine whether orientation effects can be explained by differential contributions of nonlinear processes. Inversion significantly impaired performance in our face discrimination task. However, surprisingly, observers utilized similar, local regions of faces for discrimination in both upright and inverted face conditions, and the relative contributions of nonlinear mechanisms to performance were similar across orientations. Our results suggest that upright and inverted face processing differ quantitatively, not qualitatively; information is extracted more efficiently from upright faces, perhaps as a by-product of orientation-dependent expertise.

Adult↗

Troubles with bubbles.

The bubbles method is a recently developed variant of reverse correlation methods that have been used in psychophysics and physiology. We show mathematically that for the broad and important class of noisy linear observers, the bubbles method recovers much less information about how observers process stimuli than reverse correlation does. We also show experimentally that the unusual type of noise used in the bubbles method can drastically change human observers' strategies in psychophysical tasks, which reduces the value of the information that is obtained from a bubbles experiment. We conclude that reverse correlation is generally preferable to the bubbles method in its present form, but we also give suggestions as to how the bubbles method could be modified to avoid the problems we discuss.

Humans↗