PubMed Health⌕ Search

Biomedical subjects

D J Fleet

Publications and source records attributed to D J Fleet.

9 recordsLinked to original sources

Texture space.

Many previous studies have examined the ease with which two spatially adjacent textures can be segmented. Our goal is to examine the representational system that determines the appearance of isolated patches of visual texture. To this end, similarity judgments from three subjects were obtained for 20 artificial textures comprising filtered noise. Multidimensional scaling (MDS) revealed that three perceptual dimensions explain most of the variance in subjects' similarity judgments. In addition, the three subjects' similarity judgments and MDS solutions were highly correlated. A computational model utilizing the energy responses in seven bandpass filters explains an average of 80% of the variability in the original similarity scores of individual subjects. In the model, energy responses are mapped to the perceptual space through a linear transformation that can be decomposed into two components. The first component decorrelates initial filter responses and the second component maps the decorrelated filter responses to a perceptual space. These latter transformations show remarkable agreement between the three subjects.

Form Perception↗

Human cortical activity correlates with stereoscopic depth perception.

Stereoscopic depth perception is based on binocular disparities. Although neurons in primary visual cortex (V1) are selective for binocular disparity, their responses do not explicitly code perceived depth. The stereoscopic pathway must therefore include additional processing beyond V1. We used functional magnetic resonance imaging (fMRI) to examine stereo processing in V1 and other areas of visual cortex. We created stereoscopic stimuli that portrayed two planes of dots in depth, placed symmetrically about the plane of fixation, or else asymmetrically with both planes either nearer or farther than fixation. The interplane disparity was varied parametrically to determine the stereoacuity threshold (the smallest detectable disparity) and the upper depth limit (largest detectable disparity). fMRI was then used to quantify cortical activity across the entire range of detectable interplane disparities. Measured cortical activity covaried with psychophysical measures of stereoscopic depth perception. Activity increased as the interplane disparity increased above the stereoacuity threshold and dropped as interplane disparity approached the upper depth limit. From the fMRI data and an assumption that V1 encodes absolute retinal disparity, we predicted that the mean response of V1 neurons should be a bimodal function of disparity. A post hoc analysis of electrophysiological recordings of single neurons in macaques revealed that, although the average firing rate was a bimodal function of disparity (as predicted), the precise shape of the function cannot fully explain the fMRI data. Although there was widespread activity within the extrastriate cortex (consistent with electrophysiological recordings of single neurons), area V3A showed remarkable sensitivity to stereoscopic stimuli, suggesting that neurons in V3A may play a special role in the stereo pathway.

Attention↗

Disparity tuning as simulated by a neural net.

Previous research has suggested that the processing of binocular disparity in complex cells may be described with an energy formalism. The energy formalism allows for a representation of disparity by differences in the position or in the phase of monocular receptive subfields of binocular cells, or by combination of these two types. We studied the coding of disparities with an approach complementary to previous algorithmic investigations. Since realization of these representations is probably not genetically determined but learned during ontogeny, we used backpropagation networks to study which of these three possibilities were realized within neural nets. Three types of networks were trained with noise patterns in analogy to the three types of energy models. The networks learned the task and generalized to untrained correlated noise pattern input. Outputs were broadly tuned to spatial frequency and did not respond to anti-correlated noise patterns. Although the energy model was not explicitly implemented, we could analyze the outputs of the networks using predictions of the energy formalism. After learning was completed, the model neurons preferred position shifts over phase shifts in representing disparity. We discuss the general meaning of these findings and the correspondences and deviations between the energy model, V1 neurons, and our networks.

Computer Simulation↗

Stereopsis from contrast envelopes.

We report two experiments concerning the site of the principal nonlinearity in second-order stereopsis. The first exploits the asymmetry in perceiving transparency with second-order stimuli found by Langley et al. (1998) (Proceedings of the Royal Society of London B, 265, 1837-1845) i.e. the product of a positive-valued contrast envelope and a mean-zero carrier grating can be seen transparently only when the disparities are consistent with the envelope appearing in front of the carrier. We measured the energy at the envelope frequencies that must be added in order to negate this asymmetry. We report that this amplitude can be predicted from the envelope sidebands and not from the magnitude of compressive pre-cortical nonlinearities measured by other researchers. In the second experiment, contrast threshold elevations were measured for the discrimination of envelope disparities following adaptation to sinusoidal gratings. It is reported that perception of the envelope's depth was affected most when the adapting grating was similar (in orientation and frequency) to the carrier, rather than to the contrast envelope. These results suggest that the principal nonlinearity in second-order stereopsis is cortical, occurring after orientation- and frequency-selective linear filtering.

Adaptation, Ocular↗

Linear and nonlinear transparencies in binocular vision.

When the product of a vertical square-wave grating (contrast envelope) and a horizontal sinusoidal grating (carrier) are viewed binocularly with different disparity cues they can be perceived transparently at different depths. We found, however, that the transparency was asymmetric; it only occurred when the envelope was perceived to be the overlaying surface. When the same two signals were added, the percept of transparency was symmetrical; either signal could be seen in front of or behind the other at different depths. Differences between these multiplicative and additive signal combinations were examined in two experiments. In one, we measured disparity thresholds for transparency as a function of the spatial frequency of the envelope. In the other, we measured disparity discrimination thresholds. In both experiments the thresholds for the multiplicative condition, unlike the additive condition, showed distinct minima at low envelope frequencies. The different sensitivity curves found for multiplicative and additive signal combinations suggest that different processes mediated the disparity signal. The data are consistent with a two-channel model of binocular matching, with multiple depth cues represented at single retinal locations.

Depth Perception↗

Linear filtering precedes nonlinear processing in early vision.

BACKGROUND: Nonlinearities play a significant role in early visual processing. They are central to the perception of spatial contrast variations, multiplicative transparencies and texture boundaries. This article concerns the stage of processing at which nonlinearities first become significant. RESULTS: Subjects were adapted to a high contrast sinusoidal grating followed by a brief presentation of a contrast modulated test (plaid) pattern. Thresholds for the detection of the contrast modulation (the beat) were measured. Results show that threshold elevation is greatest when the orientation and spatial frequency of the adapting grating are close to the principal Fourier frequency (the carrier) of the test pattern. Adaptation to sinewave-gratings near the frequency of the contrast modulation has relatively little effect. The data also show that the processing of contrast is frequency selective, with a peak tuning frequency near 0.4 cycles per degree. CONCLUSIONS: The data are consistent with a model in which the contrast beats are processed in a frequency-specific manner, after an initial stage of frequency-specific and orientation-specific linear filtering.

Models, Biological↗

Neural encoding of binocular disparity: energy models, position shifts and phase shifts.

Neurophysiological data support two models for the disparity selectivity of binocular simple and complex cells in primary visual cortex. These involve binocular combinations of monocular receptive fields that are shifted in retinal position (the position-shift model) or in phase (the phase-shift model) between the two eyes. This article presents a formal description and analysis of a binocular energy model with these forms of disparity selectivity. We propose how one might measure the relative contributions of phase and position shifts in simple and complex cells. The analysis also reveals ambiguities in disparity encoding that are inherent in these model neurons, suggesting a need for a second stage of processing. We propose that linear pooling of the binocular responses across orientations and scales (spatial frequency) is capable of producing an unambiguous representation of disparity.

Depth Perception↗

Computational analysis of non-Fourier motion.

Non-Fourier motion is now commonplace in research on visual motion perception, yet lacks a computational framework. This paper examines this issue based on the observation that many non-Fourier motion stimuli have a simple characterization in the frequency domain, in terms of oriented power distributions that lie along lines (or planes) that do not pass through the origin. This provides a unifying theoretical framework for a very diverse class of non-Fourier phenomena. It also allows us to examine some central issues concerning the computational nature of non-Fourier models, and naturally occurring sources of non-Fourier motion. For example, it is shown that the orientation of power in frequency domain corresponds to the velocity of a multiplicative envelope, and may arise as a restricted form of lighting effects, translucency or occlusion. We also show that both the location and orientation of spectral power may be extracted from the phase and amplitude output of band-pass filters, consonant with existing non-Fourier models.

Fourier Analysis↗

Spatiotemporal inseparability in early visual processing.

We examine the implications of significant inseparable behaviour in centre-surround retinal cell types. From the form of a spatiotemporal centre-surround (CS) model which agrees qualitatively with physiological observations, we find that the sustained/transient dichotomy is a poor distinction for X-type/Y-type retinal ganglion cells since both exhibit inseparability. Static centre-surround models and spatiotemporal separable models are not valid for time-varying stimuli. Our results contradict the models for X- and Y-type ganglion cells proposed by Marr and Hildreth (1980) and Marr and Ullman (1981), and raise doubts about the physiological validity of Marr's zero-crossing theory. The CS filter is an attractive precursor to the extraction of 2-d motion information.

Animals↗