PubMed HealthSearch

Biomedical subjects

D J Heeger

Publications and source records attributed to D J Heeger.

13 recordsLinked to original sources

Brain activity in visual cortex predicts individual differences in reading performance.

The relationship between brain activity and reading performance was examined to test the hypothesis that dyslexia involves a deficit in a specific visual pathway known as the magnocellular (M) pathway. Functional magnetic resonance imaging was used to measure brain activity in dyslexic and control subjects in conditions designed to preferentially stimulate the M pathway. Dyslexics showed reduced activity compared with controls both in the primary visual cortex and in a secondary cortical visual area (MT+) that is believed to receive a strong M pathway input. Most importantly, significant correlations were found between individual differences in reading rate and brain activity. These results support the hypothesis for an M pathway abnormality in dyslexia and imply a strong relationship between the integrity of the M pathway and reading ability.

Dyslexia

Linearity and normalization in simple cells of the macaque primary visual cortex.

Simple cells in the primary visual cortex often appear to compute a weighted sum of the light intensity distribution of the visual stimuli that fall on their receptive fields. A linear model of these cells has the advantage of simplicity and captures a number of basic aspects of cell function. It, however, fails to account for important response nonlinearities, such as the decrease in response gain and latency observed at high contrasts and the effects of masking by stimuli that fail to elicit responses when presented alone. To account for these nonlinearities we have proposed a normalization model, which extends the linear model to include mutual shunting inhibition among a large number of cortical cells. Shunting inhibition is divisive, and its effect in the model is to normalize the linear responses by a measure of stimulus energy. To test this model we performed extracellular recordings of simple cells in the primary visual cortex of anesthetized macaques. We presented large stimulus sets consisting of (1) drifting gratings of various orientations and spatiotemporal frequencies; (2) plaids composed of two drifting gratings; and (3) gratings masked by full-screen spatiotemporal white noise. We derived expressions for the model predictions and fitted them to the physiological data. Our results support the normalization model, which accounts for both the linear and the nonlinear properties of the cells. An alternative model, in which the linear responses are subject to a compressive nonlinearity, did not perform nearly as well.

Animals

Modeling the apparent frequency-specific suppression in simple cell responses.

Simple cells in cat striate cortex are selective for spatial frequency. It is widely believed that this selectivity arises simply because of the way in which the neurons sum inputs from the lateral geniculate nucleus. Alternate models, however, advocate the need for frequency-specific inhibitory mechanisms to refine the spatial frequency selectivity. Indeed, simple cell responses are often suppressed by superimposing stimuli with spatial frequencies that flank the neuron's preferred spatial frequency. In this article, we compare two models of simple cell responses head-to-head. One of these models, the flanking-suppression model, includes an inhibitory mechanism that is specific to frequencies that flank the neuron's preferred spatial frequency. The other model, the nonspecific-suppression model, includes a suppressive mechanism that is very broadly tuned for spatial frequency. Both models also include a rectification nonlinearity and both may include an additional accelerating (e.g., squaring) output nonlinearity. We demonstrate that both models can be consistent with the apparent flanking suppression. However, based on other experimental results, we argue that the nonspecific-suppression model is more plausible. We conclude that the suppression is probably broadly tuned for spatial frequency and that the apparent flanking suppression is actually due to distortions introduced by an accelerating output nonlinearity.

Animals

Linear systems analysis of functional magnetic resonance imaging in human V1.

The linear transform model of functional magnetic resonance imaging (fMRI) hypothesizes that fMRI responses are proportional to local average neural activity averaged over a period of time. This work reports results from three empirical tests that support this hypothesis. First, fMRI responses in human primary visual cortex (V1) depend separably on stimulus timing and stimulus contrast. Second, responses to long-duration stimuli can be predicted from responses to shorter duration stimuli. Third, the noise in the fMRI data is independent of stimulus contrast and temporal period. Although these tests can not prove the correctness of the linear transform model, they might have been used to reject the model. Because the linear transform model is consistent with our data, we proceeded to estimate the temporal fMRI impulse-response function and the underlying (presumably neural) contrast-response function of human V1.

Artifacts

Computational models of cortical visual processing.

The visual responses of neurons in the cerebral cortex were first adequately characterized in the 1960s by D. H. Hubel and T. N. Wiesel [(1962) J. Physiol. (London) 160, 106-154; (1968) J. Physiol. (London) 195, 215-243] using qualitative analyses based on simple geometric visual targets. Over the past 30 years, it has become common to consider the properties of these neurons by attempting to make formal descriptions of these transformations they execute on the visual image. Most such models have their roots in linear-systems approaches pioneered in the retina by C. Enroth-Cugell and J. R. Robson [(1966) J. Physiol. (London) 187, 517-552], but it is clear that purely linear models of cortical neurons are inadequate. We present two related models: one designed to account for the responses of simple cells in primary visual cortex (V1) and one designed to account for the responses of pattern direction selective cells in MT (or V5), an extrastriate visual area thought to be involved in the analysis of visual motion. These models share a common structure that operates in the same way on different kinds of input, and instantiate the widely held view that computational strategies are similar throughout the cerebral cortex. Implementations of these models for Macintosh microcomputers are available and can be used to explore the models' properties.

Computer Simulation

Neural encoding of binocular disparity: energy models, position shifts and phase shifts.

Neurophysiological data support two models for the disparity selectivity of binocular simple and complex cells in primary visual cortex. These involve binocular combinations of monocular receptive fields that are shifted in retinal position (the position-shift model) or in phase (the phase-shift model) between the two eyes. This article presents a formal description and analysis of a binocular energy model with these forms of disparity selectivity. We propose how one might measure the relative contributions of phase and position shifts in simple and complex cells. The analysis also reveals ambiguities in disparity encoding that are inherent in these model neurons, suggesting a need for a second stage of processing. We propose that linear pooling of the binocular responses across orientations and scales (spatial frequency) is capable of producing an unambiguous representation of disparity.

Depth Perception

Summation and division by neurons in primate visual cortex.

Recordings from monkey primary visual cortex (V1) were used to test a model for the visually driven responses of simple cells. According to the model, simple cells compute a linear sum of the responses of lateral geniculate nucleus (LGN) neurons. In addition, each simple cell's linear response is divided by the pooled activity of a large number of other simple cells. The cell membrane performs both operations; synaptic currents are summed and then divided by the total membrane conductance. Current and conductance are decoupled (by a complementary arrangement of excitation and inhibition) so that current depends only on the LGN inputs and conductance depends only on the cortical inputs. Closed form expressions were derived for fitting and interpreting physiological data. The model accurately predicted responses to drifting grating stimuli of various contrasts, orientations, and spatiotemporal frequencies.

Animals

Modeling simple-cell direction selectivity with normalized, half-squared, linear operators.

1. A longstanding view of simple cells is that they sum their inputs linearly. However, the linear model falls short of a complete account of simple-cell direction selectivity. We have developed a nonlinear model of simple-cell responses (hereafter referred to as the normalization model) to explain a larger body of physiological data. 2. The normalization model consists of an underlying linear stage along with two additional nonlinear stages. The first is a half-squaring nonlinearity; half-squaring is half-wave rectification followed by squaring. The second is a divisive normalization non-linearity in which each model cell is suppressed by the pooled activity of a large number of cells. 3. By comparing responses with counterphase (flickering) gratings and drifting gratings, researchers have demonstrated that there is a nonlinear contribution to simple-cell responses. Specifically they found 1) that the linear prediction from counterphase grating responses underestimates a direction index computed from drifting grating responses, 2) that the linear prediction correctly estimates responses to gratings drifting in the preferred direction, and 3) that the linear prediction overestimates responses to gratings drifting in the nonpreferred direction. 4. We have simulated model cell responses and derived mathematical expressions to demonstrate that the normalization model accounts for this empirical data. Specifically the model behaves as follows. 1) The linear prediction from counterphase data underestimates the direction index computed from drifting grating responses. 2) The linear prediction from counterphase data overestimates the response to gratings drifting in the nonpreferred direction. The discrepancy between the linear prediction and the actual response is greater when using higher contrast stimuli. 3) For an appropriate choice of contrast, the linear prediction from counterphase data correctly estimates the response to gratings drifting in the preferred direction. For higher contrasts the linear prediction overestimates the actual response, and for lower contrasts the linear prediction underestimates the actual response. 5. In addition, the normalization model is qualitatively consistent with data on the dynamics of simple-cell responses. Tolhurst et al. found that simple cells respond with an initial transient burst of activity when a stimulus first appears. The normalization model behaves similarly; it takes some time after a stimulus first appears before the model cells are fully normalized. We derived the dynamics of the model and found that the transient burst of activity in model cells depends in a particular way on stimulus contrast. The burst is short for high-contrast stimuli and longer for low-contrast stimuli.(ABSTRACT TRUNCATED AT 400 WORDS)

Animals

Normalization of cell responses in cat striate cortex.

Simple cells in the striate cortex have been depicted as half-wave-rectified linear operators. Complex cells have been depicted as energy mechanisms, constructed from the squared sum of the outputs of quadrature pairs of linear operators. However, the linear/energy model falls short of a complete explanation of striate cell responses. In this paper, a modified version of the linear/energy model is presented in which striate cells mutually inhibit one another, effectively normalizing their responses with respect to stimulus contrast. This paper reviews experimental measurements of striate cell responses, and shows that the new model explains a significantly larger body of physiological data.

Adaptation, Ocular

Half-squaring in responses of cat striate cells.

Simple cells in striate cortex have been depicted as rectified linear operators, and complex cells have been depicted as energy mechanisms (constructed from the squared sums of linear operator outputs). This paper discusses two essential hypotheses of the linear/energy model: (1) that a cell's selectivity is due to an underlying (spatiotemporal and binocular) linear stage; and (2) that a cell's firing rate depends on the squared output of the underlying linear stage. This paper reviews physiological measurements of cat striate cell responses, and concludes that both of these hypotheses are supported by the data.

Animals

Model for the extraction of image flow.

A model is presented, consonant with current views regarding the neurophysiology and psychophysics of motion perception, that combines the outputs of a set of spatiotemporal motion-energy filters to extract optical flow. The output velocity is encoded as the peak in a distribution of velocity-tuned units that behave much like cells of the middle temporal area of the primate brain. The model appears to deal with the aperture problem as well as the human visual system since it extracts the correct velocity for patterns that have large differences in contrast at different spatial orientations, and it simulates psychophysical data on the coherence of sine-grating plaid patterns.

Computer Simulation

Contrast normalization and a linear model for the directional selectivity of simple cells in cat striate cortex.

Previous tests of the linearity of spatiotemporal summation in cat simple cells have compared the responses to moving sinusoidal gratings and to gratings whose contrast was modulated sinusoidally in time. In particular, since a moving grating can be expressed as a sum of modulated gratings, the response to a moving grating should be predictable (assuming linearity) from the responses to modulated gratings. However, these simple linear predictions have shown varying degrees of failure (e.g. Reid et al., 1987, 1991), depending on the directional selectivity of the neurons (Tolhurst & Dean, 1991). We demonstrate here that the failures of these linear predictions are, in fact, explained by the contrast-normalization model of Heeger (1993). We concentrate on the ratio of the measured to predicted moving grating responses. In the context of the contrast-normalization model, calculating this ratio turns out to be particularly appropriate, since the ratio is independent of the precise details of the linear front-end mechanisms ultimately responsible for directional selectivity. Hence, the contrast-normalization model can be compared quantitatively with this ratio measure, by varying only one free parameter. When account is taken both of the expansive output nonlinearity and of contrast normalization, the directional selectivity of simple cells seems to be dependent only on linear spatiotemporal filtering.

Animals

Comparison of contrast-normalization and threshold models of the responses of simple cells in cat striate cortex.

In almost every study of the linearity of spatiotemporal summation in simple cells of the cat's visual cortex, there have been systematic mismatches between the experimental observations and the predictions of the linear theory. These mismatches have generally been explained by supposing that the initial spatiotemporal summation stage is strictly linear, but that the following output stage of the simple cell is subject to some contrast-dependent nonlinearity. Two main models of the output nonlinearity have been proposed: the threshold model (e.g. Tolhurst & Dean, 1987) and the contrast-normalization model (e.g. Heeger, 1992a,b). In this paper, the two models are fitted rigorously to a variety of previously published neurophysiological data, in order to determine whether one model is a better explanation of the data. We reexamine data on the interaction between two bar stimuli presented in different parts of the receptive field; on the relationship between the receptive-field map and the inverse Fourier transform of the spatial-frequency tuning curve; on the dependence of response amplitude and phase on the spatial phase of stationary gratings; on the relationships between the responses to moving and modulated gratings; and on the suppressive action of gratings moving in a neuron's nonpreferred direction. In many situations, the predictions of the two models are similar, but the contrast-normalization model usually fits the data slightly better than the threshold model, and it is easier to apply the equations of the normalization model. More importantly, the normalization model is naturally able to account very well for the details and subtlety of the results in experiments where the total contrast energy of the stimuli changes; some of these phenomena are completely beyond the scope of the threshold model. Rigorous application of the models' equations has revealed some situations where neither model fits quite well enough, and we must suppose, therefore, that there are some subtle nonlinearities still to be characterized.

Animals