PubMed Health⌕ Search

Biomedical subjects

S Panzeri

Publications and source records attributed to S Panzeri.

17 recordsLinked to original sources

Data-robust tight lower bounds to the information carried by spike times of a neuronal population.

We develop new data-robust lower-bound methods to quantify the information carried by the timing of spikes emitted by neuronal populations. These methods have better sampling properties and are tighter than previous bounds based on neglecting correlation in the noise entropy. Our new lower bounds are precise also in the presence of strongly correlated firing. They are not precise only if correlations are strongly stimulus modulated over a long time range. Under conditions typical of many neurophysiological experiments, these techniques permit precise information estimates to be made even with data samples that are three orders of magnitude smaller than the size of the response space.

Action Potentials↗

An exact method to quantify the information transmitted by different mechanisms of correlational coding.

We derive a new method to quantify the impact of correlated firing on the information transmitted by neuronal populations. This new method considers, in an exact way, the effects of high order spike train statistics, with no approximation involved, and it generalizes our previous work that was valid for short time windows and small populations. The new technique permits one to quantify the information transmitted if each cell were to convey fully independent information separately from the information available in the presence of synergy-redundancy effects. Synergy-redundancy effects are shown to arise from three possible contributions: a redundant contribution due to similarities in the mean response profiles of different cells; a synergistic stimulus-dependent correlational contribution quantifying the information content of changes of correlations with stimulus, and a stimulus-independent correlational contribution term that reflects interactions between the distribution of rates of individual cells and the average level of cross-correlation. We apply the new method to simultaneously recorded data from somatosensory and visual cortices. We demonstrate that it constitutes a reliable tool to determine the role of cross-correlated activity in stimulus coding even when high firing rate data (such as multi-unit recordings) are considered.

Action Potentials↗

Population coding of stimulus location in rat somatosensory cortex.

This study explores the nature of population coding in sensory cortex by applying information theoretic analyses to neuron pairs recorded simultaneously from rat barrel cortex. We quantified the roles of individual spikes and spike patterns in encoding whisker stimulus location. 82%-85% of the total information was contained in the timing of individual spikes: first spike time was particularly crucial. Spike patterns within neurons accounted for the remaining 15%-18%. Neuron pairs located in the same barrel column coded redundantly, whereas pairs in neighboring barrel columns coded independently. The barrel cortical population code for stimulus location appears to be the time of single neurons' first poststimulus spikes-a fast, robust coding mechanism that does not rely on "synergy" in crossneuronal spike patterns.

Action Potentials↗

Simultaneity of responses in a hierarchical visual network.

The pattern of anatomical connections between areas of the primate visual system is organized hierarchically. However, onset latencies in parietal and occipital stations are often simultaneous, and this seems to contradict hierarchical organization in its simplest interpretation, as serial organization. To understand the reasons for this contradiction, we simulated the cortical network for which there is onset data, including the network's hierarchical structure. The network's dynamics reproduced the simultaneous onset latencies reported in several dorsal areas. These results show that a strictly hierarchical visual system is compatible with much more complex dynamics than serial processing, and that hodological and biophysical properties, are more closely related to onset dynamics than is hierarchical organisation.

Animals↗

Temporal correlations and neural spike train entropy.

Sampling considerations limit the experimental conditions under which information theoretic analyses of neurophysiological data yield reliable results. We develop a procedure for computing the full temporal entropy and information of ensembles of neural spike trains, which performs reliably for limited samples of data. This approach also yields insight to the role of correlations between spikes in temporal coding mechanisms. The method, when applied to recordings from complex cells of the monkey primary visual cortex, results in lower rms error information estimates in comparison to a "brute force" approach.

Action Potentials↗

The role of spike timing in the coding of stimulus location in rat somatosensory cortex.

Although the timing of single spikes is known to code for time-varying features of a sensory stimulus, it remains unclear whether time is also exploited in the neuronal coding of the spatial structure of the environment, where nontemporal stimulus features are fundamental. This report demonstrates that, in the whisker representation of rat cortex, precise spike timing of single neurons increases the information transmitted about stimulus location by 44%, compared to that transmitted only by the total number of spikes. Crucial to this code is the timing of the first spike after whisker movement. Complex, single neuron spike patterns play a smaller, synergistic role. Timing permits very few spikes to transmit high quantities of information about a behaviorally significant, spatial stimulus.

Action Potentials↗

A unified approach to the study of temporal, correlational, and rate coding.

We demonstrate that the information contained in the spike occurrence times of a population of neurons can be broken up into a series of terms, each reflecting something about potential coding mechanisms. This is possible in the coding regime in which few spikes are emitted in the relevant time window. This approach allows us to study the additional information contributed by spike timing beyond that present in the spike counts and to examine the contributions to the whole information of different statistical properties of spike trains, such as firing rates and correlation functions. It thus forms the basis for a new quantitative procedure for analyzing simultaneous multiple neuron recordings and provides theoretical constraints on neural coding strategies. We find a transition between two coding regimes, depending on the size of the relevant observation timescale. For time windows shorter than the timescale of the stimulus-induced response fluctuations, there exists a spike count coding phase, in which the purely temporal information is of third order in time. For time windows much longer than the characteristic timescale, there can be additional timing information of first order, leading to a temporal coding phase in which timing information may affect the instantaneous information rate. In this new framework, we study the relative contributions of the dynamic firing rate and correlation variables to the full temporal information, the interaction of signal and noise correlations in temporal coding, synergy between spikes and between cells, and the effect of refractoriness. We illustrate the utility of the technique by analyzing a few cells from the rat barrel cortex.

Animals↗

Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons.

The speed of processing in the visual cortical areas can be fast, with for example the latency of neuronal responses increasing by only approximately 10 ms per area in the ventral visual system sequence V1 to V2 to V4 to inferior temporal visual cortex. This has led to the suggestion that rapid visual processing can only be based on the feedforward connections between cortical areas. To test this idea, we investigated the dynamics of information retrieval in multiple layer networks using a four-stage feedforward network modelled with continuous dynamics with integrate-and-fire neurons, and associative synaptic connections between stages with a synaptic time constant of 10 ms. Through the implementation of continuous dynamics, we found latency differences in information retrieval of only 5 ms per layer when local excitation was absent and processing was purely feedforward. However, information latency differences increased significantly when non-associative local excitation was included. We also found that local recurrent excitation through associatively modified synapses can contribute significantly to processing in as little as 15 ms per layer, including the feedforward and local feedback processing. Moreover, and in contrast to purely feed-forward processing, the contribution of local recurrent feedback was useful and approximately this rapid even when retrieval was made difficult by noise. These findings suggest that cortical information processing can benefit from recurrent circuits when the allowed processing time per cortical area is at least 15 ms long.

Action Potentials↗

On decoding the responses of a population of neurons from short time windows.

The effectiveness of various stimulus identification (decoding) procedures for extracting the information carried by the responses of a population of neurons to a set of repeatedly presented stimuli is studied analytically, in the limit of short time windows. It is shown that in this limit, the entire information content of the responses can sometimes be decoded, and when this is not the case, the lost information is quantified. In particular, the mutual information extracted by taking into account only the most likely stimulus in each trial turns out to be, if not equal, much closer to the true value than that calculated from all the probabilities that each of the possible stimuli in the set was the actual one. The relation between the mutual information extracted by decoding and the percentage of correct stimulus decodings is also derived analytically in the same limit, showing that the metric content index can be estimated reliably from a few cells recorded from brief periods. Computer simulations as well as the activity of real neurons recorded in the primate hippocampus serve to confirm these results and illustrate the utility and limitations of the approach.

Algorithms↗

Correlations and the encoding of information in the nervous system.

Is the information transmitted by an ensemble of neurons determined solely by the number of spikes fired by each cell, or do correlations in the emission of action potentials also play a significant role? We derive a simple formula which enables this question to be answered rigorously for short time-scales. The formula quantifies the corrections to the instantaneous information rate which result from correlations in spike emission between pairs of neurons. The mutual information that the ensemble of neurons conveys about external stimuli can thus be broken down into firing rate and correlation components. This analysis provides fundamental constraints upon the nature of information coding, showing that over short time-scales correlations cannot dominate information representation, that stimulus-independent correlations may lead to synergy (where the neurons together convey more information than they would if they were considered independently), but that only certain combinations of the different sources of correlation result in significant synergy rather than in redundancy or in negligible effects. This analysis leads to a new quantification procedure which is directly applicable to simultaneous multiple neuron recordings.

Action Potentials↗

Firing rate distributions and efficiency of information transmission of inferior temporal cortex neurons to natural visual stimuli.

The distribution of responses of sensory neurons to ecological stimulation has been proposed to be designed to maximize information transmission, which according to a simple model would imply an exponential distribution of spike counts in a given time window. We have used recordings from inferior temporal cortex neurons responding to quasi-natural visual stimulation (presented using a video of everyday lab scenes and a large number of static images of faces and natural scenes) to assess the validity of this exponential model and to develop an alternative simple model of spike count distributions. We find that the exponential model has to be rejected in 84% of cases (at the p < 0.01 level). A new model, which accounts for the firing rate distribution found in terms of slow and fast variability in the inputs that produce neuronal activation, is rejected statistically in only 16% of cases. Finally, we show that the neurons are moderately efficient at transmitting information but not optimally efficient.

Animals↗

Head direction cells in the primate pre-subiculum.

The function of the primate hippocampus and related structures was analysed by making recordings from the hippocampus, subiculum, presubiculum, and parahippocampal gyrus in monkeys actively walking in the laboratory. Head direction cells were found in the presubiculum. The firing rate of these cells was a function of the head direction of the monkey, with a response that was typically 10-100 times larger to the best as compared to the opposite direction. The mean half-amplitude width of the tuning of the cells was 76 degrees. The response of head direction cells in the presubiculum was not influenced by the place where the monkey was, there being the same tuning to head direction at different places in a room, and even outside the room. The response of these cells was also independent of the "spatial view" observed by the monkey, and also the position of the eyes in the head. The average information about head direction was 0.64 bits, about place was 0.10 bits, about spatial view was 0.27 bits, and about eye position was 0.04 bits. The cells maintained their tuning for periods of at least several minutes when the view details were obscured or the room was darkened. This representation of head direction could be useful together with the hippocampal spatial view cells and whole body motion cells found in primates in such spatial and memory functions as path integration.

Action Potentials↗

The neurophysiology of backward visual masking: information analysis.

Backward masking can potentially provide evidence of the time needed for visual processing, a fundamental constraint that must be incorporated into computational models of vision. Although backward masking has been extensively used psychophysically, there is little direct evidence for the effects of visual masking on neuronal responses. To investigate the effects of a backward masking paradigm on the responses of neurons in the temporal visual cortex, we have shown that the response of the neurons is interrupted by the mask. Under conditions when humans can just identify the stimulus, with stimulus onset asynchronies (SOA) of 20 msec, neurons in macaques respond to their best stimulus for approximately 30 msec. We now quantify the information that is available from the responses of single neurons under backward masking conditions when two to six faces were shown. We show that the information available is greatly decreased as the mask is brought closer to the stimulus. The decrease is more marked than the decrease in firing rate because it is the selective part of the firing that is especially attenuated by the mask, not the spontaneous firing, and also because the neuronal response is more variable at short SOAs. However, even at the shortest SOA of 20 msec, the information available is on average 0.1 bits. This compares to 0.3 bits with only the 16-msec target stimulus shown and a typical value for such neurons of 0.4 to 0.5 bits with a 500-msec stimulus. The results thus show that considerable information is available from neuronal responses even under backward masking conditions that allow the neurons to have their main response in 30 msec. This provides evidence for how rapid the processing of visual information is in a cortical area and provides a fundamental constraint for understanding how cortical information processing operates.

Animals↗

Information about spatial view in an ensemble of primate hippocampal cells.

Hippocampal function was analyzed by making recordings from hippocampal neurons in monkeys actively walking in the laboratory. "Spatial view" cells, which respond when the monkey looks at a part of the environment, were analyzed. To assess quantitatively the information about the spatial environment represented by these cells, we applied information theoretic techniques to their responses. The average information provided by these cells about which location the monkey was looking at was 0.32 bits, and the mean across cells of the maximum information conveyed about which location was being looked at was 1.19 bits, measured in a period of 0.5 s. There were 16 locations for this analysis, each being one-quarter of one of the walls of the room. It also was shown that the mean spontaneous rate of firing of the neurons was 0.1 spikes/s, that the mean firing rate in the center of the spatial field of the neurons was 13.2 spikes/s, and that the mean sparseness of the representation measured in a 25-ms period was 0.04 and in a 500-ms time period was 0.19. (The sparseness is approximately equivalent to the proportion of the 25- or 500-ms periods in which the neurons showed one or more spikes.) Next it was shown that the mean size of the view fields of the neurons was 0.9 of a wall. In an approach to the issue of how an ensemble of neurons might together provide more precise information about spatial location than a single neuron, it was shown that in general the neurons had different centers for their view fields. It then was shown that the information from an ensemble of these cells about where in space is being looked at increases approximately linearly with the number of cells in the ensemble. This indicates that the number of places that can be represented increases approximately exponentially with the number of cells in the population. It is concluded that there is an accurate representation of space "out there" in the primate hippocampus. This representation of space out there would be an appropriate part of a primate memory system involved in memories of where in an environment an object was seen, and more generally in the memory of particular events or episodes, for which a spatial component normally provides part of the context.

Algorithms↗

How well can we estimate the information carried in neuronal responses from limited samples?

It is difficult to extract the information carried by neuronal responses about a set of stimuli because limited data samples result in biased estimates. Recently two improved procedures have been developed to calculate information from experimental results: a binning-and-correcting procedure and a neural network procedure. We have used data produced from a model of the spatiotemporal receptive fields of parvocellular and magnocellular lateral geniculate neurons to study the performance of these methods as a function of the number of trials used. Both procedures yield accurate results for one-dimensional neuronal codes. They can also be used to produce a reasonable estimate of the extra information in a three-dimensional code, in this instance, within 0.05-0.1 bit of the asymptotically calculated value--about 10% of the total transmitted information. We believe that this performance is much more accurate than previous procedures.

Computer Simulation↗

Information in the neuronal representation of individual stimuli in the primate temporal visual cortex.

To analyze the information provided about individual visual stimuli in the responses of single neurons in the primate temporal lobe visual cortex, neuronal responses to a set of 65 visual stimuli were recorded in macaques performing a visual fixation task and analyzed using information theoretical measures. The population of neurons analyzed responded primarily to faces. The stimuli included 23 faces and 42 nonface images of real-world scenes, so that the function of this brain region could be analyzed when it was processing relatively natural scenes. It was found that for the majority of the neurons significant amounts of information were reflected about which of several of the 23 faces had been seen. Thus the representation was not local, for in a local representation almost all the information available can be obtained when the single stimulus to which the neuron responds best is shown. It is shown that the information available about any one stimulus depended on how different (for example, how many standard deviations) the response to that stimulus was from the average response to all stimuli. This was the case for responses below the average response as well as above. It is shown that the fraction of information carried by the low firing rates of a cell was large--much larger than that carried by the high firing rates. Part of the reason for this is that the probability distribution of different firing rates is biased toward low values (though with fewer very low values than would be predicted by an exponential distribution). Another factor is that the variability of the response is large at intermediate and high firing rates. Another finding is that at short sampling intervals (such as 20 ms) the neurons code information efficiently, by effectively acting as binary variables and behaving less noisily than would be expected of a Poisson process.

Action Potentials↗

Speed, noise, information and the graded nature of neuronal responses.

How the firing rate of a neuron carries information depends on the time over which rates are measured. For very short times, the amount of information conveyed depends, in a universal way, on the mean rates only (trial-to-trial variability is irrelevant) and the cell response can be taken to be binary (although an ideal binary response would convey more). For longer times, noise as well as the graded nature of the response come into play, with opposite effects. Which times can be considered 'short' varies with the brain area considered and, possibly, with the processing speed it is required to operate at.

Journal Article↗