Biomedical subjects

A G Barto

Publications and source records attributed to A G Barto.

3 recordsLinked to original sources

PubMed1991

Linear systems analysis of the relationship between firing of deep cerebellar neurons and the classically conditioned nictitating membrane response in rabbits.

The correlation of the activity of neurons in the interposed and dentate nuclei of the cerebellum with conditioned movements of the nictitating membrane was investigated using linear systems analysis. The activity of single deep cerebellar nuclear cells was assumed to be the input to a linear system that produced nictitating membrane movement. Data were initially analyzed with a causal model to assess the degree to which past neural activity predicted the conditioned response. 55 of 165 cells had correlation coefficients of 0.50 or greater between the model's moment-to-moment output and the actual output, with two interpositus cells having correlation coefficients of greater than 0.90. Double-sided impulse responses indicated that afference from the face and efference copy probably affect deep cerebellar neural activity. Nonlinearities were also found in the relationship between neuronal activity and conditioned movement. It was concluded that cerebellar deep nuclear firing is highly correlated with future nictitating membrane movements but that the firing-movement relationship contains noncausal and nonlinear components.

Animals↗

PubMed1986

Simulation of the classically conditioned nictitating membrane response by a neuron-like adaptive element: response topography, neuronal firing, and interstimulus intervals.

A neuron-like adaptive element with computational features suitable for classical conditioning, the Sutton-Barto (S-B) model, was extended to simulate real-time aspects of the conditioned nictitating membrane (NM) response. The aspects of concern were response topography, CR-related neuronal firing, and interstimulus interval (ISI) effects for forward-delay and trace conditioning paradigms. The topography of the NM CR has the following features: response latency after CS onset decreases over trials; response amplitude increases gradually within the ISI and attains its maximum coincidentally with the UR. A similar pattern characterizes the firing of some (but not all) neurons in brain regions demonstrated experimentally to be important for NM conditioning. The variant of the S-B model described in this paper consists of a set of parameters and implementation rules based on 10-ms computational time steps. It differs from the original S-B model in a number of ways. The main difference is the assumption that CS inputs to the adaptive element are not instantaneous but are instead shaped by unspecified coding processes so as to produce outputs that conform with the real-time properties of NM conditioning. The model successfully simulates the aforementioned features of NM response topography. It is also capable of simulating appropriate ISI functions, i.e. with maximum conditioning strength with ISIs of 250 ms, for forward-delay and trace paradigms. The original model's successful treatment of multiple-CS phenomena, such as blocking, conditioned inhibition, and higher-order conditioning, are retained by the present model.

Adaptation, Physiological↗

PubMed1985

Learning by statistical cooperation of self-interested neuron-like computing elements.

Since the usual approaches to cooperative computation in networks of neuron-like computating elements do not assume that network components have any "preferences", they do not make substantive contact with game theoretic concepts, despite their use of some of the same terminology. In the approach presented here, however, each network component, or adaptive element, is a self-interested agent that prefers some inputs over others and "works" toward obtaining the most highly preferred inputs. Here we describe an adaptive element that is robust enough to learn to cooperate with other elements like itself in order to further its self-interests. It is argued that some of the longstanding problems concerning adaptation and learning by networks might be solvable by this form of cooperativity, and computer simulation experiments are described that show how networks of self-interested components that are sufficiently robust can solve rather difficult learning problems. We then place the approach in its proper historical and theoretical perspective through comparison with a number of related algorithms. A secondary aim of this article is to suggest that beyond what is explicitly illustrated here, there is a wealth of ideas from game theory and allied disciplines such as mathematical economics that can be of use in thinking about cooperative computation in both nervous systems and man-made systems.

Adaptation, Physiological↗