PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Reinforcement learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39Linked to original sources

The role of differential reinforcement in predator avoidance learning.

Little is known about how predator recognition develops under natural conditions. Predispositions to respond to some stimuli preferentially are likely to interact with the effects of experience. Convergent evidence from several studies suggests that predator-nai;ve tammar wallabies (Macropus eugenii) have some ability to respond to vertebrate predators differently from non-predators and that antipredator responses can be selectively enhanced by experience. Here, we examined the effects of differential reinforcement on responses to a model fox (Vulpes vulpes), cat (Felis catus) and conspecific wallaby. During training, tammars experienced paired presentations of a model fox and a simulated capture, as well as presentations of a wallaby and a cat alone. Training enhanced responses to the fox, relative to the conspecific wallaby, but acquired responses to the two predators did not differ, despite repeated, non-reinforced presentations of the cat. Results suggest that experience interacts with the wallabies' ability to perceive predators as a natural category.

Journal Article↗

Dimensional reduction for reward-based learning.

Reward-based learning in neural systems is challenging because a large number of parameters that affect network function must be optimized solely on the basis of a reward signal that indicates improved performance. Searching the parameter space for an optimal solution is particularly difficult if the network is large. We show that Hebbian forms of synaptic plasticity applied to synapses between a supervisor circuit and the network it is controlling can effectively reduce the dimension of the space of parameters being searched to support efficient reinforcement-based learning in large networks. The critical element is that the connections between the supervisor units and the network must be reciprocal. Once the appropriate connections have been set up by Hebbian plasticity, a reinforcement-based learning procedure leads to rapid learning in a function approximation task. Hebbian plasticity within the network being supervised ultimately allows the network to perform the task without input from the supervisor.

Animals↗

Learning and memory is reflected in the responses of reinforcement-related neurons in the primate basal forebrain.

Certain basal forebrain neurons encode the learned reinforcement value of objects: they respond differentially to visual stimuli that signal availability of fruit juice (positively reinforcing) or saline (negatively reinforcing) obtained by lick responses in visual discrimination tasks. In this report we describe the rapid, learning-related changes in the responses of these neurons during the acquisition and reversal of the reinforcement contingency of a visual discrimination reversal task. The same neurons also responded differentially to novel and familiar stimuli in 2 recognition memory tasks, in which monkeys applied the learned rule that lick responses to novel stimuli elicited saline and responses to familiar stimuli elicited juice. These differential responses to novel and familiar stimuli thus reflected the reinforcement value of the stimuli. A single presentation of a novel or a familiar stimulus was sufficient to elicit a differential response which was maintained even when the stimulus had not been seen recently. The maintenance of the differential response indicates that these neurons are influenced by a durable memory for the stimuli, estimated to be 30 trials on average. These differential neurons were recorded in the substantia innominata, the diagonal band of Broca, and a periventricular region of the basal forebrain. The responses of the reinforcement-related neurons in these 3 regions were similar in most respects. These results support the conclusion that basal forebrain neurons respond to sensory stimuli that, through learning of different contingencies, signal the availability of reinforcement. We suggest that the properties of learning and memory reflected in these neuronal responses are due to afferent pathways from ventromedial regions of the prefrontal and temporal cortices and the amygdala, and that the responses of these neurons provide an enabling mechanism that facilitates the operation of diverse cortical regions in which specific sensory, motor, or mnemonic functions take place.

Animals↗

Pedunculopontine tegmental nucleus lesions impair stimulus--reward learning in autoshaping and conditioned reinforcement paradigms.

The role of the pedunculopontine tegmental nucleus (PPTg) in stimulus-reward learning was assessed by testing the effects of PPTg lesions on performance in visual autoshaping and conditioned reinforcement (CRf) paradigms. Rats with PPTg lesions were unable to learn an association between a conditioned stimulus (CS) and a primary reward in either paradigm. In the autoshaping experiment, PPTg-lesioned rats approached the CS+ and CS- with equal frequency, and the latencies to respond to the two stimuli did not differ. PPTg lesions also disrupted discriminated approaches to an appetitive CS in the CRf paradigm and completely abolished the acquisition of responding with CRf. These data are discussed in the context of a possible cognitive function of the PPTg, particularly in terms of lesion-induced disruptions of attentional processes that are mediated by the thalamus.

Animals↗