PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Reinforcement learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70Linked to original sources

The involvement of the orbitofrontal cortex in learning under changing task contingencies.

Previous investigations examining the rat prefrontal cortex subregions in attentional-set shifting have commonly employed two-choice discriminations. To better understand how varying levels of difficulty influence the contribution of the prefrontal cortex to learning, the present studies examined the effects of orbitofrontal cortex inactivation in a two- or four-choice odor reversal learning test. Long-Evans rats were trained to dig in cups that contained distinct odors. In the two-choice odor discrimination, one odor cup was always associated with a cereal reinforcement in acquisition while the opposite odor cup was associated with a cereal reinforcement in reversal learning. In the four-choice odor discrimination, an additional two cups containing distinct odors were used that were never associated with reinforcement in acquisition or reversal learning. Bilateral infusions of the GABA-A agonist, muscimol (0.5 microg) into the orbitofrontal cortex did not impair acquisition of either the two- or four-choice discrimination task. However, muscimol infusions into the orbitofrontal cortex impaired two- and four-choice reversal learning. In the two-choice odor reversal, muscimol treatment selectively increased perseverative errors. In the four-choice odor reversal, muscimol treatment increased perseverative, regressive, as well as irrelevant errors. These findings suggest that the orbital prefrontal cortex not only enables task switching by supporting the initial inhibition of a previously relevant choice pattern, but under increasing task demands also enables the reliable execution of a new choice pattern and reduction of interference to irrelevant stimuli.

Animals↗

NMDA receptor modulation of incidental learning in Pavlovian context conditioning.

Rats exposed to a footshock show conditional fear when reexposed to the shock context. Immediate presentation of shock after placement in the context significantly reduces this fear. Preexposure to the context in the absence of shock, coupled with a minimum preshock interval during training, overcomes this immediate shock deficit. Because rats learn about the context during preexposure and express that learning after being reinforced, the context preexposure effect is an aversive analogue of latent learning. The authors examined the effect of the N-methyl-D-aspartate (NMDA) receptor antagonist D,L-2-amino-5-phosphovalerate (APV) on the facilitatory effect of context preexposure. Rats were preexposed to a chamber after APV administration. The next day they were placed in the same chamber without drug and received shock 35 s later. APV blocked the facilitatory effect of preexposure. Therefore NMDA receptors are important for contextual latent learning.

Animals↗

[Effect of monoamines microinjected into the amygdaloid nucleus on the lateral hypothalamic self-stimulation response].

The effect of serotonin and noradrenaline injections in the amygdalar nuclei on the reaction of self-stimulation of the lateral hypothalamus was studied in rats. The increase of exogenous serotonin level in the amygdala phasically intensified the self-stimulation and activated emotionally negative forms of behaviour. The increase of noradrenaline content phasically lowered the frequency of self-stimulation and evoked emotionally positive forms of behaviour which did not depend on the lateral hypothalamus stimulation. It is supposed that the amygdala takes part in the mechanism of sensory reinforcement connected with learning and being in definite relations with the centres of positive reinforcement of the lateral hypothalamus, while amygdalar monoamines form the neurochemical basis for the control of the reinforcing properties of external stimuli.

Amygdala↗

Rapidly learned song-discrimination without behavioral reinforcement in adult male zebra finches (Taeniopygia guttata).

Zebra finches communicate via several distinct vocalizations, of which song is the most studied. Behavioral observations indicate that adults are able to discriminate among the songs of different conspecific individuals. In the wild, zebra finches live in structured but mobile colonies, and encounter new individuals on a frequent basis. Thus it seems plausible that adult finches might have the capacity to recognize and remember new songs they encounter on a single day, but this has never been directly tested. Here we devised a simple observational assay to determine whether adult male zebra finches show recognition of a song they have heard repeatedly from taped playbacks, over a single three hour period the day before. We quantified the rate of production of six discrete behaviors (short calls, contact calls, singing, short hops, long hops, and beak swipes) made by adult male zebra finches as they listened to the playbacks. At the onset of song playback, all birds suspended these behaviors and sat silently-occasionally moving their heads. Then, after a measurable period ("response latency"), the birds resumed these activities. We observed that the response latency was long (approximately 10 min) when birds were hearing a particular song for the first time. The response latency was much shorter (approximately 1-2 min) when the birds had heard the same song the day before. Thus, functional song memories must result from as little as 3 h of passive song-exposure. These results suggest that ongoing song learning may play a natural role in the daily life of adult zebra finches, and provide a behavioral reference point for studies of molecular and physiological plasticity in the adult auditory system.

Animals↗

Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm.

How do the frontal lobes support behavioural flexibility? One key element is the ability to adjust responses when the reinforcement value of stimuli change. In monkeys, this ability--a form of affective shifting known as reversal learning--depends on orbitofrontal cortex. The present study examines the anatomical bases of reversal learning in humans. Subjects with lesions of the ventromedial prefrontal cortex were compared with a group with dorsolateral frontal lobe damage, as well as with normal controls on a simple reversal learning task. Neither form of frontal damage affected initial stimulus-reinforcement learning; ventromedial frontal damage selectively impaired reversal learning.

Adult↗

The effects of lesions of the habenula nucleus on lever press behaviour during a tandem operant schedule with contrasting response requirements.

The effect of bilateral lesions of the habenula nuclei in male Lister hooded rats was assessed in performance of a well learned complex tandem operant reinforcement schedule. The schedule requirement involved two successive and contrasting components in which 15 operant lever press responses followed by inhibition of the same response for a period of 15 s provided liquid-food reinforcement. Initially little disruption of performance was seen when each component of the schedule was differentially signalled with an external cue. However, relative to controls, lesioned animals showed an increasing disruption of performance when such cues were omitted. The deficit in performance of lesioned animals was not a simple failure to inhibit responding that could be predicted from an altered input from septal areas. It is suggested that these behavioural data are consistent with the anatomical evidence for the habenula as a functional relay for the integration of information from limbic structures and the striatum and that lesions of the habenula affect the ability of animals to maintain effective response strategies, particularly when these are under intrinsic control.

Animals↗

Operant conditioning of pontine gigantocellular units.

In order to investigate the behavioral role of pontine gigantocellular field (FTG) units, we have operantly reinforced discharge in these cells in unrestrained cats using lateral hypothalamic stimulation as the reinforcing stimulus. Cats readily learned to increase discharge rate in reinforced FTG cells relative to simultaneously recorded, non-reinforced control cells. Increased FTG discharge was associated with elevated levels of motor activity and often with stereotyped movements. Our results are compatible with the hypothesis that FTG unit discharge is related to specific movements.

Animals↗

Reinforced variability in animals and people: implications for adaptive action.

Although reinforcement often leads to repetitive, even stereotyped responding, that is not a necessary outcome. When it depends on variations, reinforcement results in responding that is diverse, novel, indeed unpredictable, with distributions sometimes approaching those of a random process. This article reviews evidence for the powerful and precise control by reinforcement over behavioral variability, evidence obtained from human and animal-model studies, and implications of such control. For example, reinforcement of variability facilitates learning of complex new responses, aids problem solving, and may contribute to creativity. Depression and autism are characterized by abnormally repetitive behaviors, but individuals afflicted with such psychopathologies can learn to vary their behaviors when reinforced for so doing. And reinforced variability may help to solve a basic puzzle concerning the nature of voluntary action.

Animals↗

Relevance of non-human animal studies to the understanding of human sexuality.

There are several reasons for studying sexual behavior in animals other than the human. Prominent among these is probably the use of sexual behavior as a model system for analyzing hormone actions on the brain. In this kind of study, lordosis behavior in the female rat has frequently been used as the behavioral end-point. Recently, the mouse has become a popular subject because of the availability of strains lacking estrogen or progesterone receptors. Animal sexual behavior is also studied for its own sake by biologists, by agricultural scientists and by those interested in the management of wildlife resources. Finally, there are some researchers interested in human sexual behavior who prefer to approach their problems through studies in non-human subjects, as they thereby gain access to techniques of experimentation impossible in human subjects. This is particularly important when the neurobiological basis of sexual behavior is the subject of study. Two striking similarities between humans and other mammals are the hormone dependency of sexual motivation and the fundamentally bisexual organization of the nervous system. In addition, animal studies have revealed how learning with sexual reinforcement can be an important determinant of sexual behavior. The role of learning has been largely ignored in human studies, and this has led to many misconceptions. Paramount among these is the idea that sexual behavior is associated with reproduction.

Animals↗

Methods and findings in an analysis of a vocal operant.

The relations among acoustic parameters of a vocal operant were considered and some methods for their measurement are described. Four human subjects (Ss) and one chick were employed in an experiment on the relations among vocal rate, vocal topography, and schedules of reinforcement. The earlier finding that schedules of reinforcement control human and infra-human vocal responding as they do other operants was replicated and extended to the case of variable-interval reinforcement. An analysis of response amplitude, pitch, and duration showed that the mean and variance of these parameters typically increase from CRF to VI, from VI to EXT and, for a second group of Ss, from CRF to EXT. The topography of the chick's vocal response appears to stand in the same relation to reinforcement operations as does the human vocal response.

Hearing↗