PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Reinforcement learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58Linked to original sources
PubMed1966

Some discriminative properties of fixed ratio performance in the pigeon.

The discriminative control over a spatial choice response exercised by prior behavior was studied using a procedure involving discrete exposures to a two-member chained schedule. The initial member (red key) was either a smaller or larger fixed ratio (Mix FR:FR), the completion of which produced, after a 1-sec delay, two white response keys. If the larger FR had been completed as the initial chain member, a single peck on the right white key was reinforced; after the smaller FR, a peck on the left white key was reinforced. Frequencies of unreinforced responses (S(Delta) responses) were determined with several pairs of red-key FRs: 95-5, 75-25, 65-35, 60-40, 58-42 and 50-50. The S(Delta) response frequencies were low through the FR pair 65-35; sharp increases were obtained with pairs 60-40 and 58-42. Later, curves analogous to stimulus generalization functions were obtained using a probe procedure. Finally, the delay interval between completion of a red-key FR and the white-key choice response was manipulated: results were variable, but S(Delta) response frequencies tended to increase with increasing delays.

Animals↗
PubMed1990

Preference as a function of absolute response durations.

The durations of 2 responses, 2 categories of reinforced nondiscriminated interresponse times, were varied while their relative durations were held approximately constant, with the longer about 2 1/2 times longer than the shorter. Three pigeons pecked for food. Reinforcers for the shorter and longer responses were arranged by a concurrent variable-interval, variable-interval schedule. Preference for the shorter response increased when both were lengthened. These results, taken together with previous results for discriminated interresponse times, show that preference for the shorter of 2 responses depends on their absolute durations, whether they are discriminated or not and regardless of autoshaped key pecks that may occur in the discriminated case. Time-allocation-matching was not generally obtained. The results qualitatively agree with an associative learner, a computational processing model derived from a molecular analysis of behavior.

Animals↗
PubMed1962

A tracking procedure for determining the cat's frequency discrimination.

A tracking procedure was used to investigate the time required to train cats to discriminate between a frequency-modulated tone and a steady tone. The animal was reinforced with food on a VR schedule only when the steady tone was present and the animal pressed the correct bar (one of two). After reinforcement, the steady tone usually changed to a frequency-modulated signal; by pressing the other bar, the tone could be changed to its steady state and the reinforcement then obtained as before. A major difficulty was the lack of control by the auditory stimulus on the cat's responses. This problem was solved by introducing interpress time outs which forced the animal to hesitate after every press. The use of light cues to signal the time outs and the correct bar to press accelerated the rate at which the training progressed. With cats, this conditioning procedure apparently requires a much longer training period before the actual threshold determinations than the more commonly used avoidance conditioning procedures. However, when animals are to be tested repeatedly over a period of several months or longer, the procedure may prove the more desirable one because it reduces experimental neurosis.

Animals↗
PubMed1990

Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures.

In the random control procedure, responding to a conditioned stimulus (target CS) is prevented when the probability of unsignaled, unconditioned stimuli (USs) in the intertrial interval (ITI) is equal to the probability of the US in the presence of the target CS. Three experiments used an autoshaping procedure with White Carneaux pigeons to examine the effects of the temporal duration of signals for the ITI USs (cover CSs) and for concomitant periods of nonreinforcement. In Experiment 1, a short duration cover, but not a long duration cover, resulted in responding to the target CS. In Experiment 2, an explicit CS- cue during periods of nonreinforcement did not affect target acquisition. In Experiment 3, a long CS-, but not a short cover CS, was a sufficient condition for the acquisition of responding to the target CS. These results imply that the acquisition of responding to a target CS requires a discriminable period of nonreinforcement that is long relative to the target CS duration.

Animals↗
PubMed1989

A new one-trial test for neurobiological studies of memory in rats. II: Effects of piracetam and pramiracetam.

The effects of the nootropic drugs Piracetam (Pir) and Pramiracetam (Pram) were evaluated on recognition-memory of rats in a new one-trial test. This test is based on spontaneous exploratory activity and does not involve rule learning or reinforcement. Recognition is measured by the time spent by rats in exploring two different objects, one familiar (the sample), the other new. When the retention interval is 1 min, normal rats spend more time exploring the new object which demonstrates that they recognize the familiar one, but they do not discriminate between the two objects after a 24-h interval. Three doses of Pram (15, 30 and 60 mg/kg) and Pir (100, 200 and 400 mg/kg) were administered i.p. 30 min before the acquisition trial. The doses of 30 mg/kg of Pram and of 400 mg/kg of Pir produced a significant improvement in retention when the intertrial interval was 24 h. This effect was not associated with a change in overall exploratory behavior. This study shows that the new object-recognition test may be a useful tool for pharmacological studies of memory in rats.

Animals↗
PubMed1983

Control of pigeons' matching-to-sample performance by differential sample response requirements.

Pigeons were trained on a matching-to-sample task in which sample hue and required sample-specific observing behavior provided redundant, relevant cues for correct choices. On trials that involved red and yellow hues as comparison stimuli, a fixed-ratio 16 schedule (FR 16) was required to illuminate the comparisons when the sample was red, and a differential-reinforcement-of-low-rates 3-sec schedule (DRL 3-sec) was required when the sample was yellow. On trials involving blue and green hues as comparison stimuli, an FR 16 schedule was required when the sample was blue and a DRL 3-sec schedule was required when the sample was green. For some pigeons, a 0-sec delay intervened between sample offset and comparison onset, whereas other pigeons experienced a random mixture of 0-sec and 2-sec delay trials. Test trial performance at 0-sec delay indicated that sample-specific behavior controlled choice performance considerably more than sample hue did. Test performance was independent of whether original training involved all 0-sec delay trials or a mixture of 0-sec and 2-sec delays. Sample-specific observing response requirements appear to facilitate pigeons' matching-to-sample performance by strengthening associations between the observing response and correct choice.

Animals↗
PubMed1989

Response-reinforcer contingency and spatially defined operants: testing an invariance property of phi.

A chamber containing 72 response keys defining the circumference of a circle 1 m in diameter was used to examine the relation between differentiation of response location and a measure of response-reinforcer contingency known as the phi coefficient. A different target key was specified in each successive phase, and response location was differentiated with respect to the target. Criterional and noncriterional responses (i.e., responses "near" and "far" from the target) were defined using targeted percentile schedules to control the overall probability of each response class. By manipulating criterional (and, hence, noncriterional) response probability and the reinforcement probabilities conditional on each, a mathematical invariance property peculiar to phi in contingency analysis was examined. Specifically, diagonally interchanging cell frequencies in a 2 x 2 table relating criterional/noncriterional responses to reinforcement/nonreinforcement leaves phi unchanged. Hence, the degree of response differentiation predicted by phi remains unchanged under the four permutations implied by the various diagonal interchanges. This predicted invariance was examined under values of phi equal to .33, .58, and .82. Increasing phi generally increased the stereotypy of response location. Three of the permutations generated almost interchangeable performance at different phi values. The remaining permutation, however, generated functions relating response concentration to phi with slopes shallower than those obtained under the other permutations. This resulted from relatively higher levels of differentiation, compared to the other permutations, at low phi values. These data strongly suggest boundary conditions on the ability of phi to reflect completely the local processes that are indexed by phi at a molar level.

Animals↗
PubMed1983

The role of dopamine in locomotor activity and learning.

The discovery that the brain contains neurons utilizing dopamine (DA) as their transmitter has led to studies of the behavioral function of these neurons. Changes in overall level of activity of DA neurons appear to produce parallel changes in locomotor activity. Additionally, DA neurons seem to mediate in part the effects of biologically significant (reinforcing) stimuli on learning. One way in which reinforcing stimuli produce learning is to increase the incentive motivational (response-eliciting) properties of neutral stimuli associated with them; also, reinforcing stimuli maintain the incentive motivational properties of previously conditioned incentive stimuli. Normal DA functioning appears to be required for the establishment and maintenance of incentive learning in naive animals. Previous incentive learning in trained animals can influence behavior for a time even when the function of DA neurons is disrupted; however, with continued testing in the absence of normal DA functioning, previously established conditioned incentive stimuli cease to influence behavior. From these observations and recent physiological, anatomical and biochemical studies of DA systems it is suggested that the biological substrate of DA-mediated incentive learning is a heterosynaptic facilitation of muscarinic cholinergic synapses. This model has important clinical implications since it has been suggested that DA hyperfunctioning underlies the development of schizophrenia.

Animals↗
PubMed1979

Matching, undermatching, and overmatching in studies of choice.

Almost all of 103 sets of data from 23 different studies of choice conformed closely to the equation: log (B(1)/B(2)) = a log (r(1)/r(2)) + log b, where B(1) and B(2) are either numbers of responses or times spent at Alternatives 1 and 2, r(1) and r(2) are the rates of reinforcement obtained from Alternatives 1 and 2, and a and b are empirical constants. Although the matching relation requires the slope a to equal 1.0, the best-fitting values of a frequently deviated from this. For B(1) and B(2) measured as numbers of responses, a tended to fall short of 1.0 (undermatching). For B(1) and B(2) measured as times, a fell to both sides of 1.0, with the largest mode at about 1.0. Those experiments that produced values of a for both responses and time revealed only a rough correspondence between the two values; a was often noticeably larger for time. Statistical techniques for assessing significance of a deviation of a from 1.0 suggested that values of a between .90 and 1.11 can be considered good approximations to matching. Of the two experimenters who contributed the most data, one generally found undermatching, while the other generally found matching. The difference in results probably arises from differences in procedure. The procedural variations that lead to undermatching appear to be those that produce (a) asymmetrical pausing that favors the poorer alternative; (b) systematic temporal variation in preference that favors the poorer alternative; and (c) patterns of responding that involve changing over between alternatives or brief bouts at the alternatives.

Animals↗
PubMed2005

The role of terminal-link stimuli in concurrent-chain schedules: revisited using a behavioral-history procedure.

A behavioral-history procedure was used to study the function of terminal-link stimuli as conditioned reinforcers in multiple concurrent-chain schedules of reinforcement. First, three pigeons were exposed to multiple concurrent-chain schedules in which the two multiple-schedule components were correlated with a blue and a white stimulus, respectively. In each component the initial links were equal independent variable-interval (VI) 15 s schedules. A fixed-interval (FI) 10 s schedule operated on the red key in one terminal link while extinction operated on the green key in the alternative terminal link. When large preferences for the red stimulus had been established, two tests were conducted. In the terminal-link test, under new initial-link stimuli--purple and brown--an FI 10 s schedule operated for both the red and green terminal-link stimuli. In the subsequent initial-link test, the blue and white initial-link stimuli were reintroduced, and, as in the terminal-link test, FI 10s operated for both the red and the green terminal-link stimuli. In the terminal-link test, the three pigeons showed no preference for the terminal links with the red stimulus, but showed clear and consistent preferences for the red stimulus when blue and white stimuli were reintroduced as initial-link stimuli in the initial-link test. This suggests that there are multiple sources of control over initial-link response allocation in concurrent-chains, including control by both terminal- and initial-link stimuli.

Animals↗
PubMed2006

A bone health intervention for older adults living in residential settings.

Osteoporosis, a major health problem that increases with age, may lead to fractures and loss of independence. This study focused on testing a bone health intervention aimed at assisting older adults living independently in residential settings to maintain healthy bones with the long-term goals of fracture prevention and maintenance of independent function. Forty-seven participants (M (age) = 79.36 years) completed six 1-hour educational sessions. Pre-intervention testing of osteoporosis knowledge and healthy bone behaviors was followed by posttests at 1 week, 6 weeks, and 7(1/2) months. Findings revealed significant increases in knowledge and behaviors from baseline to 9(1/2) months, although a slight decline during the last 6 months when there was no reinforcement of learning suggests the need for periodic follow-up.

Absorptiometry, Photon↗
PubMed2002

Cocaine increases serotonergic activity in the hippocampus and nucleus accumbens in vivo: 5-HT1a-receptor antagonism blocks behavioral but potentiates serotonergic activation.

The hippocampus is an important mediator of learning and reinforcement, but its role in cocaine effects has received little attention. Neuronal activity in the hippocampus and the nucleus accumbens (Nac) depend on serotonergic (5-HT) transmission. Here we describe for the first time a cocaine-induced increase in 5-HT concentration in the hippocampus and the Nac parallel to behavioral activation. In addition, pretreatment with the 5-HT(1A)-receptor antagonist WAY 100635 blocked the behavioral activation after cocaine while potentiating the 5-HT increase in the hippocampus and the Nac. In vivo microdialysis was used in behaving rats to measure extracellular concentration of 5-HT in the hippocampus and the Nac. Four groups of animals received one of the following drug combinations: WAY 100635 (0.4 mg/kg) and cocaine (10 mg/kg), saline and cocaine (10 mg/kg), WAY 100635 (0.4 mg/kg) and saline, or saline and saline. The injections were administered i.p. and spaced 30 min apart. It was found that 1.) cocaine, at a dose that activates behavior, increases 5-HT levels in the hippocampus and in the Nac, and 2.) 5-HT(1A)-receptor antagonism can cause a dissociation of the hippocampal and Nac 5-HT activity from behavioral activation after cocaine. These results are discussed within the framework of the hippocampal-accumbens projection and its contribution to behavioral activity. They suggest that the hippocampus may have a role in mediating the behavioral and neurochemical effects of cocaine.

Animals↗
PubMed2000

Predator avoidance, breeding experience and reproductive success in endangered cheetahs, Acinonyx jubatus.

I examine three hypotheses about predator avoidance behaviour: (1) avoidance increases an individual's reproductive success; (2) avoidance changes with breeding experience according to one of three described models; and (3) any reproductive or experience benefits accrued to individuals by avoidance are reflected in their spatial distribution. These hypotheses were tested on cheetahs which incur substantial juvenile mortality from predation by two larger competitors: spotted hyaenas, Crocuta crocuta, and lions, Panthera leo. To examine avoidance tactics, I played lion and hyaena vocalizations to individual female cheetahs. Lion avoidance increased with the statistical interaction between age and reproductive success, suggesting that it may be a learned behaviour, reinforced by successful reproductive events. This behaviour translated into a nonrandom spatial distribution of cheetahs with the most reproductively successful females found near lower lion densities than less successful females. Hyaena avoidance decreased with the interaction between age and reproductive success, suggesting that it is diminished by successful reproductive events, perhaps because a female cheetah switches from avoidance to using antipredator behaviours as she gets older. Hyaena avoidance behaviour translated into a spatial distribution with the most reproductively successful females found near lower hyaena densities than less successful females; however, younger females were found near lower hyaena densities than older females. Copyright 2000 The Association for the Study of Animal Behaviour.

Journal Article↗
PubMed1978

Narcotic cuing and analgesic activity of narcotic analgesics: associative and dissociative characteristics.

By using a discrete-trial, two-lever, food-reinforced discrimination learning paradigm, rats were trained to discriminate the narcotic analgesic fentanyl (0.05 mg/kg) from saline. Stimulus generalization experiments with lower fentanyl doses (0.0025 to 0.02 mg/kg) were carried out to generate individual threshold doses. The latter were compared with the sensitivity of the same rats to the analgesic effect of fentanyl, and it was found that there is no correlation between these two sets of data. In a time-effect experiment, the duration of fentanyl's cuing effect was compared with that of its analgesic effect, and it was found that the time-effect characteristics of the narcotic cue are similar to those of analgesia. Again, however, there was no correlation between the duration of both effects within the same group of animals. The results further deliniate the associative and dissociative characteristics of the narcotic cue and narcotic analgesia.

Analgesics↗
PubMedDate not supplied

Affecting residents' literature reading attitudes, behaviors, and knowledge through a journal club intervention.

OBJECTIVE: To investigate whether a limited teaching intervention, based on principles of adult education, could change residents' literature reading attitudes, behaviors, and knowledge. DESIGN: The educational intervention supplemented an ongoing bimonthly journal club. The effects on residents were studied prospectively before and four months following the intervention. SETTING: A community hospital internal medicine training program. PARTICIPANTS: All 14 residents: six in the first year, and four each in the second and third years of training. INTERVENTION: A one-hour seminar incorporating principles of adult education, including the use of multiple teaching modalities. The content was based on the critical literature reading guidelines published by the McMaster group. Reinforcement of learning objectives was achieved by learner participation, written assignments, active feedback, and follow-up in subsequent journal clubs. RESULTS: Residents improved their performances on objective testing of critical appraisal knowledge by 60% (p = 0.02). They reported improved ability to appraise original research articles critically (p = 0.01) and reported spending more useful time reading. Unaffected were the total time spent reading journals, the reasons for reading them, and the perceived value of journals in "keeping up" with advances in medical knowledge. CONCLUSION: Journal clubs are important to residents, and their effectiveness in teaching critical appraisal and promoting reading of the literature may be augmented by applying principles of adult education.

Adult↗
PubMed1998

Behavioral asymmetries and neurochemical changes after unilateral lesions of tuberomammillary nucleus or substantia nigra.

Previous studies in the rat have shown that the hypothalamic tuberomammillary nucleus, the major source of neuronal histamine, is related to mechanisms of learning, memory, reinforcement, and functional recovery. These functional relationships were found to be partly lateralized. Therefore, we decided to analyze whether unilateral ibotenic acid lesions aimed at this brain region would acutely lead to asymmetries in open-field behavior, and whether they would affect the biogenic amines dopamine and serotonin in the neostriatum, hippocampus, and tectum. We compared this manipulation with unilateral 6-hydroxydopamine lesions of the substantia nigra pars compacta and with unilateral ibotenic acid lesions of the substantia nigra pars reticulata. These lesions were investigated because all three brain areas are anatomically linked to the neostriatum, are related to the neurotransmitters dopamine and serotonin, and play a role in behavioral asymmetry and functional recovery. In support of previous findings, our data show that 6-hydroxydopamine lesions of the substantia nigra pars compacta led to an ipsiversive asymmetry in turning and scanning. Ibotenic acid lesions of the adjacent pars reticulata led to contraversive turning, whereas thigmotactic scanning was reduced bilaterally. In contrast, ibotenic acid lesions of the tuberomammillary nucleus did not affect turning, but led to an ipsilateral asymmetry in scanning. Neurochemically, the 6-hydroxydopamine lesion was mainly characterized by the well-known ipsilateral neostriatal dopamine depletion and increased residual dopamine activity. In hippocampus and tectum, these transmitters were not specifically affected, except for an asymmetry of serotonin in the superior colliculus. The ibotenic acid lesions of the pars reticulata did not deplete neostriatal dopamine, indicating that they spared the dopaminergic output of the substantia nigra. In contrast, they affected dopaminergic and serotonergic measures in the colliculi, which may be due to damage of the nigral GABAergic projection to this brain area. In animals with unilateral ibotenic acid lesions of the tuberomammillary nucleus, several markers of dopaminergic and serotonergic activity were increased in the neostriatum, tectum, and hippocampus. This effect may have been due to the loss of inhibition otherwise provided by the wide-ranging histaminergic output of the tuberomammillary nucleus. These results are discussed with respect to the major outputs of the three brain areas, their potential impacts on neurotransmitters in their projection sites, and their role in behavioral asymmetry.

3,4-Dihydroxyphenylacetic Acid↗
PubMed2000

Functional aspects of the ventral pallidum.

The ventral pallidum is part of the corticoaccumbo-thalamocortical loop of the basal ganglia. In the past the function of this structure was discussed as a pure relay station in the process of limbic-motor integration. Some recent studies, however, underline that on the level of the ventral pallidum motor behavior can be modulated. The stimulation and inhibition of the different transmitter systems that converge in the ventral pallidum (dopamine, glutamate, GABA, neuropeptides) have implications in repetitive-, disinhibited-, learning- and reinforced behavior. The present review summarizes available data of these parameter related to this behavior, i.e. locomotion, reward-related behavior, prepulse inhibition, memory and neurochemistry.

Animals↗