SEARCH · PubMed Health

Results for “Reinforcement Schedule”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42Linked to original sources

PubMed1973

Fixed-interval schedule of cocaine reinforcement: effect of dose and infusion duration.

Rhesus monkeys were trained on a fixed-interval 9-min limited-hold 3-min schedule of intravenous cocaine reinforcement. A 15-min timeout followed each reinforcement or limited-hold expiration. An identical schedule of food reinforcement was interspersed in the session to assess rate-modifying effects of the drug infusions not specific to drug reinforcement. In one experiment, response rate for cocaine reinforcement was shown to be a positive function of reinforcement magnitude for a dose range from 0 to 800 ug/kg/inj. At these doses, there was little effect on food reinforced responding except at the highest dose, where responding decreased. Results of the second experiment indicated that increasing the duration of the cocaine infusion produced a change in response rate similar to decreasing unit dose. The response rate change for a given increase in infustion duration was less at a unit dose of 400 ug/kg than at 200 ug/kg.

Animals↗

PubMed1990

Performance on ratio and interval schedules with matched reinforcement rates.

In the first study, rats were trained to pull a chain on a schedule (RPI) that regulates the probability of reinforcement to maintain a constant average reinforcement rate without differentially reinforcing long inter-response times (IRTs). Although the response rate was sensitive to the overall rate of reinforcement, performance was unaffected by variations between 1 and 50 in the IRT memory size used in programming the schedule. In the second study, two groups of animals performed on either a random-interval (RI) schedule or a RPI schedule, with reinforcement rates determined by those generated by a third group performing on a random ratio (RR) 20 schedule. The RI group responded at a lower rate than the RPI group, which, in turn, responded at a lower rate than the RR group, even though the three groups experienced comparable rates of reinforcement. The fact that the RPI group responded at a lower rate than the RR group suggests that the standard response rate difference observed between ratio and interval schedules, which have been matched for reinforcement rate, cannot be attributed solely to the fact that conventional interval schedules differentially reinforce long IRTs.

Animals↗

PubMed1991

Local contrast in behavior allocation during multiple-schedule components.

Allocation of responses between two keys was studied during two alternating multiple-schedule components. Responses were recorded in successive quarters of each component. Variable-interval reinforcer schedules on the two keys were constant throughout the experiment for one (constant) component and were varied over conditions on one key for the other, producing changes in reinforcer ratios for the varied component. Behavior allocation for the first quarter of the constant component was inversely related to varied-component reinforcer ratios, a form of local contrast, but this relationship was not observed later in the component. During the first quarter of the varied component, slopes of matching lines were high and decreased later in the component. It is argued that this form of local contrast cannot be explained in terms of reallocation of extraneous reinforcers between components, and that the matching law for concurrent operants does not capture some sources of control over behavior allocation. A simple extension of the matching law is offered that adequately describes behavior changes during both components. A version of this formulation can predict contrast effects in absolute response rates.

Journal Article↗

PubMed1987

Clonidine suppression and its adrenoreceptor mediation in schedule-induced polydipsia.

Rats were trained in a fixed-interval, one-minute (FI 1 min) food reinforcement schedule for 1 hour daily at reduced body weight until their lever presses, licks and water intake all became stabilized for 6 days. Two experiments were performed to examine the function of sympathetic activity in schedule-induced polydipsia. In experiment 1, intracerebroventricular injection of clonidine (0.75-37.5 nmol) produced a dose-related suppression of schedule-induced drinking and licking and schedule-dependent lever pressing; these effects were later attenuated by yohimbine (5 nmol) pretreatment. Prazosin (10 nmol) also decreased clonidine-induced suppression of lever pressing, whereas neither prazosin (10 nmol) nor naloxone (10 nmol) caused any alteration in the suppression effects of clonidine on drinking and licking. None of these antagonists alone changed an individual rat's preestablished behavioral baselines. In experiment 2, the endogenous catecholamine levels, were determined in frontal cortex, hypothalamus, brainstem, dorsal obex area and adrenal glands. During the SIP situation, both the epinephrine level in adrenal glands and the norepinephrine level in hypothalamus were elevated.

Adrenal Medulla↗

PubMed2007

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits.

BACKGROUND: Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation. OBJECTIVE: The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry. RESULTS: The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior. CONCLUSIONS: Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression.

Animals↗

PubMed1986

The effects of intrahippocampal ibotenate on resistance to extinction after continuous or partial reinforcement.

Intracerebral injections of ibotenate were used to produce, in rats, extensive cell loss in the hippocampus and dentate gyrus (complete hippocampal, CH), in the CH plus subiculum (SUB + CH), or in the subiculum plus entorhinal cortex (SUB + EC). These rats and sham-operated controls were trained to run in a straight alley for food reward delivered on a continuous (CR) or partial (PR) reinforcement schedule. In controls PR training gave rise to the well-known partial reinforcement extinction effect (PREE), i.e., greater resistance to extinction than that observed in CR-trained animals. Previous work had shown that large aspiration lesions of the hippocampal formation eliminate the PREE by increasing resistance to extinction in CR-trained animals and decreasing resistance to extinction in PR-trained animals. In the present experiments the PREE survived CH lesions, which increased resistance to extinction in both CR and PR training conditions; these effects were observed in the start and run (but not goal) sections of the alley. In contrast, subicular cell loss (in both SUB + CH and SUB + EC groups) abolished the PREE (but in the goal section only) by increasing resistance to extinction in the CR condition and decreasing resistance to extinction in the PR condition. In addition, some of the effects of PR training on start and run speeds during acquisition were altered by the CH and SUB + CH lesions. These results confirm previous data showing that the hippocampal formation plays a role in mediating the behavioural effects of PR training, but require modification of the model previously proposed to account for these data.

Animals↗

PubMed1988

The effects of intra-subicular ibotenate on resistance to extinction after continuous or partial reinforcement.

Intracerebral injections of ibotenate were used to produce, in rats, extensive cell loss in the subiculum. These rats and sham-operated controls were trained to run in a straight alley for food reward delivered on a continuous (CR) or partial (PR) reinforcement schedule. In controls PR training gave rise to the well-known partial reinforcement extinction effect (PREE), i.e., greater resistance to extinction than that observed in CR-trained animals. Previous experiments have shown that large aspiration lesions of the hippocampal formation eliminate the PREE; and that ibotenate-induced lesions of the subicular region plus either the hippocampus or the entorhinal cortex disrupt it. In contrast to these previous results, the PREE was unaltered in the present experiment by damage largely restricted to the subiculum. This lesion caused only relatively small changes in running speeds during acquisition. Thus the critical region(s) of damage within the hippocampal formation for disruption of the PREE remains uncertain.

Animals↗

PubMed1992

Reinstatement of heroin self-administration habits: morphine prompts and naltrexone discourages renewed responding after extinction.

The effects of morphine, naltrexone, and nalorphine were studied in rats trained to lever-press for intravenous heroin and then tested under conditions of non-reinforcement. Animals were reinforced for lever-pressing on a continuous reinforcement schedule (100 micrograms/kg per infusion) for 2-3 h each day following which reinforcement was terminated and animals were studied under extinction conditions for the remainder of the session. Each day following the termination of responding under extinction conditions, animals were given a single injection of saline, morphine, nalorphine, or naltrexone; lever-pressing under the extinction conditions was then observed for several hours. When animals adapted to this regimen, very low levels of responding were seen following saline injections; morphine (2 or 10 mg/kg) reinstated vigorous responding that lasted 1-4 h. Naltrexone (2 mg/kg) suppressed responding below the levels seen after saline, and nalorphine (10 mg/kg) had the same effect as saline. These observations support the view that opioid-seeking behavior is primed by the proponent or opioid-like actions of opioids and not by the opponent or drug-opposite effects associated with opioid withdrawal.

Animals↗

PubMed2006

Increased consumption but not operant self-administration of ethanol in mice lacking the RIIbeta subunit of protein kinase A.

BACKGROUND: Accumulating evidence indicates that adenosine monophosphate (cAMP)-dependent protein kinase A (PKA) is involved in the neurobiological responses to ethanol. Previous reports indicate that mice lacking the RIIbeta subunit of PKA (RIIbeta(-/-)) voluntarily consume more ethanol than wild-type controls (RIIbeta(+/+)) using 2-bottle testing procedures. Although such procedures primarily measure consummatory behavior, operant self-administration procedures allow analysis of consummatory as well as appetitive or "ethanol-seeking" behavior (i.e., lever pressing is required to gain access to the ethanol solution). Therefore, we determined whether the high ethanol consumption characteristic of RIIbeta(-/-) mice would be complemented by increased appetitive ethanol-seeking behavior in an operant paradigm. METHODS: RIIbeta(-/-) (n=8) and RIIbeta(+/+) (n=8) mice were initially sucrose-faded until they were lever responding for nonsweetened ethanol (10, 14, and 18%). Following the self-administration testing, RIIbeta(+/+) and RIIbeta(-/-) mice were given access to 2 bottles, one containing water and the other ethanol to replicate the voluntary ethanol drinking data previously from our laboratory. Finally, immediately after voluntary consumption all mice were again tested for self-administration of 10% ethanol. Alterations in the reinforcement schedule were also explored as RIIbeta(+/+) and RIIbeta(-/-) mice were tested for self-administration of 10% ethanol at FR-3 and FR-5 schedules. RESULTS: The RIIbeta(-/-) mice displayed lower operant responding for ethanol and food reinforcement compared with RIIbeta(+/+) controls. However, this effect was driven by a significant increase in lever responses made by female RIIbeta(+/+) mice. When the excessive lever responses of the female RIIbeta(+/+) mice are accounted for, the RIIbeta(-/-) mice show ethanol lever responses comparable to controls. Following operant self-administration testing, RIIbeta(-/-) mice of both sexes consumed more ethanol solution compared with RIIbeta(+/+) mice during 2-bottle testing. CONCLUSIONS: Increased ingestion of ethanol by RIIbeta(-/-) mice is likely the result of altered PKA activity within neuronal pathways that control ethanol-consummatory behaviors. Conversely, the RIIbeta subunit of PKA appears not to play a critical role in neuronal pathways that regulate appetitive behaviors directed at obtaining ethanol. Finally, increased operant self-administration of food and ethanol by female wild-type mice was absent in female RIIbeta(-/-) mice, suggesting that normal PKA signaling may be part of a general, and sex-dependent, mechanism involved with reinforcement-seeking behavior.

Alcohol Drinking↗

PubMed1980

Relationship of reinforcement by student clinicians and peers to accuracy of imitated grammatical constructions during language training.

Percentages of correctly imitated grammatical constructions were examined within a framework of reinforcement theory. Four small treatment groups, each of 4 language-delayed children, were repeatedly observed interacting with different student-clinicians. The Therapy Reinforcement Schedule was used to obtain frequency counts of verbal and non-verbal reinforcements so that within each language group the students could be objectively divided into those who frequently and infrequently were reinforcing, and the children into those for whom peer-reinforcement was high or low. The resulting 4 groups were compared for proportions of accurately imitated constructions with a repeated-measures analysis of variance design (student-clinicians' reinforcement x peers' reinforcement x trials). Correctly scored imitations increased significantly over trials. In addition, children interacting with frequently reinforcing students received higher imitation scores than those with infrequently rewarding ones. Significant main effects of reinforcement by the peer group were not observed, although a reliable interaction of student-clinicians' reinforcement x peers' reinforcement was present. Regression analyses indicated the importance of certain types of reinforcements in predicting accuracy of imitation.

Child, Preschool↗

PubMed1985

Sequential effects in dimensional contrast.

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast "shoulders," seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.

Journal Article↗

PubMed2006

Effects of environmental enrichment on extinction and reinstatement of amphetamine self-administration and sucrose-maintained responding.

The current experiments aimed to determine whether differential rearing alters extinction and/or reinstatement of amphetamine self-administration or sucrose-maintained responding. Male Sprague-Dawley rats were raised in either an enriched condition or an isolated condition. Rats were then trained to lever press on a continuous reinforcement schedule across either 15 daily amphetamine self-administration sessions or 15 sucrose-reinforced sessions, followed by 10 sessions of extinction. After the extinction sessions, priming doses of amphetamine (0, 0.25 or 1.0 mg/kg) were administered 15 min before the session, or sucrose (one or 10 pellets) was delivered non-contingently at the beginning of the session. Enriched condition rats showed greater extinction for amphetamine and sucrose-maintained responding than isolated condition rats. When primed with amphetamine, isolated condition rats reinstated responding following 0.25 mg/kg of amphetamine, whereas enriched condition rats only reinstated responding after 1.0 mg/kg of amphetamine. Isolated condition rats failed to reinstate responding following sucrose delivery, while enriched condition rats reinstated responding following the delivery of 10 sucrose pellets. These results indicate that environmental enrichment enhanced the extinction of both amphetamine and sucrose-maintained responding. Environmental enrichment also raised the reinstatement threshold specific to the amphetamine prime, suggesting a reduction in the incentive motivational effect of amphetamine.

Amphetamine↗

PubMed1995

The paradox of preference for unreliable reinforcement: The role of context and conditioned reinforcement.

We discuss Belke and Spetch's (1994) work on choice between reliable and unreliable reinforcement. The studies by Belke and Spetch extend a line of basic research demonstrating that under certain experimental conditions in a concurrent chains procedure, pigeons prefer an alternative that produces unreliable reinforcement. The authors describe the variables that influence preference for unreliable reinforcement, including the signaling and the duration of the reinforcement schedules, the context in which the signaling stimuli occur, and the effects of conditioned reinforcement. Hypothetical applied examples that address these variables are provided, and their influence on preference for unreliable reinforcement in humans is discussed. We conclude by suggesting a line of applied research to examine the relationship between these variables and a preference for unreliable reinforcement.

Journal Article↗

PubMed2002

Conditioning the pecking motions of pigeons.

The spatio-temporal courses of head and neck motions of pigeons while pecking at small grains are described. Single and serial pecks are distinguished but the inter- and intraindividual variability of the peck kinetics is stressed. Pigeons were then trained with instrumental conditioning procedures to speed-up their pecking. A partial reinforcement schedule where pigeons had to peck repeatedly before receiving reward led to a mild shortening of inter-peck intervals at lower reinforcement rates but surprisingly, a lengthening at higher rates. A schedule where short inter-peck intervals were differentially rewarded yielded a pronounced abbreviation of the inter-peck intervals, but this was achieved by a reduction of the movement path rather than an increase in motion velocity. A schedule whereby increased approach velocities were differentially rewarded yielded marked movement accelerations. When pigeons were rewarded for diminished approach speeds they also showed significant movement decelerations. Finally, it is shown that pigeons could learn to reliably abort their peck approach movement when a visual stimulus signalling a penalty was occasionally presented during the approach movement. The proportion of successful peck interruptions decreased as these interruption signals occurred later during the approach phase. It is concluded that the pecking of pigeons is neither an innately fixed nor a visually ballistic movement. It is instead a multiply controlled and flexibly adaptable response pattern.

Journal Article↗

PubMed1986

Behavioral deficits induced by low doses of apomorphine in rats: evidence for a motivational and cognitive dysfunction which discriminates among neuroleptic drugs.

In order to further assess the alterations (motor, motivational or cognitive) that might underlie animal behavioral deficits associated with a reduced dopamine transmission, the effects of apomorphine at doses thought to stimulate dopaminergic autoreceptors were studied on rat operant behavior. Apomorphine (30 micrograms/kg SC) decreased the number of food rewards obtained, when rats trained on a continuous reinforced schedule were shifted to schedules of fixed ratio higher than 2:FR3, FR4, and FR8. In rats shifted to a FR4 schedule, apomorphine (7.5, 15, 30, 60 micrograms/kg SC) dose-relatedly reduced the number of rewards obtained. In rats subjected to previous extinction sessions, apomorphine (30 micrograms/kg) did not affect lever pressing reinstated on presentation of primary reinforcers but inhibited responding renewed on presentation of secondary reinforcers. Under a FR(3 + 1) schedule where the last (rewarded) response was distinct from the initial (non-rewarded) responses, the detrimental effect of apomorphine on response rates was considerably weaker than under a conventional FR4 schedule. The reward deficits caused by apomorphine under the FR4 schedule were dose-dependently and completely reversed by amisulpride (0.125, 0.25, 0.5, 1 and 2 mg/kg), pimozide (0.125 mg/kg), sulpiride (8, 16, 32 and 64 mg/kg), but not by conventional neuroleptics (namely chlorpromazine, fluphenazine, haloperidol, metoclopramide and thioridazine). It is suggested that behavioral deficits associated with a reduced dopamine transmission such as that caused by low doses of apomorphine involve motivational and cognitive dysfunctions rather than motor impairments. In account of its differential sensitivity to neuroleptic drugs, apomorphine-induced deficit might have some relevance for a further delineation of the mechanisms of action of these compounds.

Animals↗

PubMed2000

A behavioral economic analysis of concurrent ethanol- and water-reinforced responding in different preference conditions.

BACKGROUND: The reinforcing properties of orally self-administered drugs have been evaluated by using choice procedures. The preference for the drug over a nondrug alternative has indicated that the drug has greater value than the nondrug alternative as a reinforcer at some drug concentrations. However, at large drug concentrations, the fluid deliveries of the drug may be equal to or less than those of the nondrug alternative, whereas the actual drug intake (milligrams per kilogram of body weight) may continue to increase. In this study, we used behavioral economics to evaluate the reinforcing strength of ethanol in conditions where baseline ethanol fluid deliveries were greater than, equal to, or less than those of the concurrently available water. METHODS: Four male rhesus monkeys were allowed access to ethanol (2%, 8%, or 32%) and water for 2 hr/day under a fixed ratio (FR) 4 reinforcement schedule. At each ethanol concentration, the FR for both fluids was gradually increased to FR 64. RESULTS: During the FR 4 schedule, the fluid deliveries of ethanol at 2%, 8%, and 32% were greater than, equal to, and less than those of water, respectively. When the FR was increased at 2% ethanol, fluid deliveries and responding decreased for both the ethanol and water. When the FR was increased at 8% ethanol, water fluid deliveries and responding decreased more rapidly than did those of ethanol. When the FR was increased at 32% ethanol, the ethanol fluid deliveries remained the same across all FRs, whereas water fluid deliveries decreased rapidly. At 8% and 32% ethanol, the responding for ethanol, relative to water, increased dramatically. CONCLUSIONS: In behavioral economic terms, demand for ethanol was more inelastic regardless of whether the ethanol or water maintained more absolute fluid deliveries at baseline FRs. Therefore, researchers should examine the reinforcing effects of ethanol in a variety of concentration and schedule conditions rather than drawing inferences regarding reinforcing effects simply based on a preference measure.

Alcohol Drinking↗

PubMed1966

Varying temporal placement of an added stimulus in a fixed-interval schedule.

One paradigm for exploring stimulus effects on behavior is defined for steady state experiments. The paradigm is illustrated by a 60-sec fixed-interval reinforcement schedule wherein a 6-sec light is introduced into each interval. The temporal relation of this stimulus to the reinforcer is the independent variable that is systematically explored. Two experiments studied this temporal relation under two parametric conditions: (a) when the 6-sec light occurs once in each 60-sec interval, (b) when the 6-sec light occurs twice in each interval, the second time always during the 6 sec immediately preceding the reinforcer. Functions are presented showing the effect of the 6-sec light on responding at all points in the fixed-interval.

Animals↗

PubMed1994

Preference for reinforcers under varying schedule arrangements: A behavioral economic analysis.

The field of behavioral economics combines concepts from economics and operant conditioning to examine the influence of schedules or price on preference for reinforcers. Three case studies are reported in which behavioral economic analyses were used to assess relative preference for reinforcers shown by people with intellectual disabilities when schedule requirements varied. The studies examined (a) preference for different reinforcers, (b) substitutability of reinforcers, and (c) changes in preference as a function of schedule requirements.

Journal Article↗