SEARCH · PubMed Health

Results for “Reinforcement Schedule”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15Linked to original sources

PubMedDate not supplied

The effects of D-amphetamine on responding for candy and fruit drink using a fixed ratio and a progressive ratio schedule of reinforcer delivery.

The first purpose of this study was to compare the effects of D-amphetamine (AMPH) on operant responding reinforced under fixed ratio (FR) or progressive ratio (PR) schedules of reinforcement, testing the hypothesis that responding reinforced under a PR operant schedule would be disrupted by lower doses of AMPH than responding reinforced under a FR operant schedule. The second purpose of this study was to test the generalizability of the first hypothesis by comparing the effects of AMPH on responding reinforced by two different reinforcers under both FR and PR operant schedules. Rhesus monkeys had five to six candy and five to six fruit drink sessions per day, and could receive two reinforcers per session. Responding was initially reinforced under a PR procedure, such that the ratio size increased with each subsequent session. The parameters of the PR schedule were individually selected so that monkeys consumed a similar number of candy and fruit-drink reinforcers each day. The effects of oral AMPH (0.5, 0.75, 1.0 mg/kg) on responding were assessed. Responding was then stabilized using a FR schedule with parameters individually selected so that monkeys consumed a similar number of candy and fruit-drink reinforcers each day, and the effects of oral AMPH were again assessed. The PR breakpoint was significantly greater for candy than fruit-drink. AMPH produced dose-related decreases in both candy and fruit-drink intake, but each AMPH dose decreased the number of fruit-drink deliveries to a greater extent than the number of candy deliveries. The results failed to support the hypothesis that responding under PR schedules of reinforcement would be disrupted by lower doses of AMPH.

Animals↗

PubMed1977

Rate and temporal pattern of key pecking under autoshaping and omission schedules of reinforcement.

The role of response-reinforcer contiguity on autoshaped key pecking in pigeons was studied by scheduling response-dependent nonreinforcement at the beginning or the end of brief (8-sec) discrete trials. Schedules that permitted chance conjunctions of key pecking and food sustained high rates of responding, whereas those that prevented the occurrence of key peck-food intervals shorter than 4 sec sustained low response rates. In addition, selective reinforcement schedules supported accelerating or decelerating rates of responding within individual trials. These effects were traceable to response-reinforcer (operant), but not stimulus-reinforcer (respondent) factors.

Journal Article↗

PubMed1996

Effect of 6-hydroxydopamine lesions of the medial prefrontal cortex on intravenous cocaine self-administration under a progressive ratio schedule of reinforcement.

Rats were trained to self-administer intravenous cocaine under a progressive ratio (PR) schedule of reinforcement. Under this schedule, an increasing number of lever responses had to be made to obtain each subsequent reinforcement (1.5 mg/kg per injection). Once stable responding was achieved with this schedule, bilateral 6-hydroxydopamine (6-OHDA) or vehicle-only injections were delivered into the medial prefrontal cortex (mPFC). Following recovery from surgery, the animals were given access to cocaine under the PR schedule. The effect of the lesion on self-administration behaviour was examined at various doses of cocaine (0.09-1.5 mg/kg per injection). 6-OHDA lesions of the mPFC had no effect on self-administration behaviour at the higher unit doses of cocaine. However, at the lower doses (0.09 and 0.19 mg/kg per injection), the lesion caused a significant increase in break point (BP), the number of responses made to obtain the last reinforcement of a self-administration session. The neurochemical results showed a significant reduction (57%) in mPFC levels of dopamine (DA) and 3,4-dihydroxyphenylacetic acid (DOPAC) (53%), with no changes in noradrenaline or serotonin levels. In contrast, the lesion caused no changes in DA or DOPAC levels in the nucleus accumbens (NACC) or striatum. These results indicate that the DAergic innervation of the mPFC cortex has a role in cocaine self-administration behaviour; however, whether this role is contingent on NACC DA function remains to be elucidated.

3,4-Dihydroxyphenylacetic Acid↗

PubMed1999

The behavior of spontaneously hypertensive and Wistar Kyoto rats under a paced fixed consecutive number schedule of reinforcement.

Spontaneously hypertensive (SHR) and Wistar Kyoto rats (WKY) were trained under paced FCN schedules of reinforcement to complete a minimum number of consecutive responses on one lever, before responding on a second. The levers were retracted from the test chamber for a short period after each response to control the speed at which the rats could complete the sequence (paced FCN). Changes in the average chain length may reflect the influence of impulsivity on the execution of behavioral patterns. Although they quickly learned to press the levers, SHR rats performed poorly compared to the WKY rats when the chain length requirement was increased to FCN 6 and FCN 8. Eventually stable performance was obtained under paced FCN 6, although the SHR rats continued to have a consistently lower average chain length. Both strains of rats were treated with imipramine (10 mg/kg), chlordiazepoxide (3 and 10 mg/kg), d-amphetamine (0.4 and 0.8 mg/kg), haloperidol (0.05 and 0.1 mg/kg), 8-OH-DPAT (0.1 mg/kg), WAY-100635 (0.1 mg/kg), and DOI (0.3 and 1.0 mg/kg). The SHR rats were less sensitive to the effects of d-amphetamine, chlordiazepoxide, and DOI and slightly more sensitive to the effects of haloperidol. All of these drugs reduced the average chain length. There was no difference in the response of the two strains to imipramine and 8-OH-DPAT, both of which increased the average chain length. These results support the suggestion that SHR rats may more impulsive than WKY rats. The data with d-amphetamine and haloperidol support biochemical findings that these rats have a deficit in dopaminergic function, and the strain differences in response to chlordiazepoxide and DOI suggest that that there may be differences in GABAergic and 5-HT2-mediated neurotransmission relevant to regulating impulse control in the rat.

8-Hydroxy-2-(di-n-propylamino)tetralin↗

PubMed1976

Matching with a trio of concurrent variable-interval schedules of reinforcement.

A trio of concurrent variable-interval schedules of reinforcement was arranged according to a changeover-key procedure, including a changeover delay of 1.5 sec. The three schedules provided a combined maximum reinforcement rate of 45 reinforcements per hour. With that restriction, the nine experimental conditions included several combinations of variable-interval schedules, sometimes including extinction. The pigeons matched relative response rate and relative time to relative reinforcement rate. Relative time appeared to match some-what better than relative response rate. Performance adjusted rapidly from one experimental condition to the next, whether the change involved two or all three schedules of the concurrent trio.

Journal Article↗

PubMed1979

The effects of schedule of reinforcement on stimulus overselectivity in autistic children.

Recent research demonstrated that when autistic children are presented a discrimination task with multiple cues, they typically respond to an abnormally limited number, usually one, of the available cues. This phenomenon, termed "stimulus overselectivity," has been implicated as a possible basis for many of the behavioral deficits characteristic of autism. The present investigation was conducted to systemically analyze the effects of changing the schedules of reinforcement during discrimination training on subsequent stimulus overselectivity. Twelve autistic children were taught a discrimination involving multiple visual cues, with a CRF schedule of reinforcement. The children were then overtrained on either the same (CRF) schedule or on a partial (VR:3) reinforcement schedule. Subsequent overselectivity on single-cue test trials was then assessed. Results suggested that significantly less overselectivity occurred when the children were presented with the VR:3 reinforcement schedule during overtraining. These results are discussed in terms of variables influencing overselectivity and in terms of implications for designing treatment procedures for autistic children.

Adolescent↗

PubMed1979

Contingency-shaped and rule-governed behavior: instructional control of human loss avoidance.

Instructions can override the influence of programmed schedules of reinforcement. Although this finding has been interpreted as a limitation of reinforcement schedule control in humans, an alternative approach considers instructional control, itself, as a phenomenon determined by subjects' reinforcement histories. This approach was supported in a series of experiments that studied instructional and schedule control when instructions either did or did not accord with the schedule of reinforcement. Experiment I demonstrated that accurate instructions control discriminative performances on multiple avoidance schedules, and that such control persists in a novel discrimination. Experiments II and III showed that elimination of instruction-following occurs when inaccurate instructions cause subjects to contact a monetary loss contingency. Experiment IV demonstrated the reinforcing properties of accurate instructions. Skinner's view of rule-governed behavior is consistent with these findings, and can be extended to account for many aspects of instructional control of human operant behavior.

Journal Article↗

PubMed1996

An experimental comparison of three different schedules of reinforcement of drug abstinence using cigarette smoking as an exemplar.

The efficacy of three different schedules of reinforcement for promoting and sustaining drug abstinence was compared in this study. Cigarette smoking was studied as an exemplar of stimulant drug self-administration. Sixty cigarette smokers were assigned to one of three groups (progressive rate of reinforcement, fixed rate of reinforcement, and yoked control). Participants in all three groups were asked to refrain from smoking for 1 week. Participants in the progressive and fixed groups achieved greater mean levels of abstinence than those in the control group. Participants in the progressive group were significantly less likely to resume smoking when they became abstinent than participants in the other groups.

Adolescent↗

PubMed1991

A simple BASIC program to generate values for variable-interval schedules of reinforcement.

A BASIC program to generate values for variable-interval (VI) schedules of reinforcement is presented. A VI schedule should provide access to reinforcement with a constant probability over a time horizon. If the values in a VI schedule are calculated from an arithmetic progression, the probability of reinforcement is positively correlated with the time since the last reinforcer was delivered. Fleshler and Hoffman (1962) developed an iterative equation to calculate VI schedule values so that the probability of reinforcement remains constant. This easy-to-use program generates VI schedule values according to the Fleshler and Hoffman equation, randomizes the values, and saves the values in ASCII to a disk file.

Journal Article↗

PubMed2002

Effects of fixed ratio schedules of reinforcement on exercise by college students.

Response-contingent reinforcement was expected to increase the time spent riding a stationary exercise cycle by college women. A single-subject experimental design was used. Three college-age women rode a stationary cycle until they were either too tired to continue or until 45 minutes elapsed. Video clips were used to reinforce cycling in the first part of the experiment. Under some conditions, no video clips were presented (baseline). In other conditions, the video was on for the entire session or 25 sec. of video was presented after the completion of FR 40 (40 rotations of the cycle's pedals) or 80 (80 rotations of the cycle's pedals) schedules. In the second part of the experiment, money was presented following every 20 (FR 20) or 40 (FR 40) rotations of the cycle's pedals. The time spent riding the cycle increased over the baseline when video clips were presented. No consistent differences were observed when the video clips were on for the entire session and when they were presented under FR 40 and FR 80 schedules. For one out of two participants, monetary reward increased the time spent riding the cycle. The data suggest that reinforcement schedules are a means of initiating and maintaining adherence to an exercise program.

Adult↗

PubMed1974

Group behavior of rats under schedules of reinforcement.

Groups of three rats were placed in a chamber containing one response lever and one water dispenser. A variety of schedule conditions were explored including fixed ratio, extinction, satiation, fixed interval, fixed time, differential reinforcement of low rates, and discrimination learning. Each group was treated as a single unit, with the collective lever responses emitted by the three rats being the main dependent variable. Group responding was found to be controlled by the reinforcement schedules in an orderly and consistent manner. However, the groups often paused less and responded faster than individual rats working under identical conditions.

Animals↗

PubMed2000

Intra-VTA baclofen attenuates cocaine self-administration on a progressive ratio schedule of reinforcement.

The effect of microinjections of baclofen into the ventral tegmental area (VTA), nucleus accumbens, or striatum on cocaine self-administration reinforced on a progressive ratio schedule was investigated. Intra-VTA baclofen produced the most potent modulation of cocaine intake, causing a significant reduction in cocaine-reinforced break points at a dose (56 ng/side) that was substantially lower than doses necessary to produce comparable reductions in the nucleus accumbens or striatum. During the time that cocaine-reinforced responding was suppressed, rats demonstrated the capacity to complete several hundred responses on a concurrently available food-reinforced lever, indicating that the effect of baclofen on cocaine intake was not due to a generalized disruption in operant responding. The results indicate that GABA(B) receptors in the VTA may have the potential to modulate reward processes associated with cocaine use.

Animals↗

PubMed2001

The effects of nucleus accumbens core and shell lesions on intravenous heroin self-administration and the acquisition of drug-seeking behaviour under a second-order schedule of heroin reinforcement.

RATIONALE: Evidence has implicated the nucleus accumbens (NAcc) in drug-seeking and -taking behaviour. However, the importance of the "core" and "shell" subdivisions of the NAcc in heroin-seeking and -taking behaviour remains unclear. OBJECTIVES: To investigate the function of the NAcc core and shell in heroin self-administration and heroin-seeking behaviour. METHODS: Male rats were trained to self-administer heroin (0.12 mg/kg per infusion) under a continuous reinforcement (CRF) schedule. After responding stabilised, rats were given excitotoxic (or sham) lesions of either the NAcc core or shell and after recovery were assessed for their retention of heroin self-administration under CRF. At this point a second-order schedule of reinforcement was introduced, commencing at FR10 (FR1:S) and terminating at FR10 (FR10:S), in which ten lever presses resulted in presentation of the heroin-associated CS+, and completion of ten such units resulted in drug infusion. RESULTS: Within 7 days, all groups re-acquired responding for heroin under CRF at rates similar to their pre-lesion performance. However, rats with lesions of the NAcc core, but not shell, were severely impaired in the acquisition of heroin-seeking behaviour. CONCLUSIONS: These results indicate an important role for the core of the NAcc in the acquisition of heroin-seeking behaviour under the control of drug-associated stimuli.

Animals↗

PubMed1998

A comparison of Italian, Japanese and American students' responses to the Adolescent Reinforcement Survey Schedule.

The Italian form of the Adolescent Reinforcement Survey Schedule (ARSS-I) was administered to (N = 648) high school boys and girls from northern and central Italy. Their responses were factor analyzed using a principal component. VARIMAX rotation procedure (SAS Institute, Inc., 1990). The 10 interpretable factors from the Italian data were compared and contrasted to factor analytic results from Holmes (1991, 1994) studies using American and Japanese students. Additionally, the Italian data analyses includes an examination by gender using t tests for each of the ARSS-I items and an ANOVA for age and age-gender effects on responses to the ARSS-I.

Adolescent↗

PubMed1991

Effects of schedule of reinforcement on a pentobarbital discrimination in rats.

The purpose of this study was to determine the effects of the schedule of reinforcement on a pentobarbital discrimination in rats. Five rats were trained to discriminate 10 mg/kg pentobarbital from saline under a multiple fixed-interval 180-s fixed-ratio 20 schedule of reinforcement. During both saline and pentobarbital training sessions, subjects emitted a higher percentage of correct responses under the fixed-ratio component as compared to the fixed-interval component of the multiple schedule. Determination of the pentobarbital dose-response curve under the fixed-ratio component resulted in a steep curve characterized by responding on the saline lever at low doses and on the drug lever at higher doses. Under the fixed-interval component, a graded dose-effect curve was produced, with considerable responding on both levers after intermediate doses of pentobarbital. The administration of phencyclidine and MK-801 resulted in an intermediate level of drug-lever responding for some subjects. Administration of d-amphetamine resulted in saline (nondrug) appropriate responding. The results of this study demonstrate that the schedule of reinforcement is a determinant of drug stimulus control, just as it is a determinant of other drug effects.

Animals↗

PubMed1996

Excitotoxic lesions of the basolateral amygdala impair the acquisition of cocaine-seeking behaviour under a second-order schedule of reinforcement.

In these experiments we sought to establish the intravenous (i.v.) self-administration of cocaine under a second-order schedule of reinforcement in order: (i) to obtain reliable, drug-free levels of responding with cocaine as a reinforcer, and (ii) to enable investigation of the neural mechanisms by which arbitrary cues gain motivational salience and, as conditioned reinforcers, control over drug-seeking behaviour. Initially, each infusion of cocaine was made contingent upon a response on one of two identical levers and was paired with a 20-s light conditioned stimulus (CS). Responses on the second lever were recorded, but had no programmed consequence. When rats acquired stable rates of self-administration, a second-order schedule of the type FRx(FRy:S) was introduced, with values of "x" being increased progressively to 10 and then "y" from 2 through 8. Priming (i.e. non-contingent) infusions of cocaine were never given. Once the first infusion was obtained under the second-order schedule, further infusions were made contingent on each response (to a maximum of ten infusions/day). Each stage was repeated daily until the first infusion of each session was achieved within a 5-min criterion. Rats with bilateral, excitotoxic lesions of the basolateral amygdala readily acquired the i.v. self-administration of cocaine under a continuous reinforcement schedule, initially administering more infusions and maintaining a slightly elevated level of self-administration than controls. Despite increased numbers of CS/drug pairings, basolateral amygdala-lesioned rats were severely impaired in the acquisition of the second-order schedule of i.v. cocaine reinforcement. Lesioned rats showed a cocaine dose-response function that was shifted upwards relative to control subjects. There was no significant difference between drug-naive amygdala-lesioned and control animals in the locomotor response to intraperitoneal injections of cocaine. These experiments indicate the feasibility and utility of second-order schedules in studying the neurobehavioural basis of cocaine-seeking behaviour. They suggest a dissociation in the neural mechanisms underlying cocaine-taking and cocaine seeking behaviour, and demonstrate the potential importance of the basolateral amygdala in the processes by which previously neutral stimuli gain control over drug-seeking behaviour.

Amygdala↗

PubMed1990

Disruption of performance under a titrating matching-to-sample schedule of reinforcement by drugs of abuse.

Five adult, male White Carneaux pigeons were trained to respond under a titrating delayed matching-to-sample schedule of reinforcement. Under this schedule, the length of the delay was changed as a function of the pigeons' performances in a manner that resulted in approximately 80% accuracy in matching performance. During the first five trials of each session, the delay value was fixed at either 3 sec or 30 sec (starting delay). On the 6th and all subsequent trials, the length of the delay value was increased by a fixed amount (the titration step), did not change or was decreased by an amount equal to the titration step. Initially, the starting delay and the titration step were set at 3 sec. These values were then systematically changed to a starting delay of 30 and a titration step of 3, and finally, a starting delay of 3 and a titration step of 1. Using this procedure, the effects of pentobarbital (0.3-10 mg/kg), cocaine (0.01-10 mg/kg), d-amphetamine (0.003-3 mg/kg) and phencyclidine (0.03-3 mg/kg) were determined under the different titration parameters. Pentobarbital was shown to decrease matching performance at doses (3, 5.6 and 10 mg/kg) that did not decrease response rates. Phencyclidine produced a similar effect at a dose of 1 mg/kg under two of the three phases of the experiment. No such specific effects were observed with cocaine or d-amphetamine. Thus, of the four drugs studied, pentobarbital showed the most pronounced effect on matching performance. Whether this represents merely a loss of stimulus control or a specific effect on memory is yet to be determined. In addition, the results of these experiments clearly show that when the delay value is allowed to change as a function of the pigeons' performance, pigeons are able to perform at or above 80% accuracy at longer delay values than those generally reported using fixed-delay values.

Animals↗

PubMed1985

The transition from a fixed ratio to a fixed interval schedule of reinforcement in hypo and hyperthyroid rats.

The modification of behavior caused by hypo and hyperthyroidism were studied when the schedule of reinforcement was changed from a fixed ratio to a fixed interval. The conditions of hypo and hyperthyroidism were obtained with a chronic administration of methimazole and of 1-thyroxine. The level of the modifications of thyroid activity was determined by evaluation of the basal metabolic rate and of the plasma levels of T4. Hyperthyroidism caused no modification of the rat behaviour. A difficulty in adapting to the new experimental situation (learning) was found in hypothyroidism. This effect is evident in high hypothyroidism. In low hypothyroidism a depression of the rat behaviour may interfere with the modification of the learning process.

Animals↗