PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Reinforcement Schedule”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

Effects of methadone on behavior maintained by fixed ratio reinforcement schedules.

The effects of subcutaneous injections of methadone hydrochloride (0.75mg, 1.5mg and 2.5mg/kg) on lever pressing maintained by fixed ratio schedules of reinforcement were examined in C57BL/6J and DBA/2J mice. Response output over a 30 min session decreased as a function of increasing drug dose when reinforcement was delivered for every 5 responses. Increasing the response to reinforcement ratio from 5 to 20 in a second experiment doubled and nearly quadrupled responding by DBA and C57 mice, respectively. Injecting animals maintained on this schedule with methadone reduced responding to the same extent as that observed in the first experiment when response rates were lower. Hence, these experiments provide no support for the effect of methadone being rate-dependent. In both experiments methadone disrupted responding of DBA more than that of C57 mice. This finding is consistent with a previous report that other narcotic analgesics were more potent analgesics for DBA than for C57 mice. From these studies it appears that the opposite changes in locomotor activity upon an exposure to narcotic analgesics does not generalize to behavior under control of reinforcing stimuli; and that both the effects obtained in the present study and the analgesic action are dissociated from the effects of these drugs on locomotor activity.

Animals↗

Reinforcement schedules: Retroactive and proactive effects of reinforcers inserted into fixed-interval performances.

The responding maintained by a reinforcer depends on the relation of the reinforcer not merely to the response that produces it but also to other preceding responses. Early responses in a sequence that ends in a reinforcing consequence make smaller contributions to later response rates than more recent ones, by virtue of the longer delays that separate them from the reinforcer. This study shows that the relation between a response and a later reinforcer contributes to responding only if no other reinforcers intervene; in other words, each reinforcer blocks responses that precede it from the effects of later reinforcers. Pigeons' pecks were maintained by fixed-interval (FI) schedules of food reinforcement. When FI 60-s (short) and FI 75-s (long) schedules began simultaneously within constant 150-s cycles, long FIs did not affect short-FI performances, but short FIs eliminated the first 60 s of long-FI performances. Removing either short-FI reinforcers or short-FI stimuli showed that short-FI reinforcers and not short-FI stimuli blocked the first 60 s of the long-FI performance from the retroactive effects of the long-FI reinforcer. With FI 15-s and FI 75-s schedules, the short-FI reinforcer was followed by reduced long-FI responding, but a schedule that prevented discrimination based on time since a reinforcer eliminated this proactive effect of the short-FI reinforcer. In other words, the retroactive effects were reinforcer effects whereas the proactive effects were discriminative effects. Quantitative descriptions of variable-interval performances, in which reinforcer effects may operate in the absence of temporal discriminative effects, can be derived from these relations.

Journal Article↗

PROPERTIES OF BEHAVIOR UNDER RANDOM INTERVAL REINFORCEMENT SCHEDULES.

In a temporally defined system of reinforcement schedules, the fixed interval case is defined when reinforcement probability, P, is equal to unity for the first response in any cycle length, T; when P is less than 1.0, random interval schedules emerge wherein T/P specifies the expected interval between reinforcements. Key-pecking rates were found to be: (a) inversely related to T/P; (b) higher at T=1.0 second than at other T parameter values; (c) low and linear at several T and T/P values. The mean post-reinforcement pause, if initially small, increased, and if initially large, decreased, as T/P increased.

Animals↗

Reinforcement schedules and extrapolations to humans from animals in behavioral pharmacology.

Behavior controlled by various schedules of reinforcement is useful for characterizing drugs as well as for analyzing the mechanisms of action of their effects on behavior. Conditioned avoidance techniques have been useful for studying neuroleptics and for predicting their clinical antipsychotic acitivity; the possible involvement of dopaminergic mechanisms in the effect of neurolpetics on avoidance behavior is discussed. Tricyclic antidepressant agents have been studied in assays involving interactions with other agents, such as cocaine, amphetamine and tetrabenazine. One type of operant behavior, Sidman avoidance, has been used as particularly sensitive assay for such drug interactions. Another schedule, in which "observing" responses in pigeons are measured. seems to provide a method for studying antidepressants without involving drug interaction phenomena. For tricyclic compounds, facilitation of observing responses and weak potency of conditioned avoidance inhibition constitute a pharmacological profile that seems to have some predictive value for clinical imipramine-like antidepressant activity. "Conflict (punishment) schedules have been useful for predicting antianxiety activity in man. Although the degree of anticonflict effect observed is consistent with Dew's rate dependency hypothesis, this principle does not fully account for the observed drug effects. In the conflict model, the actions of benzodiazepines differ in drug-naive versus drug-experienced animals. Experiments with parachlorophenylalnine have not yet provided clear support for the postulated role of serotonin in related phenomena.

Animals↗

Effects of reinforcement schedules on rats' choice behavior in extinction.

The effects of reinforcement schedules on rats' choice behavior in extinction were studied. In a free-operant chamber equipped with two retractable bars, the experimental animals were trained to press the bars separately for a food reward. One bar delivered the reward on a continuous reinforcement (CRF) schedule, and the other delivered the reward on a partial reinforcement (PRF) schedule. Control animals earned the reward from both bars with the same reinforcement schedule, either a CRF or a PRF. When both bars were simultaneously available during extinction, the experimental animals responded more frequently to the CRF than to the PRF alternative, demonstrating a reversed within-subjects partial reinforcement extinction effect (PREE). A conventional between-subjects PREE was replicated in the control subjects. The results of this study were inconsistent with both Amsel's (1962, 1967) frustration hypothesis and Capaldi's (1966, 1967) sequential hypotheses.

Animals↗

Response allocation to concurrent fixed-ratio reinforcement schedules with work requirements by adults with mental retardation and typical preschool children.

The present experiments examined the effect of work requirements in combination with reinforcement schedule on the choice behavior of adults with mental retardation and preschool children. The work requirements of age-appropriate tasks (i.e., sorting silverware, jumping hurdles, tossing beanbags) were manipulated. Participants were presented with their choice of two response options for each trial that varied simultaneously on both work requirement and reinforcement schedule. Results showed that when responding to both choices occurred on the same reinforcement schedule, participants allocated most of their responses to the option with the easier work requirement. When the response option requiring less work was on a leaner reinforcement schedule, most participants shifted their choice to exert more work. There were individual differences across participants regarding their pattern of responding and when they switched from the lesser to the greater work requirement. Data showed that participants' responding was largely controlled by the reinforcement received for responding to each level of work. Various conceptualizations regarding the effects of work requirements on choice behavior are discussed.

Adult↗

Effects of modeling versus instructions on sensitivity to reinforcement schedules.

This study examined the effects of modeling versus instructions on the choices of 3 typically developing children and 3 children with attention deficit hyperactivity disorder (ADHD) whose academic responding showed insensitivity to reinforcement schedules. During baseline, students chose between successively presented pairs of mathematics problems associated with different variable-interval schedules of reinforcement. After responding proved insensitive to the schedules, sessions were preceded by either instructions or modeling, counterbalanced across students in a multiple baseline design across subjects. During the instruction condition, students were told how to distribute responding to earn the most reinforcers. During the modeling condition, students observed the experimenter performing the task while describing her distribution of responding to obtain the most reinforcers. Once responding approximated obtained reinforcement under either condition, the schedules of reinforcement were changed, and neither instruction nor modeling was provided. Both instruction and modeling interventions quickly produced patterns of response allocation that approximated obtained rates of reinforcement, but responding established with modeling was more sensitive to subsequent changes in the reinforcement schedules than responding established with instructions. Results were similar for students with and without ADHD.

Achievement↗

The effects of differential and lag reinforcement schedules on varied verbal responding by individuals with autism.

Variability has been shown to be a reinforceable dimension of behavior. One procedure that has been demonstrated to increase variability in basic research is the lag reinforcement schedule. On this type of schedule, a response is reinforced if it differs from a specified number of previous responses. Lag schedules are rarely used, however, for increasing response variability in applied settings. The purpose of the present study was to investigate the effects of a lag schedule of differential reinforcement on varied and appropriate verbal responding to social questions by 3 males with autism. A reversal design with a multiple baseline across subjects was used to evaluate the effects of the lag schedule. During baseline, differential reinforcement of appropriate responding (DRA) resulted in little or no varied responding. During the intervention, a Lag 1 requirement was added to the DRA (Lag 1/DRA) resulting in an increase in the percentage of trials with varied and appropriate verbal responding for 2 of the 3 participants. In addition, an increase in the cumulative number of novel verbal responses was also observed for the same 2 participants. These results are discussed in terms of reinforcement schedules that support variability, generalization, and potential stimulus control over varied responding.

Adult↗

Behavioral effects of pairing an S-D with a decreasing limited-hold reinforcement schedule.

Four pigeons were trained on a multiple reinforcement schedule consisting of two limited-hold schedules, one in which a discriminative stimulus (S(D)) accompanied the periodic reinforcement contingency, and one in which the discriminative stimulus was omitted. The duration of the limited-hold in each component of the multiple schedule was reduced in parallel steps. It was shown that behavioral differences between the two schedules were attenuated by this manipulation of temporal parameters. When S(D) was reduced in duration, three out of four pigeons responded with extremely high S(Delta) rates, despite the regular pairing of S(Delta) with the reinforcement contingency. These high rates qualitatively resembled the rapid rates emitted on the analogous no-S(D) component.

Animals↗

Contrast effects in multiple fixed-interval reinforcement schedules.

Pigeons were exposed to a multiple fixed-interval one-minute fixed-interval three-minute schedule of reinforcement following training on either a multiple fixed-interval one-minute fixed-interval one-minute schedule or a multiple fixed-interval three-minute fixed-interval three-minute schedule. For all birds, large negative local contrast effects developed during the first of four three-minute intervals in a component; response rate was depressed and postreinforcement pause lengthened in this interval. Positive local contrast effects were evident during the first of 12 one-minute intervals in a component for five of six birds; at asymptote, the pause was very short and response rate slightly elevated during this interval. Overall positive contrast was generally transient and varied considerably across subjects, while overall negative contrast effects, if they occurred, appeared only after a large number of sessions.

Journal Article↗

Behavioral effects of microwave reinforcement schedules and variations in microwave intensity on albino rats.

The objective of this exploratory investigation was to determine the interactive effects of fixed-ratio scheduling of microwave reinforcement in tandem with changes in microwave intensity. Nine albino rats were conditioned to regulate their thermal environment with microwave radiation while living in a Skinner (operant conditioning) Box in which the ambient temperature was about 27.13 degrees F at the beginning of the session. Each rat obtained a 6-sec. exposure of microwave radiation on a fixed-ratio schedule of MW reinforcement, the values of which varied from FR-1 to FR-30. Intensities of MW radiation were 62.5 W, 125 W, 250 W, and 437.5 W. Sessions lasted for 8 to 9 hr. over an approximate 13-mo. period. The effects of the intensity of microwave reinforcement varied as a function of the ratio value of the schedule used. Continuous reinforcement (FR-1) produced the lowest over-all rates, whereas FR-15, and FR-25 produced the highest over-all rates. Relatively higher thermal-behavior rates occurred under 62.5 W than under any of the other MW intensities for FR-1, FR-15, and FR-25, whereas FR-10 and FR-30 ratios produced intermediate rates of thermal responding which were constant for all values of MW intensity. These data are explained in terms of interactive effects between the "local" satiation or deprivation properties of the MW intensity and the ratio requirements of the schedule of MW reinforcement.

Animals↗

Effect of amphetamine on behavior maintained by sucrose: interaction of reinforcement schedule and food restriction.

A multiple schedule (Mult FR 10 VI 30") was employed to examine the interaction of reinforcement schedule and food restriction on amphetamine's effects on lever pressing behavior. High response rates were observed in fixed ratio (FR) 10 components. Significantly lower response rates were observed under the variable interval (VI) 30" schedule. In the nonrestricted feeding condition, significant decreases in high rate FR 10 responding occurred after administration of 1.0 mg/kg amphetamine while lower rates under the same schedule were increased by 0.30 and 1.0 mg/kg amphetamine. In contrast, VI 30" responding was minimally effected at any amphetamine dose. Food restriction resulted in significant increases in responding in both schedule components. Under food restriction, significant decreases in responding were observed only in the FR 10 components at the highest amphetamine dose. The data indicate that amphetamine produced rate-convergent effects and the susceptibility of the animal to these effects was dependent on the schedule of reinforcement and food restriction.

Animals↗

Quasi-reinforcement: control of responding by a percentage-reinforcement schedule.

When a variable-interval schedule of reinforcement was segmented into small fixed-interval components, with reinforcements following some components and brief blackouts following the others, rate of responding doubled and a positively accelerated pattern within each component was obtained. Presented according to this percentage reinforcement paradigm, the blackouts approximated the functions of a food reinforcer. These effects occurred only when the behavior sequence required to produce reinforcement was identical to that required to produce blackout. The quasi-reinforcing effects of these blackout stimuli suggest that a neutral stimulus need not occasion or accompany a primary reinforcer to acquire reinforcing properties.

Journal Article↗

A molar theory of reinforcement schedules.

Behavior of subjects exposed to concurrent and individual interval and ratio schedules of reinforcement may be described in terms of a set of expressions relating the value of responses to their durations, a feedback equation relating reinforcement to response duration, and the assumption that subjects allocate their time among various responses so as to maximize value.

Journal Article↗

Reinforcement schedule effects in rats trained to discriminate 3,4-methylenedioxymethamphetamine (MDMA) or cocaine.

RATIONALE: Relatively few studies have compared the discriminative stimulus effects of 3,4-methylenedioxymethamphetamine (MDMA) and cocaine, and findings from different laboratories are somewhat inconsistent. One possible reason for discrepant results may be the use of different reinforcement schedules during discrimination training. OBJECTIVE: The present study compared fixed ratio (FR) 20 and variable interval (VI) 15-s reinforcement schedules to determine their influence on discrimination acquisition, response rates, frequency of reinforcements, and stimulus generalization in rats trained to discriminate cocaine or MDMA. MATERIALS AND METHODS: Thirty-two male Sprague-Dawley rats were trained to discriminate cocaine (10 mg/kg; n=16) or MDMA (1.5 mg/kg; n=16) from saline under either a FR 20 or a VI 15-s schedule of food reinforcement. Stimulus generalization tests were conducted with a range of doses of cocaine, MDMA, d-amphetamine, and lysergic acid diethylamide in all four training groups. RESULTS: The FR 20 schedule facilitated more rapid discrimination acquisition compared to the VI 15-s schedule and established differential response rates and frequency of reinforcement under drug and vehicle conditions. However, reinforcement schedule had little influence on stimulus generalization between MDMA and cocaine. Cocaine produced partial substitution for MDMA in both training groups (FR 20, 51%; VI 15-s, 58%). Likewise, MDMA produced only partial substitution for cocaine in both training groups (FR 20, 40%; VI 15-s, 72%). CONCLUSIONS: The present findings suggest that the number of sessions required to establish discriminative stimulus control varies with different reinforcement schedules. Nevertheless, training schedules alone do not appear to have significant effects on stimulus generalization between MDMA and cocaine.

Animals↗

Discrimination of pentobarbital doses and drug mixtures under fixed-ratio and fixed-interval reinforcement schedules.

Pigeons were trained to discriminate among 5 mg/kg pentobarbital, 10mg/kg pentobarbital, and saline, under either fixed-interval (FI) or fixed-ratio (FR) reinforcement schedules. When baseline responding stabilized, a higher percentage of responses occurred on the key that produced the reinforcer under the FR schedule than under the FI schedule. After low doses of pentobarbital, responding shifted from the saline key to the 5 mg/kg pentobarbital key; at higher doses of pentobarbital responding shifted to the 10mg/kg pentobarbital key under both schedules. After low doses of ethanol and chlordiazepoxide, responding shifted from the saline key to the 5 mg/kg pentobarbital key, but after high doses of these drugs, responding continued to occur on the 5 mg/kg pentobarbital key under both reinforcement schedules. A 5 mg/kg dose of pentobarbital increased responding on the 10 mg/kg pentobarbital key when it was combined with pentobarbital, ethanol or chlordiazepoxide. Phencyclidine and D-amphetamine produced responding largely on the saline key under both reinforcement schedules. Under the FR schedule, pentobarbital dose-response curves were usually quantal, whereas under the FI schedule the pentobarbital dose-response curves usually were graded.

Animals↗

Self-administered and noncontingent nicotine enhance reinforced operant responding in rats: impact of nicotine dose and reinforcement schedule.

RATIONALE: Nicotine infusions that are self-administered (contingent) or response-independent (noncontingent) increase lever pressing for a reinforcing nonpharmacological stimulus in rats, suggesting that in addition to primary reinforcement, nicotine self-administration may result from nicotine enhancing the reinforcement derived from nonnicotine stimuli. OBJECTIVES: Based on our previous research, in this study, we tested the hypothesis that contingent and noncontingent nicotine would equally elevate responding for a moderately reinforcing visual stimulus, across a range of nicotine doses on both fixed ratio and progressive ratio reinforcement schedules. MATERIALS AND METHODS: The rats lever pressed for a visual stimulus with contingent nicotine, noncontingent nicotine, or contingent saline. Separate groups responded for saline or nicotine without the visual stimulus. Three doses of nicotine (0.01, 0.03, and 0.09 mg/kg per infusion, free base) were tested in a between-groups design. After responding on an escalating fixed ratio reinforcement schedule, the rats were tested on a progressive ratio schedule. RESULTS: Compared to responding for the visual stimulus with saline, both contingent and noncontingent nicotine equally elevated lever pressing for the stimulus at each dose on fixed and progressive ratio schedules. In the absence of the stimulus, only the highest nicotine dose sustained self-administration. CONCLUSIONS: The ability of noncontingent nicotine to elevate responding for a moderately reinforcing visual stimulus occurs across a range of doses, and both self-administered and noncontingent nicotine equally increase motivation to obtain the stimulus, as reflected by performance on a progressive ratio schedule. In the absence of a contingent stimulus, primary reinforcement from nicotine only supports self-administration at high nicotine doses in rats.

Analysis of Variance↗