Intravenous cocaine self-administration by human volunteers: second-order schedules of reinforcement.
Explore the source record for details and available documents.
Adult↗
SEARCH · PubMed Health
Results for “Reinforcement Schedule”
Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Effects of chlorpromazine on behavior maintained by a multiple schedule of reinforcement.
Explore the source record for details and available documents.
Animals↗
Independence of concurrent responding maintained by interval schedules of reinforcement.
A pigeon's responses were reinforced on a variable-interval schedule on one key; and, concurrently, either a multiple or a fixed-interval schedule of reinforcement was in effect on a second key. These concurrent schedules, conc VI 3 (mult VI 3 EXT) or conc VI 3 FI 6, were programmed with or without a changeover delay (COD). Because the COD provided that responses on one key could not be followed by reinforced responses on the other key, responding on one key was not likely to accidentally come under the control of the reinforcement schedule on the other. When the COD was used, the performances on each key were comparable to the performances maintained when these interval schedules are programmed separately. The VI schedule maintained a relatively constant rate of responding, even though the rate of responding on the second key varied in a manner appropriate to the schedule on the second key. The mult VI 3 EXT schedule maintained two separate rates of responding: a relatively high rate during the VI 3 component, and almost no responding during the EXT component. The FI schedule maintained the gradually increasing rate of responding within each interval that is characteristic of the performance maintained by this schedule. The concurrent performances, however, did include certain interactions involving the local characteristics of responding and the over-all rates of responding maintained by the various schedules. The relevance of the present findings to an inter-response time analysis of VI responding, a chaining account of FI responding, and the concept of the reflex reserve was discussed.
Animals↗
Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement.
Reinforcements were arranged independently of the pigeon's behavior by concurrent variable-interval schedules. The reinforcements arranged by one of the schedules occurred when the chamber was illuminated with amber light, and the reinforcements arranged by the other schedule occurred when the chamber was illuminated with blue light. Both schedules functioned concurrently, but reinforcers were delivered by each only in the presence of the appropriate stimulus condition. A response on a white key, the only key in the chamber, alternated the stimulus condition and the effective schedule. The results of this procedure were similar to those obtained with concurrent response-dependent variable-interval schedules of reinforcement. The proportion of the total session time spent in the presence of a schedule component approximated the proportion of the total number of reinforcements in the component. Changeover rate was a decreasing function of the changeover delay and of the difference between the relative rates of reinforcement for each pair of concurrent schedules.
Journal Article↗
The following schedule of reinforcement as a fundamental determinant of steady state contrast in multiple schedules.
Two experiments investigated whether steady-state interactions in multiple schedules depend exclusively on the following schedule of reinforcement. Experiment 1 used a four-component multiple schedule in which two components were associated with the same constant schedule of reinforcement, and where rate of reinforcement was varied in the component that followed one of these. Contrast effects were reliable only in the component that preceded the point of reinforcement variation, although some contrast did occur otherwise. In those instances where contrast other than the following-schedule effect did occur, it was accounted for by the effect of the preceding schedule, an effect for which there were consistent individual differences among subjects, and which varied with component duration. Experiment 2 used a three-component schedule, in which reinforcement rate was varied in the middle component. The results were consistent with Experiment 1, as the following-schedule effect was the only consistent effect that occurred, although an effect of the preceding schedule did occur for some subjects under some conditions, and was especially evident early in training. The conclusion from both experiments is that there is no general effect of relative rate of reinforcement apart from the sum of the effects of the preceding and following schedules, and that the following-schedule effect is the fundamental cause of steady-state interactions.
Journal Article↗
Response strength of young children in operant audiometry.
An operant conditioning discrimination paradigm was evaluated in terms of relationships between response behavior of young children and two stimulus components of the paradigm, the discriminative stimulus (DS) and the reinforcing stimulus (RS). Experiment I measured response performance in normal 1-year-old subjects as a function of differences in intensity and/or complexity among three DSs. Results showed no significant differences in conditioning rate, habituation, or consistency of the conditioned response relative to variable properties of the DS. Experiment II examined response performance of normal 2-year-old children as a function of two modifications in the RS, reinforcement schedule and reinforcement novelty. Subjects reinforced on a variable-ratio schedule of intermittent reinforcement and subjects reinforced on a 100% schedule demonstrated equivalent response habituation and consistency. In the second part of the experiment, subjects receiving novel RSs showed significantly greater response recovery than subjects reinforced with familiar RSs. Comparison of normal 1- and 2-year-old children revealed similar rates of conditioning and response consistency. However, 2-year-olds habituated more rapidly than 1-year-olds.
Acoustic Stimulation↗
Effects of caffeine and PD 116,600 on the differential-reinforcement-of-low rate 72-S (DRL 72-S) schedule of reinforcement.
Caffeine and PD 116,600 were found to decrease the reinforcement rate and increase the response rate in rats performing under a differential-reinforcement-of-low rate 72-s (DRL 72-s) schedule of reinforcement. In contrast, antidepressant drugs previously have been found to increase the reinforcement and decrease the response rate. Caffeine has been found to test similar to antidepressant drugs on at least one other behavioral screen, but caffeine does not possess clinical antidepressant properties. These results provide further support for the DRL 72-s schedule as a behavioral screen for antidepressant drugs.
Animals↗
Intermittent rewards raise self-stimulation thresholds.
Rats implanted with lateral hypothalamic electrodes pressed a lever to obtain 0.5 s bursts of pulses under the four combinations of fixed or variable, interval or ratio, schedules of reinforcement. Along with continuous reinforcement schedules, intervals of 1, 2, 5, and 10 s, or ratios of 2, 5, and 10 responses per stimulation were used in sessions wherein the frequency thresholds, defined as pulse frequencies that would support half-maximum rates of response, were estimated. Thresholds rose systematically under both ratio and interval schedules of reinforcement, and there was no difference between fixed and variable variations. When normalized data were plotted as a function of reinforcement density, thresholds from both interval and ratio schedules followed the same pattern, suggesting that the common factor was time between rewards. An increase in the current with a corresponding decrease in pulse frequency increased the rate at which time between rewards augmented thresholds.
Animals↗
Measuring threshold of reinforcing brain stimulation by the method of constant stimuli.
A new method for measuring threshold of reinforcing electrical brain stimulation is described and results of a parametric study using this method are presented. Two groups of rats were trained under a concurrent FR-CRF (fixed ratio-continuous reinforcement) schedule of reinforcement provided by electrical stimulation of the lateral hypothalamus. The invariant intermittent FR schedule of reinforcement was used to maintain a baseline of behavior while a superimposed concurrent CRF schedule was used to measure reinforcement magnitude by varying the intensity of the CRF stimulus between zero and a maximum. Increasing and decreasing stimulus intensity on the CRF schedule leads to a gradual disappearance, respectively reappearance, of post-reinforcement pauses (PRPs) on the concurrent FR schedule, providing a criterion for changeover in schedule control, and thus, for threshold of reinforcement. To illustrate the measurement of threshold according to psychophysical requirements of the Method of Constant Stimuli, different CRF intensities were given in a randomized order. In one group of animals FR and CRF stimuli were given through the same electrode. Another group received FR and CRF stimuli through separate electrodes implanted in different hemispheres of the brain. For both groups the duration of the PRP was used as the dependent variable. The data of both groups showed a high negative correlation between the intensity of the CRF stimulus and the duration of the PRP, which is consistent with the results of experiments in which a Method of Limits procedure was used. On the basis of this relationship between CRF current intensity and PRP duration a threshold for reinforcing brain stimulation was calculated.
Animals↗
Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type.
The rate of a reinforced response is conceptualized as a composite of engagement bouts (visits) and responding during visits. Part I of this paper describes a method for estimating the rate of visit initiations and the average number of responses per visit from log survivor plots: the proportion) of interresponse times (IRTs) longer than some elapsed time (log scale) plotted as a function of elapsed time. In Part 2 the method is applied to IRT distributions from rats that obtained food pellets by nose poking a lighted key under various multiple schedules of reinforcement. As expected, total response rate increased as a function of (a) increasing the rate of reinforcement (i.e., variable-interval [VI] 4 min vs. VI 1 mi), (b) increasing the amount of the reinforcer (one food pellet vs. four pellets), (c) increasing the percentage of reinforcers that were contingent on nose poking (25% vs. 100%), and (d) requiring additional responses after the end of the VI schedule (i.e., adding a tandem variable-ratio [VR] 9 requirement). The first three of these variables (relative reinforcement) increased the visit-initiation rate. The tandem VR, in contrast, increased the number of responses per visit. Thus, variables that have similar effects on total response rate can be differentiated based on their effects on the componemts of response rate.
Animals↗
Responding under discrete-trial fixed-interval schedules of reinforcement.
A fixed-interval schedule of reinforcement was modified by dividing each interval into 4-sec trial periods. No more than one response could occur during each trial because the operandum was inactivated for the remainder of any trial in which a response occurred. For example, under a 28-sec schedule, no more than seven responses could be emitted between reinforcements. Probabilities of responding by pigeons under six values of this discrete-trial fixed-interval schedule were best described by a two-state model: responding was either absent or infrequent immediately after reinforcement; then, at some variable time after reinforcement, there was an abrupt transition to a high and constant probability of responding on each trial. Performances under the discrete-trial procedure were less affected by uncontrolled sources of variance than performances under equivalent free-operant fixed-interval schedules.
Journal Article↗
Cocaine self-administration under fixed and progressive ratio schedules of reinforcement: comparison of C57BL/6J, 129X1/SvJ, and 129S6/SvEvTac inbred mice.
RATIONALE: Combining strains to generate mutant mice may obscure conclusions regarding the targeted gene. Specifically, cocaine may have reduced reinforcing effects in 129 substrains compared to the C57BL/6 strain, commonly used for ES cells and breeding, respectively. OBJECTIVES: We tested the hypothesis that reinforcing effects of cocaine differ between the C57BL/6J strain and two substrains of 129, 129X1/SvJ and 129S6/SvEvTac. METHODS: To assess and reduce performance differences, operant responding was established with liquid food as a reinforcer and evaluated under fixed and progressive ratio schedules. Dose-effect functions for intravenous cocaine self-administration were then determined under both schedules. Finally, reinforced and nonreinforced manipulanda were reversed to assess acquisition of self-administration using a previously nonreinforced response. RESULTS: Relative to C57BL/6J mice, 129X1/SvJ mice showed decreased reinforcing effects of low-magnitude food and cocaine reinforcers. Dose-effect functions for cocaine self-administration were comparable between C57BL/6J and 129S6/SvEvTac mice, despite delayed acquisition of operant behaviors and rightward shifts in the food concentration-effect functions in 129S6/SvEvTac mice. A high cocaine dose clearly served as a positive reinforcer in all three strains in a reversal procedure. CONCLUSIONS: Relative to C57BL/6J mice, the reinforcing effects of cocaine were diminished in 129X1/SvJ mice, but only for low cocaine doses, and a similar profile was observed with food reinforcement. 129S6/SvEvTac mice required more extensive operant training than C57BL/6J mice did, but after acquisition, reinforcing effects of cocaine were similar in the two strains. We suggest that comparable phenotypes observed in gene-targeting studies may result from genetic background, whereas more profound or qualitatively different phenotypes may be more confidently attributed to targeted mutations.
Animals↗
The effects of triethyltin and trimethyltin in rats responding under a DRL schedule of reinforcement.
Rats were trained to respond under a schedule of reinforcement in which only those responses separated by a 10-to 14-sec period of no responding produced a feed pellet (DRL 10 to 14 sec). Each rat received a single dose of trimethyltin (TMT) (5.6, 7.5, or 10 mg/kg) or triethyltin (TET) 1, 3, 4.25, or 5.6 mg/kg). The lowest dose of TMT (5.6 mg/kg) and the lowest dose of TET (1 mg/kg) were without significant effect. At 7.5 mg/kg and 10 mg/kg TMT, the percentage of the total responses spaced 10 to 14 sec apart decreased over the first 8 to 12 days after TMT. Those rats receiving 7.5 mg/kg TMT gradually returned to control values over the next 2 to 3 weeks while those rats receiving 10 mg/kg never recovered. Rats receiving 3, 4.25, and 5.6 mg/kg TET showed a decrease in the percentage of reinforced responses immediately after receiving TET. The behavior of those rats receiving 3 mg/kg returned to control values in 24 hr. Following 4.25 mg/kg TET, the health of the rats deteriorated rapidly. They were kept alive through heroic measures, but then were killed after testing on the 12th day following TET due to their failing health. At 5.6 mg/kg, the rats were killed on the 4th day due to failing health. These results indicate that TMT and TET differ with respect to potency and time course. The behavioral deficits produced by TET parallel the time course of general toxicity while the behavioral effects of acute TMT administration can persist in time long after the general appearance of the rats has returned to normal.
Animals↗
Order and chaos in fixed-interval schedules of reinforcement.
Fixed-interval schedule performance is characterized by high levels of variability. Responding is absent at the onset of the interval and gradually increases in frequency until reinforcer delivery. Measures of behavior also vary drastically and unpredictably between successive intervals. Recent advances in the study of nonlinear dynamics have allowed researchers to study irregular and unpredictable behavior in a number of fields. This paper reviews several concepts and techniques from nonlinear dynamics and examines their utility in predicting the behavior of pigeons responding to a fixed-interval schedule of reinforcement. The analysis provided fairly accurate a priori accounts of response rates, accounting for 92.8% of the variance when predicting response rate 1 second in the future and 64% of the variance when predicting response rates for each second over the entire next interreinforcer interval. The nonlinear dynamics account suggests that even the "noisiest" behavior might be the product of purely deterministic mechanisms.
Journal Article↗
Effects of corticotropin releasing factor, desipramine and haloperidol on a DRL schedule of reinforcement.
Rats were trained on a schedule of differential-reinforcement-of-low-rate (DRL) which has been proposed to be differentially sensitive to antidepressant drugs. Desipramine and haloperidol decreased response rate and increased reinforcement rate. CRF decreased response rate and failed to change reinforcement rate. Amphetamine produced the opposite pattern of increased response rate and decreased reinforcement rate. These results question the specificity of the DRL task as a screen for antidepressants and suggest that drugs that moderately lower response rate may produce a behavioral profile on this task similar to that of tricyclic antidepressants.
Amphetamine↗
Contrast, component duration, and the following schedule of reinforcement.
Experiment 1 investigated component duration in a four-component multiple schedule designed to separate the effects of the preceding schedule of reinforcement from those of the following schedule of reinforcement. The preceding schedule in the preceding component had no consistent effect regardless of component duration. The following schedule was a powerful determinant of behavior, however, with higher response rates resulting from a following period of extinction. Moreover, the effect of the following schedule was greater with short component durations, which strongly suggests that component-duration effects previously found with multiple schedules are due generally to variation in the degree of control by the following schedule. Experiments 2--4 investigated the basis of the effects of the following schedule. In some situations differential responding in the following component was the controlling variable, but in others it was differential reinforcement in the following component. The results are consistent with the view that response rate during a stimulus is inversely related to the "value" of the following component, where the calculation of value must include both primary and conditioned reinforcement.
Animals↗
Second-order stimuli do not always increase overall response rates in second-order schedules of reinforcement in the rat.
RATIONALE: Second-order schedules of reinforcement have been used extensively to model reward-seeking and drug-seeking behaviour. Second-order stimuli within second-order schedules have been shown to enhance response rates during operant responding for natural reinforcers and drug reinforcers. This has led some to view second-order schedules of drug reinforcement as a model maintained of drug-seeking in addicts by drug-associated stimuli. However, the functional role of the second-order stimulus within second-order schedules is complex. OBJECTIVE: We investigated the role of second-order stimuli within a second-order schedule of reinforcement [FI 4 min (FR10: S)] maintained by sweetened water reinforcement. METHODS: Eight rats were trained to press a bar on a second-order schedule of reinforcement and tested in the presence and absence of the second-order stimulus. RESULTS: In contrast to most previous work, overall bar-pressing rates were significantly increased when the second-order stimulus was omitted (second-order stimulus omission: 0.17 Hz (+/-0.04, 95% CI); second-order stimulus present: 0.13 Hz (+/-0.04, 95% CI)). However, second-order stimuli also changed the pattern of responding whereby rats would make a bout of bar presses prior to the presentation of the second-order stimulus and then pause briefly after the second-order stimulus. In the absence of second-order stimuli, responding was uniformly high. Control measures, such as the ability of the second-order stimulus to evoke checking for the primary reinforcers, indicated that the second-order stimulus was associated with the primary reinforcer. CONCLUSIONS: These results demonstrated that although second-order stimuli maintained responding and caused the rat to check for primary reinforcement, overall response rates were increased when the second-order stimuli were omitted. This has implications for interpreting the results of studies where overall response rates within second-order schedules have been the only measure used to assess the effects of potential anti-addiction drugs. Future studies could be improved by performing a second-order stimulus omission test analysing both the overall response rates and the temporal organization of responding with respect to the second-order stimulus.
Analysis of Variance↗
Bombesin improves rats' operant responding maintained by a differential-reinforcement-of-low-rates schedule of food reinforcement.
The present study examined rats' responding on a differential-reinforcement-of-low-rates schedule of food reinforcement following intraperitoneal injections of various doses of bombesin (4, 6, 8, 16, 32 micrograms/kg). Analyses indicated that only the 6 micrograms/kg dosage improved DRL responding. The findings are consistent with prior research examining bombesin's effect on operant behavior and support the notion that bombesin induces satiety rather than malaise.
Animals↗