SEARCH · PubMed Health

Results for “Reinforcement Schedule”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20Linked to original sources

PubMed1971

Concurrent schedules of reinforcement: effects of gradual and abrupt increases in changeover delay.

Pigeons' pecks were maintained on concurrent variable-interval 1-min variable-interval 3-min schedules of reinforcement, with a changeover delay of 2 sec. When changeover delay was increased successively to 5.0, 7.5, and 12.5 sec (Exp. I) the actual relative rate of reinforcement for the variable-interval 3-min key decreased progressively for two birds, abruptly for two other birds, and the subjects devoted proportionately less of their time and responding to that key. However, the relative performance measures (relative time and relative responding) approximated the actual relative rate of reinforcement, with a maximum discrepancy of 11%, over all changeover delay values investigated. Experiment II attempted to lengthen response-run durations on the variable-interval 3-min key so that they were long enough to meet the changeover delay requirement at each new changeover delay value, by progressively increasing the changeover delay by 0.5-sec increments. With this procedure the actual relative rate of reinforcement approximated more closely the scheduled relative rate as changeover delay increased. As in Exp. I, relative performance measures approximated the actual relative reinforcement rate (maximum discrepancy 17%).

Journal Article↗

PubMed1977

Behavioral and hippocampal electrical changes during operant learning in cats and effects of stimulating two hypothalamic--hippocampal systems.

The electrical activity of the dorsal and ventral hippocampus and of the anterior and posterior neocortex is described and illustrated during the development of trained operant behavior in water-deprived cats learning to bar-press for water reward under three operant conditioning schedules: (a) continuous reinforcement; (b) alternating 10 sec periods of reinforcement and non-reinforcement; and (c) mixed reinforcement and non-reinforcement with special auditory and visual cues. In addition, the contrasting effects of 100 c/sec electrical stimulation of the medial and lateral hypothalamic systems upon hippocampal electrical activity and operantly trained behavior are reported. During the early stages of learning to bar-press for water reward, when close attention to the bar and water-well are required, hippocampal electrical activity manifests synchrony (theta rhythm) and neocortical electrical activity is desynchronized. Subsequently, as bar-pressing performance improves and requires little attention to the manipulanda, the pattern of hippocampal and neocortical electrical activity is one of irregular slow waves mixed with low voltage high frequency activity, characteristic of relative inattention and automatic performance. During alternating or mixed reinforcement and non-reinforcement schedules of operant training differential effects are observed during reinforcement and non-reinforcement periods, the latter being characterized generally by lower voltage, mixed low and high frequency activity, except when orienting and shifting of attention occurred with associated theta rhythm bursts. Stimulation of the medial hypothalamic system has a striking inhibitory effect upon bar-pressing for water reward. Bar-pressing ceases for many minutes but its eventually resumed at the pre-stimulation rate. In contrast, stimulation of the lateral hypothalamic system only interrupts bar-pressing for a matter of seconds. Possible causes of these differential effects, and especially the prolonged inhibition of bar-pressing induced by medial hypothalamic stimulation, are discussed.

Animals↗

PubMed1985

Spatiotemporal patterns of behavior produced by variable-interval schedules of reinforcement.

The spatiotemporal patterns of behavior exhibited by two pigeons during a variable-interval 15-second schedule of food reinforcement, a variable-interval 5-minute schedule, and then extinction of key pecking were recorded using an apparatus that continuously tracked the position of the bird in the experimental chamber. The variable-interval 15-second schedule produced a close-to-key pattern between reinforcements with two types of regular excursions from the region of the key frequently occurring after reinforcement. Subsequent exposure to the variable-interval 5-minute schedule produced more extended and extremely regular patterns between responses. Reinstatement of the variable-interval 15-second schedule reestablished the close-to-key pattern with regular excursions frequently occurring after reinforcement. During extinction the spatiotemporal patterns that had developed during the variable-interval 5-minute schedule reappeared and gradually dissipated. These patterns may have been a form of superstitious behavior.

Journal Article↗

PubMed1985

The effect of d-amphetamine on operant behaviour maintained under variable-interval schedules of reinforcement.

Dose-response curves were obtained for the effects of d-amphetamine sulphate (0.1-3.2 mg/kg) on the operant performance of rats in variable-interval 4-min and variable-interval 20-min schedules of reinforcement. Response rates maintained under variable-interval 4-min were suppressed in a dose-dependent manner. Response rates maintained under variable-interval 20-min schedules tended to be elevated by low doses and suppressed by higher doses. The degree of response rate suppression was greater in the case of the variable-interval 4-min schedule. The results are consistent with the previously reported effect of d-amphetamine on the values of the two constants of Herrnstein's (1970) equation: the drug reduces the reinforcement frequency needed to maintain the half-maximum response rates (KH) and lowers the maximum response rate (Rmax) (Bradshaw et al. 1981 b). It is suggested that the effects of d-amphetamine on operant performance may involve two processes: an enhancement of motivation and a reduction of the capacity to respond.

Animals↗

PubMed1975

Behavioral contrast in the pigeon: a study of the duration of key pecking maintained on multiple schedules of reinforcement.

Pecks on an operant key were reinforced on either multiple variable-interval variable-interval or multiple variable-interval extinction schedules of reinforcement. The stimuli that signalled the multiple-schedule components were located on a second key (signal key), and a changeover delay prevented reinforcement of signal key-peck-operant key-peck sequences. No behavioral contrast was observed on the operant key, and appreciable responding to the signal key occurred during the variable-interval component of the multiple variable-interval extinction procedure. Peck durations on the signal key were markedly shorter than peck durations on the operant key. Moreover, most responses on the signal key occurred just after the multiple-schedule components changed. These data support an account of behavioral contrast in terms of the summation of pecks that are separately controlled by stimulus-reinforcer and response-reinforcer dependencies, and suggest that the stimulus-reinforcer dependency is responsible primarily for local contrast. In addition, the data suggest that pecks that are controlled by these two dependencies may belong to topographically different classes.

Journal Article↗

PubMed1990

Income maximizing on concurrent ratio-interval schedules of reinforcement.

Three experiments examined the effect of food availability on pigeons' choice behavior under concurrent schedules of reinforcement. In Experiment 1, 3 pigeons earned their daily food ration by choosing, in 30-min sessions, between concurrent variable-ratio 30 variable-interval 40-s schedules. Food presentations during both schedules lasted 2 or 12 s, depending upon the condition. Relative variable-ratio response rate was inversely related to hopper duration. In Experiment 2, 4 pigeons received their daily feeding by responding on the same schedule pair as in Experiment 1 (with 4-s food presentations) in sessions that varied in length from 10 to 30 min, depending on the condition. The length of a vertical slit projected on a response key increased with time so that "passage of time" might be more easily discriminable. As session duration decreased, relative variable-ratio response rate increased. In Experiment 3, 4 pigeons chose between two variable-interval 40-s schedules. One schedule operated without regard to the schedule selected, whereas the other operated only when the subject responded in its presence (dependent). Although these schedules had the same feedback function, preference for the dependent variable interval increased as session duration decreased from 30 to 10 min. The preference changes in these studies reveal the operation of an income-maximizing process in choice.

Journal Article↗

PubMed1986

Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement.

A concurrent-chain procedure was used to examine choice between segmented and less segmented response-independent schedules of reinforcement. A pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link, along with a 1.5-s changeover delay. A chained fixed-interval fixed-time and its corresponding tandem schedule constituted the terminal links. The length of the fixed-interval schedule in the terminal link was varied between 5 s and 30 s while that of the fixed-time schedule was kept at 5 s over conditions. The first components of both terminal-link schedules were accompanied by the same stimulus. Except in the baseline condition, the onset of the second component of the terminal-link chained schedule was accompanied by either a localized (key color) or a nonlocalized (dark houselight) stimulus change. Stimulus conditions were constant during the terminal-link tandem schedule. With three exceptions, pigeons demonstrated a slight preference for the tandem over the chained schedule in the terminal link. Furthermore, this preference varied inversely with the length of the first component. In general, these results are consistent with previous studies that reported an adverse effect on choice by segmenting an interval schedule into two or more components, but they are inconsistent with studies that reported preference for signaled over unsignaled delay of reinforcement.

Journal Article↗

PubMed1978

Contrast and autoshaping in multiple schedules varying reinforcer rate and duration.

Thirteen master pigeons were exposed to multiple schedules in which reinforcement frequency (Experiment I) or duration (Experiment II) was varied. In Phases 1 and 3 of Experiment I, the values of the first and second components' random-interval schedules were 33 and 99 seconds, respectively. In Phase 2, these values were 99 seconds for both components. In Experiment II, a random-interval 33-second schedule was associated with each component. During Phases 1 and 3, the first and second components had hopper durations of 7.5 and 2.5 seconds respectively. During Phase 2, both components' hopper durations were 2.5 seconds. In each experiment, positive contrast obtained for about half the master subjects. The rest showed a rate increase in both components (positive induction). Each master subject's key colors and reinforcers were synchronously presented on a response-independent basis to a yoked control. Richer component key-pecking occurred during each experiment's Phases 1 and 3 among half these subjects. However, none responded during the contrast condition (unchanged component of each experiment's Phase 2). From this it is inferred that autoshaping did not contribute to the contrast and induction findings among master birds. Little evidence of local contrast (highest rate at beginning of richer component) was found in any subject. These data show that (a) contrast can occur independently from autoshaping, (b) contrast assays during equal-valued components may produce induction, (c) local contrast in multiple schedules often does not occur, and (d) differential hopper durations can produce autoshaping and contrast.

Journal Article↗

PubMed1980

Alternative fixed-ratio fixed-interval schedules of reinforcement.

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.

Journal Article↗

PubMed1976

Response suppression on a mixed schedule of reinforcement during alcohol withdrawal.

Two groups of rats were maintained on a mixed fixed-ratio, fixed-interval schedule of food reinforcement until performance was stable. The animals were intubated daily with ascending doses of alcohol or water 30 min before each session, starting with 4.0 g/kg and increasing to the final dose of 8.0 g/kg. The results show that withdrawal from alcohol suppresses responding in all components of a mixed schedule and this suppression lasts approximately 14 hours. These results support previous reports which suggest that the duration of the behavioral aberrations produced by alcohol withdrawal are most severe 6 to 14 hours post-withdrawal.

Animals↗

PubMed1969

Behavioral contrast in chained schedules.

In each of two experiments, the rate of key pecking maintained by a variable-interval food reinforcement schedule was measured, first when that schedule was studied in isolation, and then when it was correlated with the second component of a two-component chained schedule. In the first experiment, the first component of the chained schedule was correlated with a fixed-interval schedule; in the second experiment it was correlated with a variable-interval schedule. In both experiments, behavioral contrast was demonstrated in the second component of the chained schedule. Compared to the rate of responding on the food-reinforcement schedule when it had operated in isolation, the rate of responding on the food-reinforcement schedule when it was correlated with the second component was higher, while the rate on the schedule of the first component was lower. The results are discussed with reference to the determinants of contrast.

Journal Article↗

PubMed1994

Effects of dopamine D-1 and D-2 antagonists on cocaine self-administration under different schedules of reinforcement in the rat.

The effects of three dopamine D-1 receptor antagonists (SCH23390, SCH39166 and A69024) and three dopamine D-2 antagonists (raclopride, eticlopride and spiperone) on cocaine self-administration maintained under different schedules of reinforcement were examined in the rat. Intravenous cocaine self-administration was maintained under a fixed-ratio (FR) 5 schedule with a 20-sec timeout (TO) after each reinforcement or a FR 15 with a 2-min TO multiple schedule of cocaine (0.25 mg i.v.) and food (45 mg) reinforcement. With the exception of raclopride, all of the antagonists altered the self-administration of cocaine in a manner similar to decreasing the unit dose of cocaine under the schedule in effect, reflected by increased self-administration under the FR 5 TO 20-sec schedule and decreased self-administration under the FR 15 TO 2-min multiple schedule. Moreover, a low dose of either of the benzazepine dopamine D-1 antagonists SCH23390 or SCH39166, but not the other compounds, selectively reduced cocaine self-administration without altering responding for food under the multiple schedule. Conversely, a low dose of raclopride or A69024 selectively decreased food-reinforced responding without altering cocaine self-administration under the multiple schedule. These results suggest that benzazepine dopamine D-1 antagonists, at low doses, may attenuate the reinforcing properties of cocaine more selectively than other dopamine receptor antagonists. The results also demonstrate the advantages of using different schedules to investigate the effects of dopamine D-1 and D-2 antagonists on cocaine self-administration.

Animals↗

PubMed1988

Preference for simple interval schedules of reinforcement in concurrent chains: Effects of segmentation ratio.

A concurrent-chains procedure was used to examine pigeons' preferences between segmented and unsegmented terminal-link schedules of reinforcement. During the initial link, a pair of independent, concurrent variable-interval 60-s schedules was in effect. In the terminal link, reinforcement was provided by a chain fixed-interval fixed-interval schedule on one key and by a simple fixed-interval schedule with an equal interreinforcement interval in the other. The relative duration between the first and second components (segmentation ratio) in the terminal-link chained schedule was systematically varied while the terminal-link duration was kept constant at either 15 s or 30 s in two sets of conditions. With few exceptions, the simple schedule was preferred to the chained schedule. Furthermore, this preference was inversely related to the size of the segmentation ratio in the segmented schedule. When the segmentation ratio was smaller than 1:1, preference was more extreme for a 30-s condition than for a 15-s condition. However, preference decreased more rapidly in conditions with the longer terminal-link duration when the ratio increased. Taken together, these results were consistent with previous findings concerning the effect of the terminal-link duration on choice between segmented and unsegmented schedules. In addition, the data suggested that segmentation ratio in a segmented schedule constitutes another potent factor influencing preference for the unsegmented schedule.

Journal Article↗

PubMed2005

Neuropsychopharmacology of drug seeking: Insights from studies with second-order schedules of drug reinforcement.

Second-order schedules of reinforcement model complex chains of responding for rewards such as food or drugs. Derived from studies of conditioned reinforcement, an important feature of these schedules is that responding is maintained by the response-dependent presentation of conditioned stimuli. They are thus well-suited to the study of the influences over drug seeking exerted by drug-associated stimuli. In the present review, we summarise studies investigating the neurobiology and neuropsychopharmacology of responding for cocaine under a second-order schedule of reinforcement. We conclude that limbic-striatal circuitries underlie drug seeking measured in this way. Emphasis is placed on potential interactions between structures within these subsystems by reviewing neuropsychopharmacological studies in which antagonists selective for either glutamate or dopamine receptors have been infused directly into limbic, cortical and striatal areas.

Amygdala↗

PubMed1993

Psychological distance to reward: Segmentation of aperiodic schedules of reinforcement.

College students responded for monetary rewards in two experiments on choice between differentially segmented aperiodic schedules of reinforcement. On a microcomputer, the concurrent chains were simulated as an air-defense video game in which subjects used two radars for detecting and destroying enemy aircraft. To earn more cash-exchangeable points, subjects had to shoot down as many planes as possible within a given period of time. For both experiments, access to one of two radar systems (terminal link) was controlled by a pair of independent concurrent variable-interval 60-s schedules (initial link) with a 4-s changeover delay always in effect. In Experiment 1, the appearance of an enemy aircraft in the terminal link was determined by a variable-interval (15 s or 60 s) schedule or a two-component chained variable-interval schedule of equal duration. Experiment 2 was similar to Experiment 1 except for the segmented schedule, which had three components. Subjects preferred the unsegmented schedule over its segmented counterpart in the conditions with variable-interval 60 s, and preference tended to be more pronounced with more components in the segmented schedule. These findings are compatible with those from previous studies of periodic and aperiodic schedules with pigeons or humans as subjects.

Journal Article↗

PubMed1990

Exposure duration modifies the effects of low level lead of fixed-interval performance.

Short exposures to low Pb concentrations (e.g., 25-50 ppm) have been shown to increase Fixed-Interval (FI) response rates while comparable exposures to higher concentrations (100-1000 ppm) typically decrease response rates. This study was based on the hypothesis that Pb body burden, in addition to Pb exposure concentration, is an important determinant of the nature of Pb-induced changes in Fixed-Interval (FI) response rates. One way to increase Pb body burden is to prolong exposure duration. Thus, by the above hypothesis, prolonging the exposure duration to low Pb concentrations could result in FI response rate decreases previously noted in response to higher concentrations of Pb. To test this contention, rats were exposed to 50 ppm Pb acetate in drinking water for 8 or 11 mon prior to assessment of performance on an FI 1 min schedule of food reinforcement. In contrast to the increased rates of responding previously reported after 1 mon of 50 ppm exposure, the 8-11 mon exposures produced decreased FI response rates relative to control values over 30-40 sessions. The decreased response rates were a function of longer interresponse times and consequently lower running rates; postreinforcement pause times and index of curvature were normal. Differential trends in response rates between control and 8 mon Pb-exposed rats reappeared when reinforcement schedule contingencies were changed from FI-1 min to FI-5 min and, again, when changed from FI-5 min to an FI-5 min clock schedule; no such differences were apparent when the original schedule parameter, FI-1 min, was then reimposed. Adult animals trained on FI schedules and then exposed to 50 or 500 ppm Pb for 3-5 mon showed no consistent subsequent performance changes. Taken together, these studies suggest a Pb-induced delay in the acquistion phase of FI-schedule controlled responding, while learned performance appears less vulnerable. However, a seemingly transient deficit may nonetheless reemerge when the environment imposes a new learning situation or an alteration in reinforcement contingencies. Such effects have important implications for human Pb exposure since behavioral transitions may be mandated throughout life.

Animals↗

PubMed1977

Polydipsia induced in rats by second-order schedules of reinforcement.

Three rats were exposed to a second-order schedule in which fixed-interval components ended either with food or with a brief stimulus that was never paired with food. Food and the brief stimulus occurred in a random sequence (variable-ratio 2 overall schedule). Another three rats were exposed to a similar second-order schedule, the only difference being that the food or the stimulus was presented independently of operant behavior (fixed-time components). The three rats exposed to the fixed-interval components licked at a water spout after each food presentation. These rats also licked in the intervals after the brief stimulus. Although the discriminative properties of food and of the brief stimulus were identical in relation to subsequent reinforcement, licking after the stimulus was less than after food. The three rats exposed to the second-order schedules with fixed-time components also licked at the water spout after food, but these rats did not lick consistently after brief stimulus presentations.

Acoustic Stimulation↗

PubMed1997

Cytotoxic lesions of the retrohippocampal region attenuate latent inhibition but spare the partial reinforcement extinction effect.

Experiment I assessed the effect of cytotoxic retrohippocampal (entorhinal and extra-subicular cortices) lesions on the development of latent inhibition (LI) using an off-the-baseline, between-subjects, conditioned emotional response paradigm. Sham-operated controls and unoperated rats that had been pre-exposed to a light stimulus prior to light-shock pairings showed less conditioned suppression towards the light stimulus than the nonpre-exposed animals, thus demonstrating LI. However, LI was not evident in rats with retrohippocampal lesions. In experiment 2, the same animals were trained to run in an straight runway for food. Half of the animals were trained under a 50% partial reinforcement schedule (i.e. they were rewarded randomly on half of the acquisition trials) and the other half were trained under a continuous reinforcement schedule (i.e. they were rewarded on every acquisition trial). When tested in extinction, animals trained on the partial reinforcement schedule showed greater persistence than animals trained on continuous reinforcement, thus demonstrating the partial reinforcement extinction effect (PREE). Rats with retrohippocampal lesions showed a PREE that was at least as clear as that seen in the sham-operated controls and in the unoperated animals. It is concluded that cytotoxic lesions of the retrohippocampal region selectively led to an abolition of LI, but spared the PREE. The present study thus provided evidence against the hypothesis that LI and the PREE share a common neural substrate.

Analysis of Variance↗