Behavioral interaction under concurrent spaced-responding, variable-interval schedules of reinforcement.
Explore the source record for details and available documents.
SEARCH · PubMed Health
Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Pigeons were trained on a non-spatial delayed alternation task in which the correct stimulus was that color not responded to on the preceding trial. Subjects required to emit either 15 or 30 pecks to the correct stimulus within a trial learned the task, those required to emit only one or five pecks did not. Also, alternation was learned more easily after an incorrect than after a correct trial. Later experiments showed that a minimum fixed-ratio value was required for successful color alternation to occur, even though no fixed-ratio requirement was necessary when a position cue was available. The mechanism of the fixed-ratio effects derived from the pigeons' tendency to repeat their response in the presence of the color reinforced on the last trial. Whereas subjects trained on larger fixed-ratios corrected this error tendency within a trial, subjects trained on smaller fixed ratios did not.
Explore the source record for details and available documents.
Using an operant analogue of the yes-no detection task, six pigeons were trained to detect luminance changes under two different reinforcement-scheduling procedures. In the first, an uncontrolled reinforcement-ratio procedure, the relative frequency of food reinforcers obtained for correct detections was free to vary with the birds' behavior as luminance levels were changed. In the second, a controlled reinforcement-ratio procedure, changes in preference could not alter the relative distribution of food reinforcers between the two response alternatives. Extreme response biases developed as luminance was decreased to threshold in the uncontrolled procedure. No progressive changes in response bias as a function of decreasing luminance were seen in the controlled procedure. Absolute thresholds for light intensity were lower in the controlled than in the uncontrolled procedure.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a schedule component stabilized, an opportunity to drink water was introduced into one schedule component. The value of the variable-time schedules was varied from 60 to 90 to 270 sec. The relative amount of time spent in the schedule component associated with drinking water was a decreasing function of food frequency for two animals and remained constant for the third. Drinking rates were direct functions of food frequency, and the amount of water drunk per pellet was an inverse function of food frequency. The reinforcement value of drinking water, according to the Matching Law, was a direct function of the frequency of food presentation. It was concluded that food reinforcement schedules indirectly influence rates of drinking by altering the reinforcement value of drinking water and that certain properties of schedule-induced drinking can be accounted for in terms of the reinforcement value of drinking water, the rate of drinking, and the frequency of food presentation.
Behavior-reduction interventions typically employ dense schedules of alternative reinforcement in conjunction with operant extinction for problem behavior. After problem behavior is reduced in the initial treatment stages, schedule thinning is routinely conducted to make the intervention more practical in natural environments. In the current investigation, two methods for thinning alternative reinforcement schedules were compared for 3 clients who exhibited severe problem behavior. In the dense-to-lean (DTL) condition, reinforcement was delivered on relatively dense schedules (using noncontingent reinforcement for 1 participant and functional communication training for 2 participants), followed by systematic schedule thinning to progressively leaner schedules. During the fixed lean (FL) condition, reinforcement was delivered on lean schedules (equivalent to the terminal schedule of the DTL condition). The FL condition produced a quicker attainment of individual treatment goals for 2 of the 3 participants. The results are discussed in terms of the potential utility of using relatively lean schedules at treatment outset.
Eight pigeons were exposed to independent concurrent schedules. Concurrent variable-interval 60-second variable-interval 60-second schedules were presented to one group of four subjects. Following baseline training, a limited hold was added to one of the schedules and the duration of the hold was decreased in successive conditions. Concurrent variable-interval 120-second variable-interval 40-second schedules were presented to another group of four subjects. These subjects were first exposed to decreasing durations of a limited hold in the variable-interval 40-second component. After replication of the baseline, a limited hold in the variable-interval 120-second component was decreased in duration. The initial durations of the holds were determined from the subjects' responding in the baseline conditions. A duration was chosen such that approximately 25% of the scheduled reinforcers would be canceled if responding remained unchanged.Approximate matching of time proportions and reinforcement proportions was observed when the limited hold was added to the variable-interval 60-second schedule and when the limited hold was added to the variable-interval 40-second schedule. Time proportions were less extreme than reinforcement proportions when the limited hold operated in a variable-interval 120-second schedule. Overall reinforcement rates tended to decrease with continued training in concurrent schedules with a limited hold. Absolute deviations from time matching also decreased. The results provide evidence against the principle of reinforcement maximization, and support Herrnstein and Vaughan's (1980) melioration hypothesis.
BACKGROUND: Operant experiments which indicate that ethanol can serve as a reinforcer to maintain lever responding during limited periods of access have not been conducted on non-food-deprived mice, as they have for rats and monkeys. Furthermore, there are no reports of the effects of chronic ethanol and subsequent abstinence on ethanol reward in mice. Finally, although naltrexone reduces responding for ethanol in food-deprived mice, the effects of the drug on ethanol reward for non-food-deprived mice have not been reported. METHODS: In three experiments, lever responding for ethanol (10-12%) was established in C57BL/6 (B6) mice by using either sucrose or saccharin fading procedures commonly used for rats. Experiment 1 examined both appetitive and consummatory responses while sucrose was faded from the ethanol solutions. Experiment 2 examined lever responding and ethanol intake (1) during saccharin fading; (2) when reinforcement schedules, reward availability, and primary conditioned reinforcers were manipulated; and (3) when mice were allowed chronic ethanol consumption followed by forced abstinence. Experiment 3 examined the effects of low doses of naltrexone on ethanol reward. RESULTS: Lever responding for ethanol can be established in non-food-deprived mice with the sucrose and saccharin fading procedures commonly used for rats. Lever responses increased with decreases in the reinforcer and increases in schedule demand, which indicated the reward value of the ethanol solution. Removal of ethanol from the solution reduced consumption with no change in the appetitive, instrumental response, which indicated that the two responses were under control of different stimuli, perhaps mediated by different neural mechanisms. Forced abstinence after chronic ethanol exposure increased responding for the drug, which suggested increased reward value. Naltrexone reduced responding as previously reported for food-deprived B6 mice. CONCLUSIONS: Ethanol appears to serve as a reinforcer for non-food-deprived or non-water-deprived B6 mice. Its reinforcing effects are increased by forced abstinence after chronic exposure and are decreased by naltrexone.
The influence of behavior that immediately precedes a reinforced target response on the effectiveness of a reinforcement contingency was examined in two experiments with mentally retarded children in a special-education classroom. Two reinforcement schedules were examined in each experiment. For each schedule, a prespecified period of attentive behavior served as the target response. The schedules differed in whether inattentive or attentive behavior was required immediately to precede the target response. These schedules were examined with one child in a simultaneous treatment design using praise as the reinforcer (Experiment I), and with two children in separate reversal designs using tokens as the reinforcer (Experiment II). While attentive behavior increased under each schedule, the increase was greater when attentive rather than inattentive behavior preceded the reinforced response. The results indicated that the effect of a contingency may be determined not only by the specific response reinforced but also by the behavior that immediately precedes that response.
The effect of NPY on behavior and food intake of food-satiated rats was examined under three different food availability conditions. Food was available during times when rats normally do not eat under either a fixed-ratio or fixed-interval reinforcement schedule, or it was freely available in the bottom of the cage (FF). Forty responses were required for each 45-mg food pellet under the ratio schedule (FR 40) and for the first response to occur 15 s after the previous reinforcement under the interval schedule (FI 15"). NPY (5 micrograms) significantly increased food intake under all conditions and increased food-reinforced responses under the FR and FI schedules. NPY's effect on food intake was greatest when food was freely available and least for rats working under the schedule requiring the most effort (FR 40). Food intake peaked after 3 days under repeated daily administration of NPY. Under free food access and under the fixed-interval schedule, eating and/or responding occurred almost immediately following the onset of the initial 4-h session under NPY. However, during the first session following NPY administration under the FR, rats emitted few responses during the first 2 h of the session. The onset of robust responding under the FR schedule began earlier with each successive daily administration of NPY. These data show NPY substantially increases food-maintained behavior and is a potent inducer of food intake even under conditions where considerable effort is required to obtain food. Further, the conditions under which food is made available can dramatically alter NPY's effect on the temporal pattern of food-maintained responding, feeding, and latency to eat.
Three male Mongolian gerbils displayed schedule-induced polydipsia on a fixed-time 3-min food reinforcement schedule at 85% body weight (BW). When the gerbils' body weights were gradually increased to ad lib levels, the polydipsia disappeared. When the gerbils were subsequently reduced to 85% BW again, the previous polydipsia levels of water intake were recaptured. These data replicate previous findings with rats, and suggest that schedule-induced polydipsia may be as robust in gerbils and other species, as it is with rats, once the optimal generating conditions are established.