Studies in secondary reinforcement. II. Secondary reinforcement as a function of the strength of drive during primary reinforcement.
Explore the source record for details and available documents.
SEARCH · PubMed Health
Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Two retarded boys exhibited abnormally low rates of smiling. In Exp. I, the frequency of a boy's smiling was first increased with candy reinforcement, but the frequency of the response did not decrease when candy reinforcement was terminated. When the subject wore a sign designed to make social interactions contingent on not-smiling, the frequency of smiling decreased. The sign was then changed to make social interactions contingent on smiling and the rate of smiling increased. In Exp. II, a second boy initially never smiled. Establishment of a contingency for candy reinforcement did not increase this zero response rate. Instructing the child to smile initially increased smiling, but the instructions then became progressively more ineffective. Candy reinforcement increased the rate of smiling to a normal range, but the rate of the response promptly decreased when this reinforcement was discontinued. Continuous candy reinforcement was again employed to increase the response rate and then progressively leaner schedules of variable-ratio candy reinforcement were employed. Consequently, the rate of smiling did not decrease when candy reinforcement was again eliminated. Subsequently, signs were employed to regulate social interactions and the rate of smiling was shown to be controlled by these interactions serving as reinforcers.
Three experiments involving parametric manipulation of reinforcement contingencies were performed with retardates in an automated Sheltered Workshop token economy. Experiment I showed that with amount of reinforcement held constant, work rates were positively related to reinforcement rates on fixed-interval schedules and inversely related to reinforcement rates on fixed-ratio schedules. Experiment II demonstrated an interaction between frequency of ratio reinforcement and torque required to complete a work unit: work rates were positively related to reinforcement rates when required response force was high and negatively related to reinforcement rates when required response force was low. Experiment III revealed that, with reinforcement frequency held constant, there was in inverse relationship between amount of reinforcement and work rate.
Pigeons were exposed to four different schedules of food reinforcement that arranged a fixed minimum time interval between reinforcements (60 sec or 300 sec). The first was a standard fixed-interval schedule. The second was a schedule in which food was presented automatically at the end of the fixed time interval as long as a response had occurred earlier. The third and fourth schedules were identical to the first two except that the first response after reinforcement changed the color on the key. When the schedule required a peck after the interval elapsed, the response pattern consisted of a pause after reinforcement followed by responding at a high rate until reinforcement. When a response was not required after the termination of the interval, the pattern consisted of a pause after reinforcement, followed by responses and then by a subsequent pause until reinforcement. Having the first response after reinforcement change the color on the key had little effect on performance. Post-reinforcement pause duration varied with the minimum interreinforcement interval but was unaffected by whether or not a response was required after the interval elapsed.
At several fixed and variable minimum reinforced interresponse times, a stimulus was added to differential-reinforcement-of-low-rate schedules to signal the availability or nonavailability of reinforcement. As the minimum reinforced interresponse time increased, the rate of unreinforced responding decreased. Changing from fixed to variable minimum interresponse time in the basic differential-reinforcement-of-low-rate schedule further decreased the rate of unreinforced responding. Both effects were to some degree reversible. For fixed minimum reinforced interresponse times of 30 sec or shorter, most unreinforced responses terminated interresponse times just short of that required for reinforcement. The minimum reinforced interresponse time and the number of short response latencies (</=0.5 sec) to the onset of the signal were negatively correlated. Both of these analyses suggested that at values of 30 sec or shorter, the subjects discriminated the availability of the reinforcer more on the basis of time than on the basis of presence or absence of the signal.
Three rats were exposed to variable-interval schedules specifying a range of different reinforcement frequencies, using three different volumes of .32 molar sucrose (.10, .05, and .02 milliliters) as the reinforcer. With each of the three volumes, the rates of responding of all three rats were increasing, negatively accelerated functions of reinforcement frequency, the data conforming closely to Herrnstein's equation. In each rat the value of the constant K(H), which expresses the reinforcement frequency needed to obtain the half-maximal response rate, increased with decreasing reinforcer volume, the values obtained with .02 milliliters being significantly greater than the values obtained with .10 milliliters. The values of the constant R(max), which expresses the theoretical maximum response rate, were not systematically related to reinforcer volume. The effect of reinforcer volume upon the relationship between response rate and reinforcement frequency is thus different from the effect of the concentration of sucrose reinforcement: In a previous experiment (Bradshaw, Szabadi, & Bevan, 1978) it was found that sucrose concentration influenced the values of both constants, R(max) increasing and K(H) decreasing with increasing sucrose concentration.
Two experiments examined human subjects' sensitivity to variation in reinforcer amount under different methods of reinforcer delivery. Subjects chose between schedules varying in terms of amount and/or delay of reinforcement, the reinforcer being points exchangeable for money. In Experiment 1, reinforcer amount was manipulated by varying the monetary value of the points across conditions while the number of seconds of access to a consummatory response remained constant. Choice was strongly sensitive to reinforcer amount and indicative of self-control, as in previous experiments. In Experiment 2, reinforcer amount was manipulated by automatically delivering different numbers of points during the amount period, and the consummatory response was eliminated. Sensitivity to variation in reinforcer amount was significantly lower than in Experiment 1. Furthermore, the subjects in Experiment 2 exhibited significantly less self-control than did the subjects in Experiment 1. Humans' sensitivity to variation in reinforcer amount appears to be affected by factors that enhance the discrimi-nability of the consequences of responding.
In a discrete-trials procedure with pigeons, a response on a green key led to a 4-s delay (during which green houselights were lit) and then a reinforcer might or might not be delivered. A response on a red key led to a delay of adjustable duration (during which red houselights were lit) and then a certain reinforcer. The delay was adjusted so as to estimate an indifference point--a duration for which the two alternatives were equally preferred. Once the green key was chosen, a subject had to continue to respond on the green key until a reinforcer was delivered. Each response on the green key, plus the 4-s delay that followed every response, was called one "link" of the green-key schedule. Subjects showed much greater preference for the green key when the number of links before reinforcement was variable (averaging four) than when it was fixed (always exactly four). These findings are consistent with the view that probabilistic reinforcers are analogous to reinforcers delivered after variable delays. When successive links were separated by 4-s or 8-s "interlink intervals" with white houselights, preference for the probabilistic alternative decreased somewhat for 2 subjects but was unaffected for the other 2 subjects. When the interlink intervals had the same green houselights that were present during the 4-s delays, preference for the green key decreased substantially for all subjects. These results provided mixed support for the view that preference for a probabilistic reinforcer is inversely related to the duration of conditioned reinforcers that precede the delivery of food.
RATIONALE: Nicotine infusions that are self-administered (contingent) or response-independent (noncontingent) increase lever pressing for a reinforcing nonpharmacological stimulus in rats, suggesting that in addition to primary reinforcement, nicotine self-administration may result from nicotine enhancing the reinforcement derived from nonnicotine stimuli. OBJECTIVES: Based on our previous research, in this study, we tested the hypothesis that contingent and noncontingent nicotine would equally elevate responding for a moderately reinforcing visual stimulus, across a range of nicotine doses on both fixed ratio and progressive ratio reinforcement schedules. MATERIALS AND METHODS: The rats lever pressed for a visual stimulus with contingent nicotine, noncontingent nicotine, or contingent saline. Separate groups responded for saline or nicotine without the visual stimulus. Three doses of nicotine (0.01, 0.03, and 0.09 mg/kg per infusion, free base) were tested in a between-groups design. After responding on an escalating fixed ratio reinforcement schedule, the rats were tested on a progressive ratio schedule. RESULTS: Compared to responding for the visual stimulus with saline, both contingent and noncontingent nicotine equally elevated lever pressing for the stimulus at each dose on fixed and progressive ratio schedules. In the absence of the stimulus, only the highest nicotine dose sustained self-administration. CONCLUSIONS: The ability of noncontingent nicotine to elevate responding for a moderately reinforcing visual stimulus occurs across a range of doses, and both self-administered and noncontingent nicotine equally increase motivation to obtain the stimulus, as reflected by performance on a progressive ratio schedule. In the absence of a contingent stimulus, primary reinforcement from nicotine only supports self-administration at high nicotine doses in rats.
Four months after learning breast self-examination (BSE), 169 sorority women assigned to one of three conditions (No Reinforcement, Self-Reinforcement or Peer-Reinforcement) were compared on BSE frequency subsequent to the training. Participants in both of the reinforcement conditions had agreed to a specified reward after each month's BSE, which was either self-delivered (Self-Reinforcement condition) or delivered by a partner (Peer-Reinforcement condition). Analysis of covariance revealed a significant difference among conditions and a Newman-Keuls test demonstrated that participants in both reinforcement conditions reported more months of BSE than those in the No Reinforcement condition. Furthermore, anxiety during BSE training was negatively correlated with BSE during the follow-up period. These results suggest that BSE, like other behaviors, is influenced by perceived support or rewards and by anxiety, and that BSE intervention programs should be designed with these findings in mind.
We examined the effects of conditioned reinforcement on children's choice between reliable (100%) and unreliable (50%) reinforcement under various stimulus conditions in a concurrent-chains procedure. The study was conducted across three experiments. Experiments 1 and 2 were conducted under conditions similar to basic laboratory work and consisted of participants selecting from one of two black boxes (placed on a table) that were correlated with different reinforcement schedules. In Experiment 3, we assessed a participant's preference for unreliable reinforcement during conditions in which the target responses were aggression and mands. Results of the three experiments showed that the participants preferred unreliable reinforcement under certain conditions. Findings are discussed regarding the role of specific stimuli (i.e., items correlated with a reinforcement schedule, adult reactions) as conditioned reinforcers and how they may influence children's preference for a response (e.g., aggression, self-injury) that produces reinforcement on a leaner schedule than a socially desirable response (e.g., mands).
Reinforcement contingencies and social reinforcement are ubiquitous phenomena in applied behavior analysis. This discussion paper is divided into two sections. In the first section, reinforcement contingencies are discussed in terms of the necessary and sufficient conditions for reinforcement effects. Response-stimulus dependencies, conditional probabilities, and contiguity are discussed as possible mechanisms of, and arrangements for, reinforcement effects. In the second section, social reinforcement is discussed in terms of its functional subtypes and reinforcement context effects. Two underlying themes run throughout the discussion: (a) Applied research would benefit from a greater understanding of existing basic research, and (b) basic research could be designed to specifically address some of the issues about reinforcement that are central to effective application.
Basic researchers, but not most applied researchers, have assumed that the behavior-decelerating effects of noncontingent reinforcement result at least partly from adventitious reinforcement of competing behaviors. The literature contains only sketchy evidence of these effects because few noncontingent reinforcement studies measure alternative behaviors. A laboratory model is presented in which concurrent schedules of contingent reinforcement were used to establish a "target" and an "alternative" behavior. Imposing noncontingent reinforcement decreased target behavior rates and increased alternative behavior rates, outcomes that were well described by the standard quantitative account of alternative reinforcement, the generalized matching law. These results suggest that adventitious reinforcement of alternative behaviors can occur during noncontingent reinforcement interventions, although the range of conditions under which this occurs remains to be determined in future studies. As an adjunct to applied studies, laboratory models permit easy measurement of alternative behaviors and parametric manipulations needed to answer many research questions.
Differential reinforcement of other behavior (DRO) and noncontingent reinforcement were compared as control procedures during the modification of a 3-yr-old preschooler's compliance. The recorded reinforcer was teacher proximity (within 3 ft (0.9) of the subject for at least 5 sec) which was often accompanied by positive verbal comments that varied in content across experimental conditions. The verabal content during contingent reinforcement might have been: "Thank you for picking up the blocks"; during non-contingent reinforcement: "You're wearing a pretty dress"; and during DRO: "I don't blame you for not picking up because it isn't any fun". Contingent reinforcement increased compliance in all manipulation conditions. Noncontingent reinforcement decreased compliance during two reversal conditions. However, the behavior was variable and did not decrease to the low levels reached during the two DRO reversals.
Alternative non-drug reinforcers have been demonstrated to decrease drug-reinforced behavior by both decreasing relative reinforcing efficacy and substituting for the drug reinforcer. The effect of saccharin on responding maintained by orally delivered phencyclidine (PCP) was examined in this study using concurrent progressive-ratio (PR) schedules of reinforcement and a behavioral economic analysis of demand. Seven adult male rhesus monkeys self-administered PCP (0.06, 0.12, 0.25, 0.50 and 1.0 mg/ml) and either concurrent water or saccharin (0.03% wt/vol) from two drinking spouts under concurrent independent PR schedules. During daily sessions the response requirements (lip contacts on automatic drinking spouts) increased across 15 levels, from 8 to 4096. Each successful ratio completion resulted in the availability of 40 liquid deliveries under an FR 1 schedule and a subsequent increment in the PR. Concentrations of PCP were presented in a non-systematic order and presentation of the concurrent liquid, saccharin or water, was counterbalanced across subjects. All behaviors maintained by PCP were significantly greater than those maintained by water. Replacement of water with saccharin served to significantly decrease PCP-maintained responding and break points (BP) across the range of PCP concentrations; however, saccharin did not significantly decrease deliveries of PCP. Saccharin maintained significantly greater responding, BPs and deliveries compared to either PCP or water, across all PCP concentrations. The use of BP as a measure of reinforcing efficacy suggests that saccharin decreased the relative reinforcing efficacy of PCP. Furthermore, behavioral economic analyses suggested that saccharin decreased maximal PCP-maintained responding (Pmax) in a similar fashion, suggesting that BP and Pmax may be analogous measures of reinforcing efficacy.
When a variable-interval schedule of reinforcement was segmented into small fixed-interval components, with reinforcements following some components and brief blackouts following the others, rate of responding doubled and a positively accelerated pattern within each component was obtained. Presented according to this percentage reinforcement paradigm, the blackouts approximated the functions of a food reinforcer. These effects occurred only when the behavior sequence required to produce reinforcement was identical to that required to produce blackout. The quasi-reinforcing effects of these blackout stimuli suggest that a neutral stimulus need not occasion or accompany a primary reinforcer to acquire reinforcing properties.
In pigeons responding under a 180-sec fixed-interval schedule of reinforcement, the frequency distribution of the duration of the final interresponse time before the reinforcer was compared with the distribution of the preceding two interresponse times. The results confirmed qualitatively and quantitatively the expected preferential reinforcement of longer interreinforcement times under fixed-interval reinforcement. Requirements at reinforcement were then changed to eliminate the preferential reinforcement of longer interresponse times. Local patterns and mean rate of responding could change, without the characteristic fixed-interval pattern of increasing responding through the interval (scalloping) being much affected. It is concluded that this characteristic pattern of fixed-interval responding does not depend crucially on effects of the reinforcer at the moment of reinforcement, but rather to effects extending over much longer periods of time than just the last interresponse time.