PubMed Health⌕ Search

Biomedical subjects

R L Shull

Publications and source records attributed to R L Shull.

At least 19 recordsLinked to original sources
PubMed2001

Response rate viewed as engagement bouts: effects of relative reinforcement and schedule type.

The rate of a reinforced response is conceptualized as a composite of engagement bouts (visits) and responding during visits. Part I of this paper describes a method for estimating the rate of visit initiations and the average number of responses per visit from log survivor plots: the proportion) of interresponse times (IRTs) longer than some elapsed time (log scale) plotted as a function of elapsed time. In Part 2 the method is applied to IRT distributions from rats that obtained food pellets by nose poking a lighted key under various multiple schedules of reinforcement. As expected, total response rate increased as a function of (a) increasing the rate of reinforcement (i.e., variable-interval [VI] 4 min vs. VI 1 mi), (b) increasing the amount of the reinforcer (one food pellet vs. four pellets), (c) increasing the percentage of reinforcers that were contingent on nose poking (25% vs. 100%), and (d) requiring additional responses after the end of the VI schedule (i.e., adding a tandem variable-ratio [VR] 9 requirement). The first three of these variables (relative reinforcement) increased the visit-initiation rate. The tandem VR, in contrast, increased the number of responses per visit. Thus, variables that have similar effects on total response rate can be differentiated based on their effects on the componemts of response rate.

Animals↗
PubMed2001

Response-independent milk delivery enhances persistence of pellet-reinforced lever pressing by rats.

If, during training, one stimulus is correlated with a higher rate of reinforcement than another, responding will be more resistant to extinction in the presence of that higher rate signal, even if many of the reinforcers have been presented independently of responding. For the present study we asked if the response-independent reinforcers must be the same as the response-dependent reinforcers to enhance the response's persistence. Twelve Long-Evans hooded rats obtained 45-mg food pellets by lever pressing (variable-interval 100-s schedules) in the presence of two discriminative stimuli (blinking vs. steady lights) that alternated every minute during daily sessions. Also, in the presence of one of the stimuli (counterbalanced across rats), the rats received additional response-independent deliveries of sweetened condensed milk (a variable-time schedule). Extinction sessions were exactly like training sessions except that neither pellets nor milk were presented. Lever pressing was more resistant to extinction in the presence of the milk-correlated stimulus when (a) the size of the milk deliveries during training (under a variable-time 30 s schedule) was 0.04 ml (vs. 0.01 ml) and (b) 120-s or 240-s blackouts separated components. Response-independent reinforcers do not have to be the same as the response-dependent reinforcers to enhance persistence.

Animals↗
PubMed1996

Editorial.

Explore the source record for details and available documents.

Journal Article↗
PubMed1996

Introduction.

Explore the source record for details and available documents.

Journal Article↗
PubMed1992

Choice between fixed-interval schedules: Graded versus step-like choice functions.

Pigeons chose between two fixed-interval schedules of food reinforcement. A single peck on one of two lighted keys started the fixed-interval schedule correlated with that key. The schedule had to be completed before the next choice opportunity. The durations of the fixed intervals were varied over conditions from 15 s to 40 s. To maximize the rate of reinforcement, the pigeons had to choose exclusively the shorter of the two schedules. Nevertheless, choice was not all-or-none. Instead, relative choice, and the rates of producing the fixed intervals, varied in a graded fashion with the disparity between the two schedules. Choice ratios under this procedure (single response to choose) were highly sensitive to the ratios of the fixed-interval schedules.

Journal Article↗
PubMed1990

Delay and number of food reinforcers: Effects on choice and latencies.

Pigeons were given a choice between two identical-duration situations (terminal links of chain schedules). One terminal link of the choice pair provided two food deliveries, and the other provided five. The exact times of these food deliveries differed between the terminal links and were varied over conditions. A single response during the initial link gave immediate access to the corresponding terminal link. Forced trials, during which only one of the initial-link keys was lighted, were interspersed with choice trials during which both initial-link keys were lighted. Choice tended to favor whichever terminal link was correlated with the higher sum of the immediacies (i.e., the sum of the reciprocals of the delays to each of the reinforcers following the choice, with all delays measured from the choice). Latencies on forced trials and on choice trials also were related (negatively) to the sum of the immediacies. This correlation among response measures (choice and latencies) suggests that both measures are manifestations of the effect of conditioned reinforcement on response tendencies.

Journal Article↗
PubMed1990

Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies?

Two multiple-schedule experiments with pigeons examined the effect of adding food reinforcement from an alternative source on the resistance of the reinforced response (target response) to the decremental effects of satiation and extinction. In Experiment 1, key pecks were reinforced by food in two components according to variable-interval schedules and, in some conditions, food was delivered according to variable-time schedules in one of the components. The rate of key pecking in a component was negatively related to the proportion of reinforcers from the alternative (variable-time) source. Resistance to satiation and extinction, in contrast, was positively related to the overall rate of reinforcement in the component. Experiment 2 was conceptually similar except that the alternative reinforcers were contingent on a specific concurrent response. Again, the rate of the target response varied as a function of its relative reinforcement, but its resistance to satiation and extinction varied directly with the overall rate of reinforcement in the component stimulus regardless of its relative reinforcement. Together the results of the two experiments suggest that the relative reinforcement of a response (the operant contingency) determines its rate, whereas the stimulus-reinforcement contingency (a Pavlovian contingency) determines its resistance to change.

Animals↗
PubMed1986

Resistance to change produced by access to fixed-delay versus variable-delay terminal links.

Pigeons' responding was reinforced on a multiple schedule consisting of two two-link chain schedules presented in regular alternation. Responding in initial links (always variable-interval 60-s) produced a key-color change and access to a terminal link. The terminal link for one chain provided food after a fixed delay (fixed-interval or fixed-time); the terminal link for the other provided food after a variable delay (variable-interval or variable-time). The average duration of the terminal-link schedules was varied across conditions, but in every condition the arithmetic mean of the variable-delay terminal-link schedule was equal to the duration of the fixed delay. Response rates were higher in the initial links of the chains with the variable-delay terminal links. Response-decreasing operations (satiation, extinction) were used after performances reached asymptote. Response rates maintained by access to variable-delay terminal links tended to be more resistant to change than were rates maintained by access to fixed-delay terminal links. These results are consistent with the preference for variable- over fixed-interval terminal links observed with concurrent-chains schedules, suggesting (1) that immediacy of reinforcement influences the conditioned reinforcing potency of access to a terminal link and (2) that choice in concurrent chains and resistance of responding to change may be manifestations of the same effect of reinforcement.

Journal Article↗
PubMed1981

Delay or rate of food delivery as determiners of response rate.

PIGEONS WERE CONFRONTED WITH TWO KEYS: a green food key and a white changeover key. Food became available for a peck to the green key after variable intervals of time (mean = 113 seconds). A single peck on the changeover key changed the color of the food key to red for a fixed period of time during which the timing of the variable-interval schedule in green was suspended and the switching option eliminated and after which the conditions associated with green were reinstated. In Experiment 1 a single food presentation was obtainable during each red-key period after a minimum delay timed from the switch. This delay and the duration of the red-key period were held constant during a condition but varied between conditions (delay = 2.5, 7.5, 15, or 30 seconds; red-period duration = 30, 60, 120, 240, or 480 seconds). In Experiment 2 additional food presentations were scheduled during a 240-second red-key period with the delay to the first food delivery held constant at 30 seconds, and the delays to later food deliveries varied over conditions. Considering the data from both experiments, the rate of switching to red was a decreasing function of the delay to the first food, the delay to the second food, and perhaps the delay to the third food after a switch. There was no clear evidence that the rate of food in the red-key period made an independent contribution. The ordering of response rates among conditions was consistent with the view that each food presentation after a response adds an incremental effect to the rate of the response and that each food presentation's contribution is a decreasing function of its delay timed from the response.

Journal Article↗
PubMed1980

A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times.

Pigeons were trained to peck keys on fixed-ratio and fixed-interval schedules of food reinforcement. Both schedules produced a pattern of behavior characterized as pause and run, but the relation of pausing to time between reinforcers differed for the two schedules even when mean time between reinforcers was the same. Pausing in the fixed ratio occupied less of the time between reinforcers for shorter interreinforcer times. For two of three birds, the relation was reversed at longer interreinforcer times. As an interreinforcer time elapsed, there was an increasing tendency to return to responding for the fixed interval, but a roughly constant tendency to return to responding for the fixed-ratio schedule. In Experiment 1 these observations were made for both single-reinforcement schedules and multiple schedules of fixed-ratio and fixed-interval reinforcement. In Experiment 2 the observations were extended to a comparison of fixed-ratio versus variable-interval reinforcement schedules, where the distribution of interreinforcement times in the variable interval approximated that for the fixed ratio.

Journal Article↗
PubMed1978

Effect of varying the duration of grain presentation on automaintenance.

In a series of three experiments the effects of variation in grain duration on automaintenance were evaluated. In the first experiment, key illumination was followed by grain only when pigeons did not peck the key. Each subject was exposed to 2-, 4-, and 8-second feeder durations in blocks of 10 sessions. Subjects pecked on a high percentage of trials at all feeder durations. The mean peck latency was shorter in the 8-second condition than in the two other conditions in five of six subjects. The conditional probability of pecking given successive keylight-grain pairings did not increase as the number of pairings increased. The second experiment was identical to the first, except that key pecking had no scheduled consequence. Under these conditions, all three subjects showed substantial responding. The recorded measures showed no systematic relationship to feeder duration in this study. In the third experiment, two different stimuli were followed by feeder presentations of either identical (2- or 8-second) or different (2- and 8-second) durations within each session. Subjects tended to respond sooner and with a higher overall rate in the presence of the stimulus associated with the longer feeder duration only when different feeder durations were presented within the same session. This result was confirmed by direct observation of the pigeons. The results of these experiments suggest that the effects of varying grain duration may be small, compared to the effects of varying other variables. The results also suggest that the location as well as the frequency of pecking may be an important measure in the analysis of factors controlling the pigeon's key peck.

Journal Article↗
PubMed1976

Food deliveries during the pause on fixed-interval schedules.

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.

Journal Article↗
PubMed1975

Response-rate invariance in concurrent schedules: effects of different changeover contingencies.

In a two-key chamber, one key (the food key) was either red or green with different variable-interval schedules operating concurrently in each color and a second key (the changeover key) served to change the food-key color. Three pigeons were trained with either a 2-sec changeover delay or a 0-sec changeover delay and three birds with a fixed-ratio 2 on the changeover key instead of a changeover delay. The proportion of time spent in red approximated the proportion of reinforcers delivered in red for all birds. When the procedure was changed so that reinforcers were signalled in the green schedule, rates of reinforcement were unaltered, but the pigeons spent virtually the whole session in red. Changeovers to green were allowed only when a reinforcer was assigned by the schedule associated with green. For all pigeons with the fixed-ratio requirement on the changeover key or with a 0-sec changeover delay, the overall rate of red-key responses was higher during the signalling condition than during unsignalled, or baseline, condition. The present data question the generality of previous reports that the rate of one response is independent of the amount of time allocated to the alternative response.

Journal Article↗
PubMed1975

Time allocation on concurrent schedules with asymmetrical response requirements.

Pigeons were trained on concurrent schedules in which key pecking was required by both schedules (concurrent variable-interval variable-interval schedules) and on concurrent schedules in which key pecking was required by only one of the schedules (concurrent variable-interval variable-time schedules). The distribution of reinforcements was systematically varied with both types of concurrent schedules. The distribution of time between the schedules depended on the reinforcement distribution and was independent of the symmetry of the response requirement. The relation between time and reinforcement distributions appears to be invariant over a wide range of manipulations of responding maintained by concurrent schedules.

Journal Article↗
PubMed1972

Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules.

Each of three pigeons was studied first under a standard fixed-interval schedule. With the fixed interval held constant, the schedule was changed to a second-order schedule in which the response unit was the behavior on a small fixed-ratio schedule (first a fixed-ratio 10 and then a fixed-ratio 20 schedule). That is, every completion of the fixed-ratio schedule produced a 0.7-sec darkening of the key and reset the response count to zero for the next ratio. The first fixed-ratio completed after the fixed-interval schedule elapsed produced the 0.7-sec blackout followed immediately by food. These manipulations were carried out under two different fixed-interval durations for each bird ranging from 3 min to 12 min. The standard fixed-interval schedules produced the typical pause after reinforcement followed by responding at a moderate rate until the next reinforcement. The second-order schedules also engendered a pause after reinforcement, but responding occurred in bursts separated by brief pauses after each blackout. For a particular fixed-interval duration, post-reinforcement pauses increased slightly as the number of pecks in the response unit increased despite large differences in the rate and pattern of key pecking. Post-reinforcement pause increased with the fixed-interval duration under all response units. These data confirm that the allocation of time between pausing and responding is relatively independent of the rate and topography of responding after the pause.

Journal Article↗