PubMed HealthSearch

Biomedical subjects

G Galbicka

Publications and source records attributed to G Galbicka.

9 recordsLinked to original sources

Daily rhythms in a complex operant: targeted percentile shaping of run lengths in rats.

Daily rhythms in response output and accuracy were examined when reinforcement for a complex operant was uncoupled from accuracy of performance. Rats housed in operant conditioning chambers earned their daily ration of food under a targeted percentile procedure for responding on two levers. The targeted pattern was a series of consecutive responses on the left lever (a "run"), followed by a single response on the right lever. The targeted run length was either "O" (i.e., undefined, under the nondifferential baseline), 6, 12 or 24. Under baseline, a random third of all trials ended in pellet delivery; under the percentile conditions, trials with runs closer to the target than two-thirds of the runs from the most recent 24 trials ended in pellet delivery. This contingency shaped run lengths while ensuring that approximately one-third of all trials produced pellets. Responding tracked the target value well, with mean obtained run lengths equal to 90% of the target or better. Daily rhythms were clearly evident in measures of overall output, with subjects responding primarily 3-7 h into the dark period. The only substantial light-period responding observed in all subjects occurred during the 2 h after noon, when the chambers were serviced. No systematic variation in this pattern was observed as a function of target. Run length was much less variable across the daily cycle than was response output, with only a suggestion under the longest target that response accuracy was lower during periods removed from the period of peak activity.

Animals

Behavioral effects of enantiomers of dizocilpine under two "counting" procedures in rats.

Stereoisomers of the N-methyl-D-aspartate antagonist dizocilpine (MK-801) were studied to determine whether behavioral effects on complex operants depend on reinforcement loss accompanying behavioral disruption. Rats earned food pellets if the run of consecutive left-lever presses preceding a trial-terminating right-lever press approximated a target of 12. A percentile schedule reinforced any run closer to the target than two-thirds of the runs on the most recent 24 trials. Once the sequence was learned, half the subjects were shifted to a procedure that yoked reinforcement for each length run to the probability that length generated pellets during asymptototic percentile performance. Although these two procedures generate similar control run and reinforcement distributions, disrupting behavior reduced reinforcement probability far more under the yoked than the percentile procedure. Despite this difference in drug-induced reinforcement loss, both enantiomers produced similar dose-related decreases in run length and response rate under both procedures, with the (-) isomer approximately one log unit less potent than the (+) isomer. The absence of differential effects under these procedures diminishes the likelihood that reinforcement loss contributes to dizocilpine's effects, indirectly bolstering claims that dizocilpine directly affects learning.

Animals

Response acquisition under targeted percentile schedules: a continuing quandary for molar models of operant behavior.

The number of responses rats made in a "run" of consecutive left-lever presses, prior to a trial-ending right-lever press, was differentiated using a targeted percentile procedure. Under the nondifferential baseline, reinforcement was provided with a probability of .33 at the end of a trial, irrespective of the run on that trial. Most of the 30 subjects made short runs under these conditions, with the mean for the group around three. A targeted percentile schedule was next used to differentiate run length around the target value of 12. The current run was reinforced if it was nearer the target than 67% of those runs in the last 24 trials that were on the same side of the target as the current run. Programming reinforcement in this way held overall reinforcement probability per trial constant at .33 while providing reinforcement differentially with respect to runs more closely approximating the target of 12. The mean run for the group under this procedure increased to approximately 10. Runs approaching the target length were acquired even though differentiated responding produced the same probability of reinforcement per trial, decreased the probability of reinforcement per response, did not increase overall reinforcement rate, and generally substantially reduced it (i.e., in only a few instances did response rate increase sufficiently to compensate for the increase in the number of responses per trial). Models of behavior predicated solely on molar reinforcement contingencies all predict that runs should remain short throughout this experiment, because such runs promote both the most frequent reinforcement and the greatest reinforcement per press. To the contrary, 29 of 30 subjects emitted runs in the vicinity of the target, driving down reinforcement rate while greatly increasing the number of presses per pellet. These results illustrate the powerful effects of local reinforcement contingencies in changing behavior, and in doing so underscore a need for more dynamic quantitative formulations of operant behavior to supplement or supplant the currently prevalent static ones.

Animals

Control over response number by a targeted percentile schedule: reinforcement loss and the acute effects of d-amphetamine.

Two fixed-consecutive-number-like procedures were used to examine effects of acute d-amphetamine administration on control over response number. In both procedures, rats were required to press the left lever at least once and then press the right lever to complete a trial. The consecutive left-lever presses on each trial comprised a "run." Under the targeted percentile schedule, reinforcement was provided if the current run length was closer to the target length (16) than half of the most recent 24 runs. This differentially reinforced run length while holding reinforcement probability constant at .5. A second group acquired the differentiation under the targeted percentile schedule, but were then shifted to a procedure that yoked reinforcement probability by subject and run length to that obtained under the targeted percentile schedule. The two procedures generated practically identical control run lengths, response rates, reinforcement probabilities, and reinforcement rates. Administration of d-amphetamine disrupted percentile responding to a greater degree than yoked control responding. This disruption decreased reinforcement frequency less in the former than the latter procedure. The similar baseline responding under these two procedures suggests that this difference in sensitivity was due to behavioral adjustments to drug prompted by reduction of reinforcement density in the yoked control but not the percentile schedule. These adjustments attenuate the drug's effects under the former, but not the latter, procedure.

Animals

Tolerance to behavioral effects of physostigmine under interval schedules of positive or negative reinforcement.

The present experiments examined whether the rate and type of events maintaining responding help determine physostigmine's behavioral effects. The first two experiments examined the acute and chronic effects of physostigmine, respectively, on lever pressing of rats under variable-interval schedules of food presentation. The third examined the chronic effects of physostigmine on lever pressing under random-interval schedules of shock avoidance. Three different variable intervals (18, 56, and 180 s) and two different random intervals (20 and 60 s) were studied, each associated with a distinctive stimulus. Baseline rates of responding were directly related to the scheduled rate of food delivery or shock avoidance. Acute administration of 0.154-1.233 mumol/kg (0.1-0.8 mg/kg) physostigmine sulfate produced monotonic decreases in overall response rate under all schedules of food presentation. Acute effects (per cent of control response rate) did not differ systematically under the various interval values. Large doses (i.e., 0.4 or 0.8 mg/kg) suppressed the rate of food delivery as well. When initially administered, 0.967 mumol/kg (0.4 mg/kg) physostigmine salicylate also suppressed avoidance response rates and per cent shocks avoided. Tolerance developed to the effects of this dose of physostigmine salicylate on pellet or shock-avoidance frequency more rapidly than to effects on overall response rate. Tolerance to the latter developed only very gradually and could in the case of shock-avoidance response rates be considered partial at best. Tolerance was not affected by the scheduled rate of food or shock presentation. Blood acetylcholinesterase levels showed no recovery during chronic physostigmine. Tolerance is discussed in terms of the reinforcement-loss hypothesis.

Acetylcholinesterase

Response-reinforcer contingency and spatially defined operants: testing an invariance property of phi.

A chamber containing 72 response keys defining the circumference of a circle 1 m in diameter was used to examine the relation between differentiation of response location and a measure of response-reinforcer contingency known as the phi coefficient. A different target key was specified in each successive phase, and response location was differentiated with respect to the target. Criterional and noncriterional responses (i.e., responses "near" and "far" from the target) were defined using targeted percentile schedules to control the overall probability of each response class. By manipulating criterional (and, hence, noncriterional) response probability and the reinforcement probabilities conditional on each, a mathematical invariance property peculiar to phi in contingency analysis was examined. Specifically, diagonally interchanging cell frequencies in a 2 x 2 table relating criterional/noncriterional responses to reinforcement/nonreinforcement leaves phi unchanged. Hence, the degree of response differentiation predicted by phi remains unchanged under the four permutations implied by the various diagonal interchanges. This predicted invariance was examined under values of phi equal to .33, .58, and .82. Increasing phi generally increased the stereotypy of response location. Three of the permutations generated almost interchangeable performance at different phi values. The remaining permutation, however, generated functions relating response concentration to phi with slopes shallower than those obtained under the other permutations. This resulted from relatively higher levels of differentiation, compared to the other permutations, at low phi values. These data strongly suggest boundary conditions on the ability of phi to reflect completely the local processes that are indexed by phi at a molar level.

Animals

Parametric manipulation of interresponse-time contingency independent of reinforcement rate.

Pecking of pigeons was reinforced under a modified interval-percentile procedure that allowed independent manipulation of overall reinforcement rate and the degree to which reinforcement depended on interresponse-time duration. Increasing the contingency, as measured by the phi coefficient, between reinforcement and long interresponse times while controlling the overall rate of reinforcement systematically increased the frequency of those interresponse times and decreased response rate under both of the reinforcement rates studied. Increasing reinforcement rate also generally increased response rate, particularly under weaker interresponse-time contingencies. Random-interval schedules with comparable reinforcement rates generated response rates and interresponse-time distributions similar to those obtained with moderate-to-high interresponse-time reinforcement contingencies. These results suggest that interresponse-time reinforcement contingencies inherent in random-interval and constant-probability variable-interval schedules exercise substantial control over responding independent of overall reinforcement rate effects. The interresponse-time reinforcement contingencies inherent in these schedules may actually mask the effects of overall reinforcement rate; thus differences in response rate as a function of reinforcement rate when interresponse-time reinforcement is eliminated may be underestimated.

Animals

Interresponse-time punishment: a basis for shock-maintained behavior.

Lever pressing of squirrel monkeys postponed brief electric shock according to a free-operant shock-postponement procedure. Pressing also produced shock with a probability proportional to the duration of the current interresponse time in some conditions, or to the fifth ordinally-preceding interresponse time in others. These conditions provided equal frequencies and temporal distributions of response-produced shocks either contingent on or independent of the current interresponse-time duration, respectively. Shock delivered contingent on the current interresponse-time duration resulted in shorter mean interresponse times and higher overall response rates that shock delivered independent of the current interresponse time. In subsequent conditions, response-produced shocks were sufficient to maintain responding following suspension of the postponement procedure only when those shocks were contingent on the current interresponse time. Presenting shock independent of the current interresponse time, conversely, suppressed response rate and ultimately led to cessation of responding in the absence of a conjoint shock-postponement procedure. These results demonstrate interresponse-time punishment in the absence of any indirect avoidance contingencies based on overall shock-frequency reduction, and strongly support similar interpretation at the more local level of shock-frequency reduction correlated with particular interresponse times. Differential punishment of long interresponse times also provides both an a priori basis for predicting whether a schedule of shock presentation will maintain or suppress responding and a framework for interpreting many of the functional relations between overall response rate and parameters of consequent shock presentation. Finally, these results and others indicate the importance of response-consequence contiguity above and beyong any notion of noncontiguous contingency in the control of behavior.

Animals

Schedule-dependent tolerance to behavioral effects of delta 9-tetrahydrocannabinol when reinforcement frequencies are matched.

Squirrel monkeys pressed a lever under a multiple interresponse-time greater than 28-sec, modified random-interval schedule which provided comparable frequencies and temporal distributions of food pellet presentation in the two components. Daily intramuscular administration of either 0.25 or 1.00 mg/kg delta 9-tetrahydrocannabinol resulted initially in suppression and/or disruption of responding and concomitant decreases in the frequency of food presentation in both components. Responding in both components next increased, resulting in recovery of baseline frequencies of pellet delivery during the random-interval component, but continued depression during the interresponse-time schedule. The drug-induced changes in responding under the interresponse-time schedule diminished with repeated injections, whereas response rates during the random-interval schedule sometimes remained elevated. Interresponse-time distributions under the interresponse-time schedule showed that with repeated administration of the drug only those characteristics which had the greatest effect on reinforcement frequency recovered to baseline levels. When drug injections were replaced by daily injections of the vehicle, responding was greatly disrupted only during the random-interval component. These findings are only partially consistent with other results which suggest aht tolerance development to the behavioral effects of delta 9-tetrahydrocannabinol is greatly enhanced if the drug initially produces reinforcement loss.

Animals