Biomedical subjects

B Balleine

Publications and source records attributed to B Balleine.

14 recordsLinked to original sources

PubMed1996

Role of primary motivation in stimulus preexposure effects.

It is currently a matter of debate whether the deficit in conditioning observed after stimulus preexposure is one of acquisition or one of performance. The major criticism of performance-based theories is their inability to specify what is learned during nonreinforced preexposure that may influence subsequent acquisition of conditioned responding-Experiments 1 and 2 used an excitatory appetitive conditioning procedure and Experiment 3 used an inhibitory appetitive conditioning procedure, with rats as subjects, and consistently found that the effects of preexposure to a stimulus transferred to conditioning only when the reinforcer was relevant to the motivational state in which that preexposure was conducted. This finding suggests that during preexposure, rats learn that a stimulus is unrelated to events of relevance to their current motivational state.

Animals↗

PubMed1996

Bidirectional instrumental conditioning.

Three experiments examined bidirectional instrumental conditioning by training hungry rats to push a pole in one direction for food pellets and in the other for either a sugar or a starch solution. In the first study we examined whether the animals learned about the action-reinforcer relations using a specific satiety procedure. Prefeeding one type of reinforcer before an extinction test selectively depressed the performance of the action that had been paired with this reinforcer during training. The second experiment investigated the sensitivity of the bidirectional actions to variations in the action-reinforcer contingencies. When the instrumental contingency was degraded by presenting unpaired reinforcers, the animals pushed less in the direction that was paired with the reinforcer type that was the same as the non-contiguous one. A third study revealed that increasing the rate of reinforcement for one action enhanced its rate of performance without significantly affecting the performance of the other action. We conclude that the effects of reinforcer devaluation, the action-outcome contingency, and the rate of reinforcement are not mediated by Pavlovian associations between the manipulandum and the reinforcer.

Animals↗

PubMed1995

Cholecystokinin attenuates incentive learning in rats.

The hypothesis that endogenous cholecystokinin (CCK) reduces the incentive value assigned to food was examined by training undeprived rats to lever press and chain pull, with one action earning food pellets and the other maltodextrin solution. All animals were then food deprived and reexposed to one outcome after an injection of CCK-8 and the other after an injection of vehicle (VEH). When maintained food deprived and given a choice between the lever and chain in an extinction test, the rats performed fewer of the action trained with the outcome that was reexposed under CCK whether tested under CCK or VEH. In a subsequent experiment, this preference was attenuated by coadministration of the 5-hydroxytryptamine1A (5-HT1A) agonist 8-hydroxy-2(di-n-propylamino)tetralin during reexposure, suggesting that CCK interacts with 5-HT to modify incentive value.

8-Hydroxy-2-(di-n-propylamino)tetralin↗

PubMed1995

Instrumental outcome devaluation is attenuated by the anti-emetic ondansetron.

In three experiments we assessed the effect of an anti-emetic, the selective 5-HT antagonist ondansetron, on (1) the conditioning of a taste aversion using lithium chloride (LiCl); (2) the expression of that aversion; and (3) instrumental outcome-devaluation effects. In Experiment 1 it was found that ondansetron reduced the aversion induced by LiCl when administered prior to the LiCl injection and also attenuated the expression of that aversion when administered prior to test sessions. In Experiments 2 and 3, thirsty rats were trained, in a single session, to lever press and chain pull for sucrose and saline solutions concurrently before being injected with LiCl. They were then re-exposed to both solutions, one after injection of vehicle and the other after injection of ondansetron. In a choice extinction test on the levers and chains, animals performed more of the action whose training outcome was re-exposed under ondansetron than the other action, whether the test was conducted after an injection of vehicle or after one of ondansetron.

Animals↗

PubMed1994

Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action.

In a series of studies, we assessed the effects of ibotenic acid lesions of the nucleus accumbens on instrumental performance in hungry rats. Although these lesions were found to generally impair lever press performance for both food pellets and a sucrose solution, they did not affect sensitivity to changes in the incentive value of the outcome induced either by a shift in food deprivation or a shift in the sucrose concentration. Further, these lesions did not affect sensitivity to a change in the instrumental contingency from response-contingent to non-contingent outcome delivery. In contrast, concurrent assessment of food magazine approach responses found that the lesion induced both a deficit in magazine entry and marked insensitivity to shifts in the incentive value of the outcome and to the changed situation that accompanied the change in instrumental contingency. These results are interpreted as suggesting (1) that nucleus accumbens lesions produce a general deficit in affective arousal; and (2) that the influence of affective mechanisms on instrumental performance may be structurally dissociated from the control of performance mediated by the action-outcome relation.

Animals↗

PubMed1994

Benzodiazepine-induced outcome revaluation and the motivational control of instrumental action in rats.

It has been argued that the control of instrumental action by motivational states is indirect, being mediated by the effects these states have on the incentive value of the instrumental outcome (A. Dickinson & B. W. Balleine, 1994). In this study, the benzodiazepine agonist midazolam was found to control instrumental action in a similar manner. Midazolam (1 mg/kg) increased rewarded instrumental performance in rats trained undeprived but only elevated performance in extinction when rats were reexposed to the instrumental outcome under midazolam before the test. This effect of reexposure under midazolam did not transfer to a test conducted under food deprivation, suggesting that it was not produced by drug-induced hunger. Finally, in animals trained hungry, midazolam was found to block outcome devaluation induced by a reduction in food deprivation, indicating that midazolam and food deprivation affect outcome value via a common substrate.

Animals↗

PubMed1994

Role of cholecystokinin in the motivational control of instrumental action in rats.

In 4 experiments, the role of cholecystokinin (CCK) in the motivational control of instrumental performance in rats was assessed. Following instrumental training with food rewards, injections of CCK (either 2 micrograms/kg or 4 micrograms/kg) had no effect on instrumental performance in extinction, even when the opportunity was given to learn about the incentive value of the food outcome under CCK. These results contrasted markedly with the effects of shifts in food deprivation. Rewarded instrumental performance was, however, reduced by both doses of CCK, suggesting that CCK may mediate deprivation-related shifts in incentive value. Tests of this hypothesis found that the alimentary CCK antagonist devazepide (MK329) attenuated the devaluation of a food outcome produced by exposure to the outcome in a nondeprived state. These data are interpreted as suggesting that CCK may act as a satiety-specific incentive signal.

Animals↗

PubMed1994

Asymmetrical interactions between thirst and hunger in Pavlovian-instrumental transfer.

Pavlovian-instrumental transfer experiments have demonstrated that a stimulus paired with a sucrose solution under hunger will increase instrumental performance under thirst relative to a stimulus previously paired with food pellets. In Experiment 1 it was demonstrated that this difference is, in part, produced by suppression induced by the pellet stimulus, which, it was found, acted to reduce instrumental performance under thirst. In Experiment 2, the reverse shift was examined, comparing the effects of stimuli paired with either a saline solution or a sucrose solution under thirst on instrumental performance under hunger. Although the sucrose stimulus was found to elevate performance when hungry, the saline stimulus was found to be without effect. This asymmetry in the interaction between hunger and thirst is discussed in terms of the way motivational states control the interaction between sensory and affective components of the reinforcer.

Animals↗

PubMed1992

Incentive learning following reinforcer devaluation is not conditional upon the motivational state during re-exposure.

Three experiments analysed the effect of re-exposure to the reinforcer following aversion conditioning on instrumental performance. In the first experiment, groups of hungry and thirsty rats were trained to press a lever for sucrose, which was then followed by a single injection of lithium chloride (LiCl). On the following day, half the animals in each motivational condition received re-exposure to the sucrose solution; the remaining animals were not re-exposed. In a subsequent extinction test animals that had received re-exposure to the sucrose pressed less than animals that were not re-exposed. Moreover, the effect of re-exposure to the sucrose solution was similar following training under hunger and thirst. In the remaining studies, animals were trained to lever-press for sucrose while either hungry or thirsty. They were then injected with LiCl and re-exposed to the sucrose while either hungry or thirsty, i.e. in the same or different motivational state employed during training, or they were not re-exposed. Lever pressing was then tested in extinction in the training motivational state. As in the first experiment, re-exposure to the reinforcer after aversion conditioning enhanced the magnitude of the reinforcer devaluation effect. More importantly, re-exposure to the sucrose produced a comparable effect on instrumental performance, whether re-exposure was given under the same or different motivational state to that employed during training. These results suggest that the instrumental reinforcer devaluation effect depends upon a process of incentive learning, but that this process is not conditional upon the current motivational state of the animal.

Animals↗

PubMed1992

Signalling and incentive processes in instrumental reinforcer devaluation.

We have previously reported that conditioning an aversion to the reinforcer using an isotonic lithium chloride (LiCl) solution following instrumental training reduces performance in a subsequent extinction test only if animals are re-exposed to the reinforcer prior to the test. Rescorla (1992), in contrast, reported an immediate devaluation effect using a hypertonic LiCl solution that did not depend upon re-exposure. In two experiments we examined the effect of using a hypertonic LiCl solution to condition the aversion to the reinforcer on subsequent instrumental performance in extinction, with and without re-exposure. In Experiment 1 thirsty rats were trained to press a lever for a sucrose solution before being injected with 0.6 M LiCl either immediately or after a delay. Half of the immediate and delay groups were then re-exposed to the sucrose in the absence of the lever, with the remainder being exposed to water. Contrary to the previously reported effects of isotonic LiCl, a hypertonic solution induced a reinforcer devaluation effect in all the immediately poisoned animals, which did not depend upon re-exposure to the reinforcer. In Experiment 2 the possibility that this devaluation effect was induced by the discomfort associated with the hypertonicity of the solution was assessed by replicating Experiment 1 but, in addition, using two immediately poisoned groups given the LiCl injection under anaesthesia. In the absence of anaesthesia, the devaluation effect observed without re-exposure to the reinforcer in Experiment 1 was replicated. When the injection was given under anaesthesia, however, a reinforcer devaluation effect was observed only in animals that were re-exposed to the reinforcer prior to the extinction test. These results were interpreted as evidence that a reinforcer devaluation effect induced by pairing the reinforcer with illness depends upon a process of incentive learning, whereas a devaluation effect mediated by learning a signalling relationship between the reinforcer and somatic discomfort does not.

Animals↗

PubMed1992

Instrumental performance following a shift in primary motivation depends on incentive learning.

In 5 experiments the role of incentive learning in instrumental performance following a shift in primary motivation was examined. In Experiments 1 and 2 rats trained to perform an instrumental action reinforced by either pellets or maltodextrin when in a low-deprivation state were shifted to a high-deprivation state and tested in extinction. This shift in deprivation increased performance only if the animals had been exposed to the reinforcer in the high-deprivation state prior to instrumental training. Experiments 3, 4, and 5 examined the reverse shift training in a high-deprivation state and testing in a low-deprivation state, and found, similarly, that performance was only sensitive to this shift if animals were previously exposed to the reinforcer while in the low-deprivation state. These experiments support the conclusion that instrumental performance following revaluation of the reinforcer depends on a process of incentive learning.

Animals↗

PubMed1991

The acquisition of self-stimulation of the medical prefrontal cortex following exposure to escapable or inescapable footshock.

The effect of acute stress on the acquisition of an instrumental action reinforced by electrical stimulation of the medial prefrontal cortex (MPC) was investigated by exposing rats to either escapable, inescapable or no footshock prior to daily self-stimulation training sessions. Treatment with inescapable footshock did not affect the number of sessions required for acquisition of MPC self-stimulation but did increase the rate of responding over acquisition sessions compared with the no-shock group. When the treatment footshock was escapable, however, both a facilitation in acquisition, as indexed by a reduction in the number of sessions to criterion, and an increase in the rate of MPC self-stimulation was found. These data were interpreted as offering evidence for the operation of a dopaminergic mechanism in the acquisition of MPC self-stimulation. Further, they indicate, contrary to the reported effects of footshock on self-stimulation of other brain areas, that exposure to acute stress has a facilitatory effect on the rate of self stimulation of the MPC.

Animals↗

PubMed1991

Reconsideration of the role of competing responses in demonstrations of the interference effect (learned helplessness).

In Experiment 1a, rats trained to escape shock by performing a 2-s inactive response were less impaired on a subsequent 2-way shuttle response than their yoked counterparts that received inescapable shock. In contrast, in Experiment 1b, rats trained to escape shock by performing a longer duration inactive response were more impaired on the subsequent escape task than their inescapably shocked counterparts. In Experiment 2, the results of Experiments 1a and 1b were replicated, and the inactive responses performed during pretreatment by both the escapable and inescapable shock groups were assessed and correlated with test stage 2-way shuttle escape performance. These activity data indicate that inactivity during pretreatment shock in both escapable and inescapable shock groups was a highly reliable predictor of subsequent 2-way shuttle performance, irrespective of the pretreatment shock contingency to which these Ss were exposed.

Animals↗

PubMed1990

Motivational control of instrumental performance following a shift from thirst to hunger.

Thirsty rats were trained to press a lever for either a sucrose solution or saline before performance was tested in extinction while the animals were either hungry alone or experiencing both hunger and a sodium appetite. Reinforcer-specific motivational control was observed in that the animals trained with the sucrose solution pressed more than those trained with the saline when they were tested hungry, but not when they were tested under combined hunger and sodium appetite. In order to assess the role of a Pavlovian incentive process in this effect, thirsty animals received non-contingent pairings of one stimulus with the sucrose solution and another with saline in the second experiment. In an extinction test the sucrose stimulus augmented lever pressing relative to the saline stimulus when the animals were hungry, but not when they were thirsty. In the subsequent experiments the contribution of the Pavlovian process was equated by giving concurrent training with both incentives. Lever pressing and chain pulling were reinforced concurrently, one with the sucrose solution and the other with saline, while the animals were thirsty. Once again, the animals pressed more in extinction if this action had been trained with the sucrose solution rather than the saline, but only if they were hungry rather than thirsty. Thus, instrumental performance across a thirst-to-hunger shift can also be controlled by an instrumental incentive process. The direct engagement of the instrumental process by this motivational shift contrasts to the absence of such control following a hunger-to-thirst transition (Dickinson & Dawson, 1987a), a fact attributed to the asymmetrical motivational interactions produced by water and food deprivation.

Animals↗