Biomedical subjects

Mark E Walton

Publications and source records attributed to Mark E Walton.

6 recordsLinked to original sources

PubMed2006

Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine.

RATIONALE: Throughout our lives we constantly assess the costs and benefits of the possible future outcomes of our actions and use this information to guide behavior. There is accumulating evidence that dopamine contributes to a fundamental component of this computation-how rewards are compared with the costs incurred when obtaining them. OBJECTIVE: We review the evidence for dopamine's role in cost-benefit decision making and outline a simple mathematical framework in which to represent the interactions between rewards, costs, behavioral state and dopamine. CONCLUSIONS: Dopamine's effects on cost-benefit decision making can be modeled using simple utility-function curves. This approach provides a useful framework for modeling existing data and generating experimental hypotheses that can be objectively and quantitatively tested by observing choice behavior without the necessity to account for subjective psychological states such as pleasure or desire. We suggest that dopamine plays a key role in overcoming response costs and enabling high-effort behaviors. A particularly important anatomical site of this action is the core of the nucleus accumbens. Here, dopamine is able to modulate activity originating from the frontal cortical systems that also assess costs and rewards. Internal deprivation states (e.g., hunger and thirst) also help to energize goal-seeking behaviors, probably in part by their rich influence on dopamine, which can in turn modify decision making policies.

Animals↗

PubMed2006

Separate neural pathways process different decision costs.

Behavioral ecologists and economists emphasize that potential costs, as well as rewards, influence decision making. Although neuroscientists assume that frontal areas are central to decision making, the evidence is contradictory and the critical region remains unclear. Here it is shown that frontal lobe contributions to cost-benefit decision making can be understood by positing the existence of two independent systems that make decisions about delay and effort costs. Anterior cingulate cortex lesions affected how much effort rats decided to invest for rewards. Orbitofrontal cortical lesions affected how long rats decided to wait for rewards. The pattern of disruption suggested the deficit could be related to impaired associative learning. Impairments of the two systems may underlie apathetic and impulsive choice patterns in neurological and psychiatric illnesses. Although the existence of two systems is not predicted by economic accounts of decision making, our results suggest that delay and effort may exert distinct influences on decision making.

Animals↗

PubMed2006

Optimal decision making and the anterior cingulate cortex.

Learning the value of options in an uncertain environment is central to optimal decision making. The anterior cingulate cortex (ACC) has been implicated in using reinforcement information to control behavior. Here we demonstrate that the ACC's critical role in reinforcement-guided behavior is neither in detecting nor in correcting errors, but in guiding voluntary choices based on the history of actions and outcomes. ACC lesions did not impair the performance of monkeys (Macaca mulatta) immediately after errors, but made them unable to sustain rewarded responses in a reinforcement-guided choice task and to integrate risk and payoff in a dynamic foraging task. These data suggest that the ACC is essential for learning the value of actions.

Animals↗

PubMed2004

Interactions between decision making and performance monitoring within prefrontal cortex.

Our ability to judge the consequences of our actions is central to rational decision making. A large body of evidence implicates primate prefrontal regions in the regulation of this ability. It has proven extremely difficult, however, to separate functional areas in the frontal lobes. Using functional magnetic resonance imaging, we demonstrate complementary and reciprocal roles for the human orbitofrontal (OFC) and dorsal anterior cingulate cortices (ACd) in monitoring the outcome of behavior. Activation levels in these regions were negatively correlated, with activation increasing in the ACd and decreasing in the OFC when the selected response was the result of the participant's own decision. The pattern was reversed when the selected response was guided by the experimenter rather than the participant. These results indicate that the neural mechanisms underlying the way we assess the consequences of choices differ depending on whether we are told what to do or are able to exercise our volition.

Adaptation, Psychological↗

PubMed2003

Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions.

The rat medial frontal cortex (MFC) has been implicated in allowing animals to work harder to receive larger rewards. However, it is unknown what role the individual MFC regions [anterior cingulate cortex (ACC) and prelimbic-infralimbic cortex (PL-IL)] play in such decision making. To investigate this, we trained rats on a T-maze cost-benefit task with two possible courses of action, shown previously to be affected by complete MFC lesions. One response involved climbing a 30 cm barrier to obtain a large quantity of reward (high cost-high reward), whereas the other had a lower energetic demand but also a smaller reward gain (low cost-low reward). Before surgery, all animals preferred to select the high cost-high reward option. However, after excitotoxic ACC lesions, there was a complete reversal of behavior, with the ACC group selecting the low cost-low reward response on nearly every trial. In contrast, both control animals and rats with PL-IL lesions continued to choose to climb the barrier for the larger reward. When the same rats were tested on a delayed match-to-sample paradigm however, it was the PL-IL group that was significantly impaired at learning the response rule, with the performance of ACC rats being comparable with controls. This double dissociation indicates that the ACC is the important region within the MFC when evaluating how much effort to expand for a specific reward.

Analysis of Variance↗

PubMed2002

The role of rat medial frontal cortex in effort-based decision making.

We conducted a series of experiments to elucidate the role of rat medial frontal cortex (MFC) (including prelimbic, infralimbic, and cingulate cortices) in effort-based decision making. Rats were trained on a cost-benefit T-maze task in which they could either choose to climb a barrier to obtain a high reward in one arm (HR arm) or could obtain a small reward in the other with no barrier present (LR arm). Before surgery, all animals were selecting the HR arm on almost every trial. However, after excitotoxic lesions to MFC, the rats shifted to selecting the LR arm on almost every trial. This was not caused by a spatial memory or motor deficit because the same rats returned to selecting the HR arm when the amount of effort needed to be expended to obtain reward in either arm was equalized by putting an identical barrier in the LR arm. Additional experiments demonstrated that the change in effort-based decisions observed in the rats was not caused by a complete insensitivity to reward and effort because they returned to choosing the HR arm if either the cost was reduced (by making the barrier smaller) or the benefit was increased (increasing the food ratio differential). Instead, the MFC lesion shifted the animals' decision criterion, making them more likely to choose the LR arm than the sham-lesioned animals. These results imply that medial frontal cortex is important for allowing the animal to put in more work to obtain greater rewards.

Animals↗