PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Reinforcement learning”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54Linked to original sources
PubMed1981

The magnitude of post-reinforcement EEG synchronization (PRS) in cats reflects learning ability.

Electrocortical alpha-like activity, termed post-reinforcement synchronization (PRS), observed during operantly behavior, was quantified in 25 cats and plotted against the number of training sessions required for each to learn to press a lever for milk reward. A significant correlation (r = 0.77; P less than 0.001) was found between PRS magnitude and learning ability. The time required for learning correlated with the amount of perseveration in partially reinforced, i.e. ineffective, behavioral modes.

Animals↗
PubMed1989

Theories of probabilistic reinforcement.

In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.

Animals↗
PubMed2004

Context preexposure influences the effectiveness of feedback stimuli in avoidance learning.

According to the effective reinforcement theory of avoidance learning, there is a positive relationship between the level of context fear and the effectiveness of feedback stimuli. The present research used different preexposure treatments to manipulate context fear and to evaluate the effects of feedback stimuli in two-way avoidance learning. Rat subjects received nonreinforced preexposure either to the nonvisual context cues (avoidance apparatus with the houselights extinguished), to the visual context cues (avoidance apparatus with the houselights on but with a Plexiglas floor covering the grids), or to a neutral box. During subsequent avoidance training conditioned stimulus termination was delayed for 5s after an instrumental response and either a flashing light or darkness was presented as a feedback stimulus. Without preexposure, darkness produced better avoidance performance than did the flashing light. Preexposure to the visual context cues decreased the effectiveness of darkness as a feedback stimulus. However, preexposure to either the visual or to the nonvisual context cues facilitated avoidance performance when a flashing light was used as a feedback stimulus. The results suggest that the effects of a feedback stimulus may be dependent upon the amount and source of context fear.

Animals↗
PubMed1991

Choice with probabilistic reinforcement: effects of delay and conditioned reinforcers.

Two experiments measured pigeons' choices between probabilistic reinforcers and certain but delayed reinforcers. In Experiment 1, a peck on a red key led to a 5-s delay and then a possible reinforcer (with a probability of .2). A peck on a green key led to a certain reinforcer after an adjusting delay. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In all conditions, red houselights were present during the 5-s delay on reinforced trials with the probabilistic alternative, but the houselight colors on nonreinforced trials differed across conditions. Subjects showed a stronger preference for the probabilistic alternative when the houselights were a different color (white or blue) during the delay on nonreinforced trials than when they were red on both reinforced and nonreinforced trials. These results supported the hypothesis that the value or effectiveness of a probabilistic reinforcer is inversely related to the cumulative time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. Experiment 2 tested some quantitative versions of this hypothesis by varying the delay for the probabilistic alternative (either 0 s or 2 s) and the probability of reinforcement (from .1 to 1.0). The results were best described by an equation that took into account both the cumulative durations of stimuli associated with the probabilistic reinforcer and the variability in these durations from one reinforcer to the next.

Animals↗
PubMed1990

Lesions of the amygdaloid complex impair acquisition of serial pattern learning in rats.

Normal and amygdala-lesioned rats were trained in a runway to respond to a three-element pattern ending in 2, 12, or 0 Noyes pellets (45 mg), respectively. The amygdalectomized rats' performance was inferior to that of normal controls during the early and middle stages of training, that is, amygdalectomized rats ran more slowly on rewarded trials and developed patterned running later than control rats. In the later stages of training, the lesioned rats demonstrated tracking of the series elements, reflected by differential running times similar to those of the control animals. Results are discussed in terms of some of the current theories involving the role of the amygdaloid complex in learning and reinforcement.

Amygdala↗
PubMed1962

Some effects of response cost upon human operant behavior.

Three experiments are reported which investigated the effects of cost (point loss per response) upon human-observer responses maintained by VI and FI schedules of reinforcement (acquisition of points via critical-signal detections). (I) Cost attenuated VI response rates without substantially disturbing the constancy of responding, regardless of the presentation sequence of the no-cost and cost conditions. (II) FI scalloping appeared only under cost conditions. Under no cost, a constant rate of responding (similar to VI performance) characterized inter-reinforcement intervals. Exposure to cost did not prevent the recovery of previously established no-cost baselines. (III) FI irregularities, analogous to those commonly observed under FI reinforcement schedules, may be produced by different temporal presentations of the no-cost and cost conditions. The results of all three experiments emphasize the importance of cost as a factor in the maintenance of human behavior on schedules of positive reinforcement.

Learning↗
PubMed2004

An fMRI study of reward-related probability learning.

The human striatum has been implicated in processing reward-related information. More recently, activity in the striatum, particularly the caudate nucleus, has been observed when a contingency between behavior and reward exists, suggesting a role for the caudate in reinforcement-based learning. Using a gambling paradigm, in which affective feedback (reward and punishment) followed simple, random guesses on a trial by trial basis, we sought to investigate the role of the caudate nucleus as reward-related learning progressed. Participants were instructed to make a guess regarding the value of a presented card (if the value of the card was higher or lower than 5). They were told that five different cues would be presented prior to making a guess, and that each cue indicated the probability that the card would be high or low. The goal was to learn the contingencies and maximize the reward attained. Accuracy, as measured by participant's choices, improved throughout the experiment for cues that strongly predicted reward, while no change was observed for unpredictable cues. Event-related fMRI revealed that activity in the caudate nucleus was more robust during the early phases of learning, irrespective of contingencies, suggesting involvement of this region during the initial stages of trial and error learning. Further, the reward feedback signal in the caudate nucleus for well-learned cues decreased as learning progressed, suggesting an evolving adaptation of reward feedback expectancy as a behavior-outcome contingency becomes more predictable.

Adult↗
PubMed1985

Learned helplessness and immunization: sensitivity to response-reinforcer independence in immunized rats.

In experiments 1 and 2, we examined the learned helplessness and immunization effects using a test in which appetitive responding was extinguished by delivering noncontingent reinforcers. Contrary to learned helplessness theory, "immunized" animals showed performance virtually identical to that of animals exposed only to inescapable shock, and different from nonshocked controls. Experiment 2 suggests that the helplessness effect and the lack of immunization are not due to direct response suppression resulting from shock. In Experiment 3, where the immunization effect was assessed by measuring the acquisition of a response to obtain food when there was a positive response-reinforcer contingency, immunization was observed. These results cannot be explained on the basis of proactive interference, but suggest that animals exposed to the immunization procedure acquire an expectancy of response-reinforcer independence during inescapable shock. Thus, immunization effects may reflect the differential expression of expectancies, rather than their differential acquisition as learned helplessness theory postulates.

Animals↗
PubMed2006

The present values of delayed rewards are approximately additive.

In two experiments, human subjects were asked to estimate their present values of single delayed rewards and their present values of temporal sequences of three rewards. Present values were solicited by asking subjects to indicate an amount of money v for which they would be indifferent between receiving v at the end of the session and receiving the delayed reward(s). A procedure was used for which responding the true value of v was the optimal strategy, and the actual payoff that each subject received was determined by one randomly selected trial. In Experiment 1 (n=29) each delayed reward was 9.90 dollars in cash. In Experiment 2 (n=19) the delayed rewards were dated 15 dollars gift certificates to a local restaurant. In both experiments, the present values of the sequences were approximately equal to the sums of the present values of their component rewards. The presence of outliers suggests that a few subjects may have valued sequences less than the sums of their single rewards. Effects of a preference for uniform sequences, if any, were too small to be detected. Discounting of sequences was well fit by a parallel hyperbolic discounting equation, consistent with Mazur's [Mazur, J.E., 1986. Choice between single and multiple delayed reinforcers. J. Exp. Anal. Behav. 46 (1), 67-77] results using multiple reinforcers.

Adult↗
PubMed1962

Reinforcing brain stimulation in competition with water reward and shock avoidance.

Employing response rate as the index of reinforcing strength in self-stimulation experiments is questioned. With water reward or shock avoidance placed in competition with brain stimulation, self-stimulation rate does not reflect relative reinforcement value. The results agree with preference tests which show that, for a given electrode site, stimulus intensity, not rate, is directly related to reward strength.

Brain↗
PubMed2005

Discriminative stimuli that follow the absence of reinforcement are preferred by pigeons over those that follow reinforcement.

Clement, Feltus, Kaiser, and Zentall (2000) found that when pigeons have to work to obtain a discriminative stimulus that is followed by reinforcement, they prefer a discriminative stimulus that requires greater effort over one that requires less effort. The authors suggested that such a preference results from the greater change in hedonic value that occurs between the more aversive event and the onset of the stimulus that signals reinforcement, a contrast effect. It was hypothesized that any stimulus that follows a relatively more aversive event would be preferred over a stimulus that follows a relatively less aversive event. In the present experiment, the authors tested the counterintuitive prediction of that theory, that pigeons should prefer a discriminative stimulus that follows the absence of reinforcement over a discriminative stimulus that follows reinforcement. Results supported the theory.

Animals↗
PubMed1986

Operant conditioning of head waving in Aplysia.

Head waving is a naturally occurring behavior that Aplysia use to explore their environment. Aplysia can be operantly trained to modify their head-waving response, increasing the amount of head waving on one side of their body in order to terminate the presentation of an aversive strong light. Acquisition of the operant response is rapid, within 10 min. Two observations indicate that the operant conditioning is under the control of the contingencies of reinforcement: (i) contingent reinforcement significantly elevates operant responding, reversing the contingencies significantly reduces operant performance, and reinstating the contingencies significantly reinstates operant responding; and (ii) yoked controls do not acquire the operant response, yet these same animals readily learn when reinforcement is made contingent upon their responses. Finally, internally derived cues (e.g., proprioceptive or reafferent) appear to play a predominant role in acquiring the operant response. Since progress has been made in understanding the cellular basis of classical conditioning in Aplysia, this demonstration of operant conditioning in a response system that is well-suited for a cellular analysis provides a preparation in which it is possible both to analyze the cellular mechanisms of operant conditioning and to address the theoretical question of the relationship between classical and operant conditioning on a mechanistic level.

Animals↗