Operant conditioning
Form of learning in which responses come to be controlled by their consequences
Instrumental learning
Another name for operant learning, introduced by Edward Thorndike
Edward Thorndike
Introduced the term "Instrumental Learning
BF Skinner
Introduced the term "Operant Conditioning
Law of effect
States that if a response in the presence of a stimulus leads to satisfying effects, the association between the stimulus and the response is strengthened
Reinforcement
Occurs when an event following a response increases an organism's tendency to make that response
Operant chamber
A small enclosure in which an animal can make a specific response that is recorded while the consequences of the response are systematically controlled
Skinner box
Another name for an operant chamber
Emit
Term that means "to send forth
Reinforcement contingencies
Circumstances or rules that determine whether responses lead to the presentation of reinforcers
Cumulative recorder
Creates a graphic record of responding and reinforcement in a Skinner box as a function of time
Shaping
Consists of the reinforcement of closer and closer approximations of a desired response
Resistance to extinction
Occurs when an organism continues to make a response after delivery of the reinforcer has been terminated
Discriminative stimuli
Cues that influence operant behavior by indicating the probable consequences (reinforcement or non-reinforcement) of a response
Primary reinforcers
Events that are inherently reinforcing because they satisfy biological needs
Secondary (conditioned) reinforcers
Events that acquire reinforcing qualities by being associated with primary reinforcers
Schedule of reinforcement
Determines which occurrences of a specific response result in the presentation of a reinforcer
Continuous reinforcement
Occurs when every instance of a designated response is reinforced
Intermittent (partial) reinforcement
Occurs when a designated response is reinforced only some of the time
Fixed-ratio schedule
Schedule where the reinforcer is given after a fixed number of nonreinforced responses
Variable-ratio schedule
Schedule where the reinforcer is given after a variable number of nonreinforced responses
Fixed-interval schedule
Schedule where the reinforcer is given for the first response that occurs after a fixed time interval has elapsed
Variable-interval schedule
Schedule where the reinforcer is given for the first response after a variable time interval has elapsed
Concurrent schedules of reinforcement
Consist of two or more reinforcement schedules that operate simultaneously and independently, each for a different response
Matching law
States that under concurrent schedules of reinforcement, organisms' relative rate of responding to each alternative tends to match each alternative's relative rate of reinforcement
Optimal foraging theory
States that the food-seeking behaviors of many animals maximize the nutrition gained in relation to the energy expended to locate, secure, and consume various foods
Positive reinforcement
Occurs when a response is strengthened because it is followed by the presentation of a rewarding stimulus
Negative reinforcement
Occurs when a response is strengthened because it is followed by the removal of an aversive (unpleasant) stimulus
Escape learning
An organism acquires a response that decreases or ends some aversive stimulation in this form of learning
Avoidance learning
An organism acquires a response that prevents some aversive stimulation from occurring in this form of learning
Punishment
Occurs when an event following a response weakens the tendency to make that response