Law of Effect
Edward Thorndike (1874-1949), an early American psychologist, was a key figure in the development of behavioral theory and is best known for his work on animal learning. He placed cats inside of a puzzle box and observed their behavior. Watch a reenactment of his study:
Watch: Thorndike - Law of Effect (http://youtu.be/Vk6H7Ukp6To)
The main idea here is key -- a behavior is more likely to occur if it leads to a desirable effect. Thus, ever very complicated behavior can be explained in terms of "trail and error" learning rather than intelligent insight.
Operant Conditioning
B. F. Skinner (1904-1990) is generally considered the father of Radical Behaviorism – the theoretical argument that the environment determines all behavior. No attention or importance is given to the mind; to Skinner it is all about rewards and punishment.
As you will see, much of his work was done with a specially designed chamber, known as a Skinner Box (a.k.a. an Operant Chamber), that controls rewards and punishment.
Watch: Skinner - Operant Conditioning (http://youtu.be/LSv992Ts6as)
So what influences behavior? Creatures are motivated to seek pleasure and avoid pain and we can break down the outcomes in two ways.
Reinforcers vs. Punishers: A reinforcer is some stimulus that an animal wants to receive. That is, the outcome reinforces (strengthens) the behavior that caused it. A punisher, on the other hand, is a stimulus that the animal wants to avoid. If the outcome is aversive the behavior is less likely to occur.
Primary vs. Secondary: Primary stimuli are things that have a natural effect without any learning necessary. Link this back to our discussion about classical conditioning - primary stimuli are the UCS. Secondary, on the other hand, are stimuli that we have learned to be desirable or aversive via classical conditioning. They are things that started out as a neutral stimulus (NS) but have been associated with a primary stimuli, thus becoming a conditioned stimulus (CS).
This gives us four categories of stimuli that will influence behavior:
Edward Thorndike (1874-1949), an early American psychologist, was a key figure in the development of behavioral theory and is best known for his work on animal learning. He placed cats inside of a puzzle box and observed their behavior. Watch a reenactment of his study:
Watch: Thorndike - Law of Effect (http://youtu.be/Vk6H7Ukp6To)
The main idea here is key -- a behavior is more likely to occur if it leads to a desirable effect. Thus, ever very complicated behavior can be explained in terms of "trail and error" learning rather than intelligent insight.
Operant Conditioning
B. F. Skinner (1904-1990) is generally considered the father of Radical Behaviorism – the theoretical argument that the environment determines all behavior. No attention or importance is given to the mind; to Skinner it is all about rewards and punishment.
As you will see, much of his work was done with a specially designed chamber, known as a Skinner Box (a.k.a. an Operant Chamber), that controls rewards and punishment.
Watch: Skinner - Operant Conditioning (http://youtu.be/LSv992Ts6as)
So what influences behavior? Creatures are motivated to seek pleasure and avoid pain and we can break down the outcomes in two ways.
Reinforcers vs. Punishers: A reinforcer is some stimulus that an animal wants to receive. That is, the outcome reinforces (strengthens) the behavior that caused it. A punisher, on the other hand, is a stimulus that the animal wants to avoid. If the outcome is aversive the behavior is less likely to occur.
Primary vs. Secondary: Primary stimuli are things that have a natural effect without any learning necessary. Link this back to our discussion about classical conditioning - primary stimuli are the UCS. Secondary, on the other hand, are stimuli that we have learned to be desirable or aversive via classical conditioning. They are things that started out as a neutral stimulus (NS) but have been associated with a primary stimuli, thus becoming a conditioned stimulus (CS).
This gives us four categories of stimuli that will influence behavior:
- Primary reinforcers are naturally desirable. For example: food, warmth, sexual pleasure.
- Secondary reinforcers are things we have learned to want because they are associated with other stimuli. For example: we learn that money is desirable because we associate it with the things we can buy. We learn that an audience clapping is a good thing because we associate it with praise, compliments and even rewards.
- Primary punishers are naturally aversive. For example, physical pain, bright lights, hunger
- Secondary punishers are things we have learned to avoid. For example: we learn that an audience booing is undesirable because we associated it with isolation and a lack of rewards. When you parent stares at you and shakes his or her head side to side you know that you've done something wrong because you have learned to associate that look with other punishers. If an animal or human is punished by being hit with a belt the belt itself becomes an aversive stimulus.
So how do we actually go about changing behavior using operant conditioning? If we control the outcome we can increase or decrease the frequency of a behavior, and we can do this in one of four ways:
Reinforcement (R) vs. Punishment (P): Just as we described earlier, an outcome is reinforcing if it encourages the behavior to happen more and it is punishing if it discourages the behavior.
Positive (+) vs. Negative (-): This is where it can get a little tricky… the words in this context have nothing to do with good or bad, they refer to whether we are adding in a new stimulus (+) or taking one away (-). This make more sense when we consider specific examples:
- Positive Reinforcement (+R): Presenting a desired stimulus after a desired behavior has occurred with the goal of increasing that behavior. For example, a mother grants her child 10 minutes of TV time (+R) for cleaning his room. Cleaning has been encouraged.
- Negative Reinforcement (-R): Removing an aversive stimulus after a desired behavior has occurred. For example, a father nags with annoying voices until his child cleans her room. Once the room is clean the nagging stops (-R). Cleaning has been encouraged.
Note that in both cases a desired behavior is being reinforced, the difference is whether we encourage the behavior by adding in something desired or by taking away something that is aversive.
- Positive Punishment (+P): Presenting an aversive stimulus after an undesired behavior has occurred with the goal of decreasing that behavior. For example, a mother makes her child hold a bar of soap in his mouth (+P) after using a curse word in the house. Swearing has been discouraged.
- Negative Punishment (-P): Removing a desired stimulus after an undesired behavior has occurred. For example, a father takes away his daughter's cell phone for a week (-P) after she uses a curse word in the house. Swearing has been discouraged.
Again, in both cases the result is the same, but we can punish a behavior by introducing an aversive outcome or by taking away something that is desired. The key is to think about the words "positive" and "negative" as mathematic operations -- are you adding something in or taking something away?
Learning is a basic form of intelligence - and even very simple creatures learn which behaviors earn reinforcement. Here is a fun example of how you can apply these concepts to train a fish to play soccer (yes, this is real):
Watch: Can your fish play soccer? (http://youtu.be/jgRrrNL-mi4)
Learning is a basic form of intelligence - and even very simple creatures learn which behaviors earn reinforcement. Here is a fun example of how you can apply these concepts to train a fish to play soccer (yes, this is real):
Watch: Can your fish play soccer? (http://youtu.be/jgRrrNL-mi4)
