Learning

1. LEARNING

2. • Learning is a relatively permanent change in
behavior that is brought about by experience.

3. classical conditioning
• A type of learning in which a neutral stimulus
comes to bring about a response after it is
paired with a stimulus that naturally brings
about that response.

4. EXPERIMENT
• Pavlov had been studying the secretion of salivation in dogs in response to the food. While doing
that, he observed stomach secretions and salivation would begin in the dogs when they had not yet
eaten any food. The mere sight of the experimenter who normally brought the food, or even the
sound of the experimenter’s footsteps, was enough to produce salivation in the dogs
He saw that the dogs were responding not only on the basis of a biological need (hunger) but also
as a result of learning—or, as it came to be called, classical conditioning.
• Classical conditioning is a type of learning in which a neutral stimulus (such as the experimenter’s
footsteps) comes to elicit a response after being paired with a stimulus (such as food) that naturally
brings about that response.
• To demonstrate classical conditioning, Pavlov (1927), He rang a bell and, just a few seconds later,
presented the dog with meat. This pairing occurred repeatedly and was carefully planned so that,
each time, exactly the same amount of time elapsed between the presentation of the bell and the
meat.
• At first the dog would salivate only when the meat was presented, but soon it began to salivate at
the sound of the bell. In fact, even when Pavlov stopped presenting the meat, the dog still salivated
after hearing the sound. The dog had been classically conditioned to salivate to the bell.

6. • Previous figure shows The basic process of classical conditioning.
• (a) Before conditioning, the ringing of a bell does not bring about
salivation—making the bell a neutral stimulus. In contrast, meat
naturally brings about salivation, making the meat an
unconditioned stimulus (UCS) and salivation an unconditioned
response (UCR).
• (b) During conditioning, the bell is rung just before the presentation
of the meat.
• (c) Eventually, the ringing of the bell alone brings about salivation.
We now can say that conditioning has been accomplished: The
previously neutral stimulus of the bell is now considered a
conditioned stimulus (CS) that brings about the conditioned
response of salivation (CR)

7. • neutral stimulus A stimulus that, before conditioning, does not naturally
bring about the response of interest.
• unconditioned stimulus (UCS) A stimulus that naturally brings about a
particular response without having been learned.
• unconditioned response (UCR) A response that is natural and needs no
training (e.g., salivation at the smell of food).
• conditioned stimulus (CS) A once neutral stimulus that has been paired
with an unconditioned stimulus to bring about a response formerly caused
only by the unconditioned stimulus.
• conditioned response (CR) A response that, after conditioning, follows a
previously neutral stimulus (e.g., salivation at the ringing of a bell).

8. SUMMARY
• Conditioned = learned.
• Unconditioned = not learned.
• An unconditioned stimulus (UCS) leads to an unconditioned response (UCR).
•Un conditioned stimulus–unconditioned response pairings are not learned and
not trained: They are naturally occurring.
• A conditioned stimulus (CS) leads to a conditioned response (CR), and a
conditioned stimulus–conditioned response pairing is a consequence of
learning and training.
• An unconditioned response and a conditioned response are similar (such as
salivation in Pavlov’s experiment), but the unconditioned response occurs
naturally, whereas the conditioned response is learned.

9. Applying Conditioning
Principles to Human Behavior
• Emotional responses are especially likely to be learned through
classical conditioning processes. For instance, John B. Watson
(1920) showed that classical conditioning was at the root of such
fears by conditioning an 11-month-old infant named Albert to be
afraid of rats. “Little Albert,” like most infants, initially was
frightened by loud noises but had no fear of rats.
• In the study, the experimenters sounded a loud noise whenever
Little Albert touched a white, furry rat. The noise (the
unconditioned stimulus) evoked fear (the unconditioned response).
After just a few pairings of noise and rat, Albert began to
show fear of the rat by itself, bursting into tears when he saw it. The
rat, then, had become a CS that brought about the CR, fear.

10. • for example, classical conditioning can lead to the development of
phobias, which are intense, irrational fears. For example, an insect
phobia might develop in someone who is stung by a bee. The insect
phobia might be so severe that the person refrains from leaving
home.
• Posttraumatic stress disorder (PTSD), suffered by some war
veterans and others who have had traumatic experiences, can also
be produced by classical conditioning Even years after their
battlefield experiences, veterans may feel a rush of fear and anxiety
at a stimulus such as a loud noise

11. • On the other hand, classical conditioning also relates to
pleasant experiences. For instance, you may have a
particular fondness for hearing a certain song can bring
back happy emotions due to associations that you have
developed in the past.
• Classical conditioning also explains why drug addictions are
so difficult to treat. Drug addicts learn to associate certain
stimuli—such as syringe or a room where they use drugs—
with the pleasant feelings produced by the drugs. So simply
seeing a syringe or entering a room can produce reactions
associated with the drug and continued cravings for it.

12. • Extinction: A basic phenomenon of learning that occurs when a
previously conditioned response decreases in frequency and
eventually disappears.
To produce extinction, one needs to end the association between
conditioned stimuli and unconditioned stimuli. For instance, if we
had trained a dog to salivate (the conditioned response) at the
ringing of a bell (the conditioned stimulus), we could produce
extinction by repeatedly ringing the bell but not providing meat (the
unconditioned stimulus).
• At first the dog would continue to salivate when it heard the bell,
but after a few such instances, the amount of salivation would
probably decline, and the dog would eventually stop responding to
the bell altogether. At that point, we could say that the response
had been extinguished.

13. • Once a conditioned response has been extinguished, has it vanished
forever?
Pavlov discovered this phenomenon when he returned to his dog a few
days after the conditioned behavior had seemingly been extinguished. If
he rang a bell, the dog once again salivated—an effect known as
spontaneous recovery which means the reemergence of an extinguished
conditioned response after a period of time and with no further
conditioning.
• Spontaneous recovery also helps explain why it is so hard to overcome
drug addictions. For example, cocaine addicts who are thought to be
“cured” can experience an irresistible impulse to use the drug again if they
are subsequently confronted by a stimulus with strong connections to the
drug, such as a white powder.

14. Generalization
and Discrimination
• stimulus generalization A process in which, after a
stimulus has been conditioned to produce a particular
response, stimuli that are similar to the original
stimulus produce the same response.
• stimulus discrimination The process that occurs if two
stimuli are sufficiently distinct from one another that
one evokes a conditioned response but the other does
not; the ability to differentiate between stimuli.

15. • Pavlov noticed a similar phenomenon. His dogs often
salivated not only at the ringing of the bell that was used
during their original conditioning but at the sound of a
buzzer as well. Such behavior is the result of stimulus
generalization.
• Stimulus generalization is a process in which, after a
stimulus has been conditioned to produce a particular
response, stimuli that are similar to the original stimulus
produce the same response. The greater the similarity
between two stimuli, the greater the likelihood of stimulus
generalization.
• Little Albert, who, as we mentioned earlier, was
conditioned to be fearful of white rats, grew afraid of other
furry white things as well.

16. • Stimulus discrimination: If two stimuli are sufficiently
distinct from each other that one evokes a conditioned
response but the other does not. Stimulus discrimination
provides the ability to differentiate between stimuli.
• For example, a dog comes running into the kitchen when
he hears the sound of the electric can opener, which he
has learned is used to open his dog food. But he does not
run into the kitchen at the sound of the food processor,
although it sounds similar.
• In other words, dog discriminates between the stimuli of
can opener and food processor.

17. Operant Conditioning
• operant conditioning
• Learning in which a voluntary response is
strengthened or weakened, depending on its
favorable or unfavorable consequences.

18. • The term operant emphasizes this point: The
organism operates on its environment to produce
a desirable result. Operant conditioning is at work
when we learn that studying hard results in good
grades.

19. Thorndike’s Law of Effect
• law of effect:
Responses that lead to satisfying
consequences are more likely to be repeated.

20. Skinner’s Experiment
• hungry rat was placed in a skinner box. At first the rat wandered around
the box, exploring the environment in a relatively random fashion. At
some point, however, he pressed the lever by chance, and when he did, he
received a food pellet.
• The first time this happens, the rat did not learn the connection between
pressing a lever and receiving food and continued to explore the box.
• Sooner or later the rat pressed the lever again and receive a pellet, at that
time the frequency of the pressing response was increased.
• Eventually, the rat pressed the lever continually until it satisfied his
hunger, thereby demonstrating that he has learned that the receipt of
food is contingent on pressing the lever.

21. REINFORCEMENT: THE CENTRAL CONCEPT
OF OPERANT CONDITIONING
• Reinforcement is the process by which a
stimulus increases the probability that a
previous behavior will be repeated.
• In other words, pressing the lever is more
likely to occur again because of the stimulus of
food

22. • In a situation such as this one, the food is called a
reinforcer.
• A reinforcer is any stimulus that increases the
probability that a preceding behavior will occur again.
Hence, food is a reinforcer, because it increases the
probability that the behavior of pressing (formally
referred to as the response of pressing) will take place.
• What kind of stimuli can act as reinforcers?
• Bonuses, toys, and good grades can serve as reinforcers

23. • A primary reinforcer satisfies some biological need and works naturally,
regardless of a person’s previous experience. Food for a hungry person,
warmth for a cold person, and relief for a person in pain all would be
classified as primary reinforcers.
• In contrast, a secondary reinforcer is a stimulus that becomes reinforcing
because of its association with a primary reinforcer. For instance, we know
that money is valuable, because we have learned that it allows us to
obtain other desirable objects, including primary reinforcers such as food
and shelter. Money thus becomes a secondary reinforcer.
• Neuroscientists are beginning to explore the biological underpinnings of
reinforcers. For example, we now know that the neurotransmitter
dopamine plays a key role in the reinforcement of
behavior. When we are exposed to certain kinds of stimuli, a food.
Dopamine travels through parts of the brain, leading to feelings of
pleasure that are reinforcing

24. POSITIVE REINFORCERS, NEGATIVE REINFORCERS,
AND PUNISHMENT
• A positive reinforcer is an addition of positive stimulus to the environment that brings about an increase in
a preceding response.
• For example, If food, water, money, or praise is provided after a response, it is more likely that that
response will occur again in the future. The paychecks that workers get at the end of the week, for example,
increase the likelihood that they will return to their jobs the following week.
• In contrast, a negative reinforcer refers to removal of unpleasant stimulus whose removal leads to an
increase in the probability that a prior response will be repeated in the future.
• For example, if you have an itchy rash (an unpleasant stimulus) that is relieved when you apply a certain
brand of ointment, you are more likely to use that ointment the next time you have an itchy rash. Using the
ointment, then, is negatively reinforcing, because it removes the unpleasant itch.
• Similarly, if your iPod volume is so loud that it hurts your ears when you first turn it on, you are likely to
reduce the volume level. Lowering the volume is negatively reinforcing, and you are more likely to repeat
the action in the future when you first turn it on.
• Negative reinforcement, then, teaches the individual that taking an action removes a negative condition that
exists in the environment. Like positive reinforcers, negative reinforcers increase the likelihood that
previous behaviors will be repeated

25. • Punishment
refers to a stimulus that decreases the probability that a prior behavior will occur again
There are two types of punishment: positive punishment and negative punishment, just as there
are positive reinforcement and negative reinforcement. (In both cases, “positive” means adding
something, and “negative” means removing something.)
• Positive punishment weakens a response through the application of an unpleasant stimulus.
• For instance, spanking a child for misbehaving or spending 10 years in jail for committing a crime is
positive punishment.
• negative punishment consists of the removal of something pleasant.
• For instance, when a teenager is told she is no longer be able to use the family car because of her
poor grades, or when an employee is informed that he has been demoted with a cut in pay because
of a poor job evaluation, negative punishment is being administered.
• Both positive and negative punishment result in a decrease in the likelihood that a prior behavior
will be repeated.

27. THE PROS AND CONS OF PUNISHMENT:
• physical punishment can convey to the recipient the idea
that physical aggression is permissible and perhaps even
desirable. A father who yells at and hits his son for
misbehaving teaches the son that aggression is an
appropriate, adult response. The son soon may copy his
father’s behavior by acting aggressively toward others.
• In addition, physical punishment is often administered by
people who are themselves angry or enraged. individuals in
such an emotional state cant control carefully the degree of
punishment they are inflicting.
• Punishment can also reduce the self-esteem of recipients
unless they can understand the reasons for it

28. • Finally, punishment does not convey any information
about what an alternative, more appropriate behavior
might be. Punishing a child for staring out the window
in school could merely lead her to stare at the floor
instead. Unless we teach her appropriate ways to
respond, we have merely managed to substitute one
undesirable behavior for another.
• If punishment is not followed up with reinforcement
for subsequent behavior that is more appropriate, little
will be accomplished. In short, reinforcing desired
behavior is a more appropriate technique for
modifying behavior than using punishment.

29. SCHEDULES OF REINFORCEMENT
• When we refer to the frequency and timing of
reinforcement that follows desired behavior, we are
talking about schedules of reinforcement.
• Behavior that is reinforced every time it occurs is said
to be on a continuous reinforcement schedule; if it is
reinforced some but not all of the time, it is on a
partial (or intermittent) reinforcement schedule.

30. • categories of partial reinforcement schedule :
• schedules that consider the number of responses
made before reinforcement is given, called fixed-
ratio and variable-ratio schedules.
• Schedules that consider amount of time that
passes before reinforcement is provided, called
fixed-interval and variable-interval schedules.

31. • Fixed and Variable-Ratio Schedules
• In a fixed-ratio schedule, reinforcement is given only after a specific number of responses.
• For instance, a rat might receive a food pellet every 10th time it pressed a lever. Similarly,
garment workers are generally paid on fixed-ratio schedules: They receive a specific number
of dollars for every shirt they sew..
• In a variable-ratio schedule, reinforcement occurs after a varying number of responses
rather than after a fixed number.
• For example , variable-ratio schedule is a Door to door salesmen. It is uncertain how many
houses they will have to visit to make a sale, but the more houses they try, the more likely
that they will succeed.

32. • Fixed- and Variable-Interval Schedules: The Passage of Time.
• In a fixed-interval schedule, reinforcement is given only after a
specific amount of time
• Because a fixed-interval schedule provides reinforcement for a
response only if a fixed time period has elapsed, overall rates of
response are relatively low.
• One example of a fixed-interval schedule is a weekly paycheck.

33. • In a variable-interval schedule, the time between reinforcements
varies around some average rather than being fixed.
• For example, a professor who gives surprise quizzes that vary from
one every 3 days to one every 3 weeks is using a variable-interval
schedule.
• Students would be apt to study more regularly because they would
never know when the next surprise quiz was coming. Variable-
interval schedules, in general, are more likely to produce relatively
steady rates of responding than are fixed-interval schedules, with
responses that take longer to extinguish after reinforcement ends.

34. Definition of terminologies
• schedules of reinforcement
• Different patterns of frequency and timing of reinforcement following desired behavior.
• continuous reinforcement schedule
Reinforcing of a behavior every time it occurs.
• partial (or intermittent) reinforcement schedule
• Reinforcing of a behavior some but not all of the time.
• fixed-ratio schedule A schedule by which reinforcement is given only after a specific number
of responses are made.
• variable-ratio schedule A schedule by which reinforcement occurs after a varying number of
responses rather than after a fixed number.
• fixed-interval schedule A schedule that provides reinforcement for a response only if a fixed
time period has elapsed, making overall rates of response relatively low.
• variable-interval schedule A schedule by which the time between reinforcements
varies rather than being fixed.

35. DISCRIMINATION AND GENERALIZATION IN OPERANT CONDITIONING:
• The process by which people learn to discriminate stimuli is
known as stimulus control training. In stimulus control
training, a behavior is reinforced in the presence of a
specific stimulus, but not in its absence.
• A discriminative stimulus signals the likelihood that
reinforcement will follow a response. For example, if you
wait until your roommate is in a good mood before you ask
to borrow her favorite CD, your behavior can be said to be
under stimulus control because you can discriminate
between her moods.
• If you have learned that being polite helps you to get your
way in a certain situation (reinforcing your politeness), you
are likely to generalize your response to other situations.

36. SHAPING: REINFORCING WHAT DOESN’T COME NATURALLY
• shaping
• The process of teaching a complex behavior by rewarding closer and closer
approximations of the desired behavior.
• In shaping, you start by reinforcing any behavior that is at all similar to the
behavior you want the person to learn.
• Later, you reinforce only responses that are closer to the behavior you
ultimately want to teach.
• Finally, you reinforce only the desired response.

37. BIOLOGICAL CONSTRAINTS ON LEARNING:
• There are biological constraints, built-in limitations in
the ability of animals to learn particular behaviors.
• In some cases, an organism has a special predisposition
that will aid in its learning a behavior (such as pecking
behaviors in pigeons). In other cases, biological
constraints act to prevent or inhibit an organism from
learning a behavior. For example, it’s impossible to
train pigs to pick up a disk, because they are
biologically programmed to push objects like it along
the ground.

38. • The existence of biological constraints is
consistent with evolutionary explanations of
behavior. Clearly, there are adaptive benefits
that promote survival for organisms that
quickly learn—or avoid—certain behaviors.

39. COMPARING CLASSICAL AND OPERANT
CONDITIONING

40. Using Behavior Analysis and Behavior Modification
• Identifying goals and target behaviors . The first step is to define
desired behavior . Is it an increase in time spent studying? A
decrease in weight? An increase in the use of language? A
reduction in the amount of aggression displayed by a child? The
goals must be stated in observable terms and must lead to specific
targets. For instance, a goal might be “to increase study time,”
whereas the target behavior would be “to study at least 2 hours per
day on weekdays and an hour on Saturdays.”
•Designing a data-recording system and recording preliminary
data .
To determine whether behavior has changed, it is necessary to
collect data before any changes are made in the situation. This
information provides a baseline against which future changes can
be measured.

41. •Selecting a behavior-change strategy . The crucial step is to select an appropriate strategy. Because all
the principles of learning can be employed to bring about behavior change, a “package” of
treatments is normally used. This might include the systematic use of positive reinforcement for
desired behavior (verbal praise or something more tangible, such as food), as well as a program of
extinction for undesirable behavior (ignoring a child who throws a tantrum). Selecting the right
reinforcers is critical, and it may be necessary to experiment a bit to find out what is important to
a particular individual.
• Implementing the program . Probably the most important aspect of program implementation is
consistency. It is also important to reinforce the intended behavior. For example, suppose a mother
wants her son to spend more time on his homework, but as soon as he sits down to study, he asks
for a snack. If the mother gets a snack for him, she is likely to be reinforcing her son’s delaying
tactic, not his studying.
•Keeping careful records after the program is implemented . Another crucial task is record
keeping. If the target behaviors are not monitored, there is no way of knowing whether the
program has actually been successful.
•Evaluating and altering the ongoing program . Finally, the results of the program should be
compared with baseline, pre-implementation data to determine its effectiveness. If the program
has been successful, the procedures employed can be phased out gradually. For instance, if the
program called for reinforcing every instance of picking up one’s clothes from the bedroom floor,
the reinforcement schedule could be modified to a fixed-ratio schedule in which every third
instance was reinforced. However, if the program has not been successful in bringing about the
desired behavior change, consideration of other approaches might be advisable.

42. Cognitive Approaches
to Learning
• cognitive learning theory
• An approach to the study of learning that
focuses on the thought processes that
underlie learning.

43. latent learning
• Learning in which a new behavior is acquired
but is not demonstrated until some incentive
is provided for displaying it

44. Experiment
• Latent learning. (a) Rats were allowed to roam through a maze for
17 days. (b) The rats that were never rewarded (the unrewarded
condition) consistently made the most errors.
• whereas those that received food at the finish every day (the
rewarded condition) consistently made fewer errors.
• But the results also showed latent learning: Rats that were
rewarded only after the 10th day showed an immediate reduction
in errors and soon became similar in error rate to the rats that had
been rewarded consistently. According to cognitive learning
theorists, the reduction in errors indicates that the rats had
developed a cognitive map—a mental representation—of the maze.

45. Observational Learning:
Learning Through Imitation
• observational learning
• Learning by observing the behavior of another
person, or model.

46. • According to psychologist Albert Bandura and
colleagues, a major part of human
learning consists of observational learning,
which is learning by watching the behavior of
another person, or model .
• Because of its reliance on observation of others—
a social phenomenon—the perspective taken by
Bandura is often referred to as a social cognitive
approach to learning .

47. • Bandura dramatically demonstrated the ability of
models to stimulate learning in a classic
experiment. In the study, young children saw a
film of an adult wildly hitting a toy called a Bobo
doll.
• Later the children were given the opportunity to
play with the Bobo doll themselves. Result
showed most of the children displayed the same
kind of behavior, mimicking/copying the
aggressive behavior.

48. • Not only negative behaviors are acquired through
observational learning. In one experiment, for example,
children who were afraid of dogs were exposed to a model
who was playing with a dog. After exposure, observers
were considerably more likely to approach a strange dog
than were children who had not viewed the Fearless Peer.
• In addition, the discovery of mirror neurons that fire when
we observe another person carrying out a behavior
suggests that the capacity to imitate others may be innate.

49. • Not all behavior that we witness is learned or
carried out, of course. One crucial factor that
determines whether we later imitate a model is
whether the model is rewarded for his or her
behavior.
• If we observe a friend being rewarded for putting
more time into his studies by receiving higher
grades, we are more likely to imitate his behavior
than we would if his behavior resulted only in
being stressed and tired.

50. VIOLENCE IN TELEVISION AND VIDEO GAMES:
DOES THE MEDIA’S MESSAGE MATTER?
• In an episode of The Sopranos , a former television
series, fictional mobster Tony Soprano murdered one
of his associates. To make identification of the victim’s
body difficult, criminals dismembered the body and
dumped the body parts. A few months later, in real life,
two half brothers in Riverside, California, strangled
their mother and then cut her head and hands from
her body. They told police that the plan to dismember
their mother was inspired by the Sopranos episode .

51. • Most psychologists agree that watching high levels of
media violence makes viewers more susceptible to acting
aggressively. For example, one survey showed that one-
fourth of violent young male offenders in prison in Florida
had attempted to commit a media-inspired copycat crime.
• A significant proportion of those teenage offenders noted
that they paid close attention to the media Violent video
games have also been linked with actual aggression. In one
of a series of studies by psychologist Craig Anderson and his
colleagues, college students who frequently played violent
video games, were more likely to have been involved in
delinquent behavior and aggression. Frequent players also
had lower academic achievement.

52. • Several aspects of media violence may contribute to real-life
aggressive behavior. For one thing, experiencing violent media
content seems to lower inhibitions against carrying out
aggression—watching television portrayals of violence or using
violence to win a video game makes aggression seem a legitimate
response to particular situations.
• Finally, exposure to aggression may leave us desensitized to
violence, and produces little emotional response. Our sense of the
pain and suffering brought about by aggression may be reduced.
• What about real-life exposure to actual violence? Does it also lead
to increases in aggression?
• The answer is yes. Exposure to actual violence (being shot or being
shot at) doubles the probability that an adolescent will commit
serious violence over the next 2 years. Whether the violence is real
or fictionalized, then, observing violent behavior leads to increases
in aggressive behavior

53. Does Culture Influence How We Learn?
• Do the differences in teaching approaches between cultures affect how people
learn?
• Some psychologists, taking a cognitive perspective on learning, suggest that
people develop particular learning styles, characteristic ways of approaching
material, based on their cultural background and unique pattern of abilities.
Learning styles differ along several dimensions. For example, one central
dimension is relational versus analytical approaches to learning.
• people with a relational learning style master material best through exposure to a
full unit or phenomenon. Parts of the unit are comprehended only when their
relationship to the whole is understood.
• In contrast, those with an analytical learning style do best when they can carry
out an initial analysis of the principles and components underlying a phenomenon
or situation. By developing an understanding of the fundamental principles and
components, they are best able to understand the full picture.