The document summarizes key concepts from Chapter 6 of the textbook Psychological Science on the topic of learning. It discusses:
1) The influential work of B.F. Skinner and John Watson in establishing behaviorism as the dominant paradigm for studying learning through the early 1960s.
2) The difference between classical and operant conditioning, with classical conditioning involving associating a neutral stimulus with an unconditioned stimulus through repeated pairings, while operant conditioning involves reinforcing or punishing behaviors to increase or decrease their likelihood.
3) How concepts from classical and operant conditioning can help explain phenomena like phobias, drug addiction, and the effects of different reinforcement schedules on behavioral persistence.
Behaviorism in Psychology
Basic concepts, Major theorist and their contributions , Therapeutic Techniques, Current applications of behaviorism and research area
This descriptive ppt on Behaviorism will help to take the knowledge in crux. It includes how the behaviorism came into fame after the fall of Psychology and goals of behaviorism. It includes the brief contribution of Watson and B.F Skinner two leading forces of Behaviorism. It includes classical conditioning, S-R relationship,it also includes operant conditioning. It also states about the criticism of Behaviorism.
Behaviorism in Psychology
Basic concepts, Major theorist and their contributions , Therapeutic Techniques, Current applications of behaviorism and research area
This descriptive ppt on Behaviorism will help to take the knowledge in crux. It includes how the behaviorism came into fame after the fall of Psychology and goals of behaviorism. It includes the brief contribution of Watson and B.F Skinner two leading forces of Behaviorism. It includes classical conditioning, S-R relationship,it also includes operant conditioning. It also states about the criticism of Behaviorism.
The following lecture - given at the Colombo Institute for Research and Psychology - covers an introduction to behaviorism, key thinkers, an introduction to classical conditioning, key mechanisms in classical conditioning and some applications including conditioned emotion and drug response.
The following lecture - given at the Colombo Institute for Research and Psychology - covers an introduction to behaviorism, key thinkers, an introduction to classical conditioning, key mechanisms in classical conditioning and some applications including conditioned emotion and drug response.
Behaviorism school of thought in psychologyNadeemShoukat3
Ishallah this video help you to comprehend about behaviorism school of thought, its major thinker, major experiment, advantages and disadvantages and much more
These slides are about different methods and types of learning and basically concerned about classical conditioning. Classical conditioning and its whole process is described here briefly.
CH. 4 LEARNING, MEMORY, AND INTELLIGENCELearning is definedMaximaSheffield592
CH. 4 LEARNING, MEMORY, AND INTELLIGENCE
Learning is defined as relatively permanent changes in behavior that result from experience but are not caused by fatigue, maturation, drugs, injury, or disease.
Memory is simply a process of encoding, storing, and retrieving pieces of information.
Everything we are, in our conscious experience, is dependent upon memory. Without memory we would live in a constant state of rediscovery, whereby every instance would be newly learned. Learning and memory are also intricately connected to intelligence.
Intelligence is the overall capacity to think and act logically and rationally within one’s environment.
What is Learning: Approaches to Learning
Learning, psychology tells us, consists of changes in behavior. But not all changes in behavior are examples of learning.
In the most brief explanation, learning is a change in behavior (or the potential for behavior) as a result of experience.
Learning:
A process resulting in a relatively consistent change in behavior or behavioral potential and is based on experience.
Learning is difficult to assess because it cannot be observed directly; instead, inferences are made about learning based on changes in performance.
Learning is not easily separated from other major topics in psychology. Changes in behavior are centrally involved in many aspects of psychology, including motivation, personality, development, and even mental disorders.
Cognitive Theories:
Theories that look at intellectual processes such as those involved in thinking, problem solving, imagining, and anticipating.
Behavioristic Theories:
Theories concerned with objective evidence of behavior rather than with consciousness and mind. Sometimes these are referred to as S-R or associationistic theories because they deal mainly with associations between stimuli and responses (muscular, glandular, or mental reaction to a stimulus).
Stimulus:
Any change in the physical environment capable of exciting a sense organ. Stimuli can also be internal events such as glandular secretions or even thoughts.
Behavioristic Approaches:
Classical Conditioning and Pavlov’s Experiments
An American named Edwin Twitmyer was actually the first person known to have reported the principle of classical conditioning. About a year later, a Russian by the name of Ivan Pavlov presented essentially the same findings—only he had used dogs as subjects whereas Twitmyer had used humans.
Classical Conditioning, sometimes called learning through stimulus substitution, is learning through stimulus substitution as a result of repeated pairings of an unconditioned stimulus with a conditioned stimulus
To clarify the laws of classical conditioning, Pavlov devised a series of experiments (Pavlov, 1927). In the best known of these, a dog is placed in a harness-like contraption. The apparatus allows food powder to be inserted directly into the dog’s mouth or to be dropped into a dish in front of the dog.
The salivation that ...
Safalta Digital marketing institute in Noida, provide complete applications that encompass a huge range of virtual advertising and marketing additives, which includes search engine optimization, virtual communication advertising, pay-per-click on marketing, content material advertising, internet analytics, and greater. These university courses are designed for students who possess a comprehensive understanding of virtual marketing strategies and attributes.Safalta Digital Marketing Institute in Noida is a first choice for young individuals or students who are looking to start their careers in the field of digital advertising. The institute gives specialized courses designed and certification.
for beginners, providing thorough training in areas such as SEO, digital communication marketing, and PPC training in Noida. After finishing the program, students receive the certifications recognised by top different universitie, setting a strong foundation for a successful career in digital marketing.
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Biological screening of herbal drugs: Introduction and Need for
Phyto-Pharmacological Screening, New Strategies for evaluating
Natural Products, In vitro evaluation techniques for Antioxidants, Antimicrobial and Anticancer drugs. In vivo evaluation techniques
for Anti-inflammatory, Antiulcer, Anticancer, Wound healing, Antidiabetic, Hepatoprotective, Cardio protective, Diuretics and
Antifertility, Toxicity studies as per OECD guidelines
Francesca Gottschalk - How can education support child empowerment.pptxEduSkills OECD
Francesca Gottschalk from the OECD’s Centre for Educational Research and Innovation presents at the Ask an Expert Webinar: How can education support child empowerment?
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
2. Learning
• B. F. Skinner, who was inspired by the work of
Watson and Pavlov, has been one of the most
influential people in contemporary psychology
• Skinner believed that, to be scientists,
psychologists had to study observable actions
and focus on the behaviors people and
nonhuman animals display
3. 6.1 What Ideas Guide
the Study of Learning?
• Define classical conditioning.
• Differentiate between US, UR, CS, and CR.
• Describe the role of learning in the
development and treatment of phobias and
drug addiction.
• Discuss the evolutionary significance of
classical conditioning.
• Describe the Rescorla-Wagner model of
classical conditioning.
4. 6.1 What Ideas Guide
the Study of Learning?
• Skinner and other behaviorists dismissed the
importance of introspection and mental states
in favor of basic learning principles and
scientific approaches to psychology.
• Learning theories have been used to improve
quality of life and to train humans and
nonhuman animals to learn new tasks.
5. Learning Results from Experience
• Learning: a relatively enduring change in
behavior, resulting from experience
• Associations develop through conditioning, a
process in which environmental stimuli and
behavioral responses become connected
– classical (Pavlovian) conditioning: learning that
two types of events occur together
– operant (instrumental) conditioning: learning that
a behavior leads to a particular outcome
6. Learning Results from Experience
• Learning Theory arose in the early twentieth century
in response to Freudian and introspective
approaches
• John B. Watson argued that only observable behavior
was a valid indicator of psychological activity, and
that the infant mind was a tabula rasa, or blank slate
• He stated that the environment and its effects were
the sole determinants of learning
• Behaviorism was the dominant paradigm into the
1960s, and had a huge influence on every area of
psychology
7. Behavioral Responses Are Conditioned
• Watson was influenced by Ivan Pavlov’s research on
the salivary reflex, an automatic response when food
stimulus is presented to a hungry animal
• Pavlov noticed the dogs salivated as soon as they
saw the bowls that usually contained food,
suggesting a learnedresponse
• Twitmyer made a similar observation of the kneejerk reflex in humans: when paired with a bell,
subjects can be conditioned to demonstrate the
knee-jerk response without other triggers
8.
9.
10. Pavlov’s Experiments
• Classical (Pavlovian) conditioning: A neutral object
comes to elicit a response when it is associated with
a stimulus that already produces that response
• A typical Pavlovian experiment involves:
– Conditioning trials: neutral stimulus AND unconditioned
stimulus are paired to produce reflex, e.g. salivation
• Neutral stimulus: anything the animal can see or hear as long as it
is NOT associated with the reflex being tested, e.g. ringing bell
• Unconditioned stimulus (US): a stimulus that elicits a response,
such as a reflex, without any prior learning, e.g. food
– Critical trials: neutral stimulus alone is tested, and effect
on the reflex is measured
11. Terminology of Pavlov’s Experiments
• Unconditioned response (UR): a response that does not have
to be learned, such as a reflex
• Unconditioned stimulus (US): a stimulus that elicits a
response, such as a reflex, without any prior learning
• Conditioned stimulus (CS): a stimulus that elicits a response
only after learning has taken place
• Conditioned response (CR): a response to a conditioned
stimulus; a response that has been learned
Can you think of any learned associations that have classically
conditioned you?
12.
13. Acquisition, Extinction, and
Spontaneous Recovery
• Pavlov was influenced by Darwinand believed that
conditioning is the basis of adaptive behaviors
• Acquisition: the gradual formation of an association
between the CS and US
• The critical element in the acquisition of a learned
association is time, or contiguity
• The CR is stronger when there is a very brief delay
between the CS and the US
– For example, scary music begins to play right before a
frightening scene in a movie—not during or after
14. Acquisition, Extinction, and
Spontaneous Recovery
• How long do learned behaviors persist?
• Animals must learn when associations are no longer
adaptive
– extinction: a form of learning that the prior association no
longer holds. The CR is weakened when the CS is repeated
without the US, and eventually extinguishes
• Spontaneous recovery: a previously extinguished
response reemerges after the presentation of the CS
• The recovery will fade unless the CS is again paired
with the US
• Extinction inhibits the associative bond, but does
not eliminate it
15.
16. Generalization, Discrimination, and
Second Order Conditioning
• In a learning situation, how does the brain determine
which stimulus is relevant?
• stimulus generalization: responding to stimuli that
are similar but not identical to the CS produce the CR
• stimulus discrimination: a differentiation between
two similar stimuli when only one of them is
consistently associated with the US
• Second-order conditioning: a CS becomes associated
with other stimuli associated with the US. This
phenomenon helps account for the complexity of
learned associations
17.
18.
19. Phobias and Addictions Have
Learned Components
• Classical conditioning helps explain many
behavioral phenomena. Among the examples
are phobias and addictions.
20. Phobias and Their Treatment
• Phobia: an acquired fear out of proportion to
the real threat of an object or of a situation
• Fear conditioning: the process of classically
conditioning animals to fear neutral objects
• The responses include specific physiological
and behavioral reactions
– freezing: may be a hardwired response to fear that
helps animals deal with predators
21. Phobias and their Treatment
• In 1919, John B. Watson became one of the first
researchers to demonstrate the role of classical
conditioning in the development of phobias by
devising the “Little Albert” experiment
• At the time, the prominent theory of phobias
wasbased on Freudian ideas about unconscious
repressed sexual desires
• Watson proposed that phobias could be explained by
simple learning principles, such as classical
conditioning
22. Phobias and their Treatment
• The “Little Albert” Research Method:
– Little Albert was presented with neutral objects (a white
rat and costume masks) that provoked a neutral response
– During conditioning trials, when Albert reached for the
white rat (CS) a loud clanging sound (US) scared him (UR)
– Results: Eventually, the pairing of the rat (CS) and the
clanging sound (US) led to the rat’s producing fear (CR) on
its own. The fear response generalized to other stimuli
presented with the rat initially, such as the costume masks
– Conclusion: Classical conditioning can cause people to fear
neutral objects
23. Phobias and their Treatment
• Watson planned to conduct extinction trials to
remove the learned phobias but Albert’s mother
removed him from the study
– Do you think this type of research is ethical?
• Watson’s colleague, Mary Cover Jones, used classic
conditioning techniques to develop effective
behavioral therapies to treat phobias
– Counterconditioning –exposing a patient to small doses of
the feared stimulus while they engage in an enjoyable task
24. Phobias and their Treatment
• Systematic desensitization:a formal treatment
based on counterconditioning
– Developed by behavioral therapist Joseph Wolpe
in 1997
– CS → CR1 (fear) connection can be broken by
developing a CS → CR2 (relaxation) connection
• Psychologists now believe that exposure to
the feared stimulus is more important than
relaxation
25.
26. Drug Addiction
• Classical conditioning also plays an important role in
drug addiction.
• Environmental cues associated with drug use can
induce conditioned cravings
• Unsatisfied cravings may result in withdrawal, an
unpleasant state of tension and anxiety, coupled with
changes in heart rate and blood pressure
• The sight of drug cues leads to activation of the
prefrontal cortex and various regions of the limbic
system and produces an expectation that the drug
high will follow
27. Drug Addiction
• Psychologist Shepard Siegel (2005) believed exposing addicts
to drug cues was an important part of treating addiction
– Exposure helps extinguish responses to the cues and prevents them
from triggering cravings
• Siegel and his colleagues conducted research into the
relationship between drug tolerance and situation
– The body has learned to expect the drug in that location and
compensates by altering neurochemistry or physiology to metabolize
it
– Conversely, if addicts take their usual large doses in novel settings,
they are more likely to overdose because their bodies will not respond
sufficiently to compensate
28.
29. Classical Conditioning
Involves More Than Events
Occurring at the Same Time
• Pavlov’s original explanation for classical conditioning was
that any two events presented in contiguity would produce a
learned association
• Pavlov and his followers believed that the association’s
strength was determined by factors such as the intensity of
the conditioned and unconditioned stimuli
• However, in the mid-1960s, a number of challenges to
Pavlov’s theory suggested that some conditioned stimuli were
more likely than others to produce learning
• Contiguity was not sufficient to create CS-US associations
30. Evolutionary Significance
• Psychologist John Garcia and colleagues showed that certain
pairings of stimuli are more likely to become associated than
others
• conditioned food aversion:the association between eating a
food and getting sick
– Response occurs even if the illness was caused by a virus or some
other condition
– Especially likely to occur if the food was not part of the person’s usual
diet. A food aversion can be formed in one trial
• Animals that associate a certain flavor with illness, and
therefore avoid that flavor, are more likely to survive and pass
along their genes
31. Evolutionary Significance
• Learned adaptive responses may reflect the survival
value that different auditory and visual stimuli have
based on potential dangers associated with the
stimuli
• What evolutionary value do you see in this learned
behavior?
• Biological preparedness: Psychologist Martin
Seligman (1970) argued that animals are genetically
programmed to fear specific objects
• People are predisposed to wariness of outgroup
members (Olsson, Ebert, Banaji, & Phelps, 2005)
32.
33.
34. Learning Involves Cognition
• Classical conditioning is a way that animals come to
predict the occurrence of events—which prompted
psychologists to take a cognitive perspective on
learning
• Robert Rescorla argued that for learning to take
place, the conditioned stimulus must accurately
predict the unconditioned stimulus
• Rescorla-Wagner model: states that the strength of
the CS-US association is determined by the extent to
which the unconditioned stimulus is unexpected or
surprising
35. Learning Involves Cognition
• Other aspects of classical conditioning
consistent with the Rescorla-Wagner model:
– Orienting response: occurs when an animal
encounters a novel stimulus
– Blocking effect: once a conditioned stimulus is
learned, it can prevent the acquisition of a new
conditioned stimulus
– Occasion setter: a stimulus associated with a CS
that acts as a trigger for the CS
36.
37. Critical Thinking Skill:
Avoiding the Association of Events
with Other Events That Occur
at the Same Time
• People, and apparently other animals, have a
strong need to understand what causes or
predicts events. Their resulting associations
can lead people to cling to superstitions
• What misfortunes could actually occur in the
situations shown on the following slide?
38.
39.
40. 6.2 How Does Operant Conditioning
Differ from Classical Conditioning?
• Define operant conditioning.
• Distinguish between positive reinforcement,
negative reinforcement, positive punishment,
and negative punishment.
• Distinguish between schedules of
reinforcement.
• Identify biological and cognitive factors that
influence operant conditioning.
41. 6.2 How Does Operant Conditioning
Differ from Classical Conditioning?
• Operant (instrumental) conditioning: a learning process in
which the consequences of an action determine the likelihood
that it will be performed in the future
• B. F. Skinner chose the term operant to express the idea that
animals operate on their environments to produce effects.
• Edward Thorndike performed the first reported carefully
controlled experiments in comparative animal psychology
using a puzzle box.
– Law of Effect: Any behavior that leads to a “satisfying state of affairs”
is likely to occur again, and any behavior that leads to an “annoying
state of affairs” is less likely to occur again.
42.
43.
44.
45. Reinforcement Increases Behavior
• Thirty years after Thorndike, Skinner developed a
more formal learning theory based on the law of
effect
• He objected to the subjective aspects of Thorndike’s
law of effect: States of “satisfaction” are not
observable empirically
• Skinner believed that behavior occurs because it has
been reinforced
– reinforcer: a stimulus that follows a response and
increases the likelihood that the response will be repeated
46. The Skinner Box
• An operant chamber that allowed repeated
conditioning trials without requiring
interaction from the experimenter
• Contained one lever connected to a food
supply and another connected to a water
supply
47.
48.
49. Shaping
• Sometimes animals take a long time to perform the
precise desired action. What can be done?
• Shaping: an operant-conditioning technique that
consists of reinforcing behaviors that are increasingly
similar to the desired behavior
– successive approximations: anybehavior that even slightly
resembles the desired behavior
• Suppose you wanted to teach yourself to do
something. Which behavior would you choose, and
how would you go about shaping it?
50. Reinforcers Can Be Conditioned
• primary reinforcers: satisfy biological needs
such as food or water
• secondary reinforcers: events or objects
established through classical conditioning that
serve as reinforcers but do not satisfy
biological needs, e.g. money or compliments
51. Reinforcer Potency
• David Premack theorized about how a reinforcer’s
value could be determined
• The key is the amount of time an organism, when
free to do anything, engages in a specific behavior
associated with the reinforcer
• Premack principle: Using a more valued activity can
reinforce the performance of a less valued activity
– How do you think you could use this principle on yourself?
52. Both Reinforcement and Punishment
Can Be Positive or Negative
• Reinforcement and punishment have the opposite
effects on behavior
– Reinforcement increases a behavior’s probability
– Punishment decreases its probability
• Both reinforcement and punishment can be positive
or negative
• This designation depends on whether something is
given or removed, not on whether any part of the
process is good or bad
53. Positive and Negative Reinforcement
• Reinforcement — positive or negative —
increases the likelihood of a behavior
– positive reinforcement: the administration of a
stimulus to increase the probability of a behavior’s
being repeated, e.g. a reward
– negative reinforcement: the removal of a stimulus
to increase the probability of a behavior’s being
repeated, e.g. requiring a rat to press a lever to
turn off a shock
54. Positive and Negative Punishment
• Punishment reduces the probability that a
behavior will recur
– positive punishment: the administration of a
stimulus to decrease the probability of a
behavior’s recurring, e.g. receiving a ticket for
speeding
– negative punishment: the removal of a stimulus
to decrease the probability of a behavior’s
recurring, e.g. taking away driving privileges for
bad behavior
55. Effectiveness of Parental Punishment
• For punishment to be effective, it must be reasonable,
unpleasant, and applied immediately so that the relationship
between the unwanted behavior and the punishment is clear
– How might this go wrong?
• Punishment often fails to offset the reinforcing aspects of the
undesired behavior
• Research indicates that physical punishment is often
ineffective, compared with grounding and time-outs
• Many psychologists believe that positive reinforcement is the
most effective way of increasing desired behaviors while
encouraging positive parent/child bonding
56.
57. Operant Conditioning is Influenced by
Schedules of Reinforcement
• How often should reinforcers be given?
• continuous reinforcement: a type of learning
in which behavior is reinforced each time it
occurs
• partial reinforcement: a type of learning
inwhich behavior is reinforced intermittently
• Partial reinforcement’s effect on conditioning
depends on the reinforcement schedule
58. Ratio and Interval Schedules
• Partial reinforcement can be administered
according to either the number of behavioral
responses or the passage of time
– ratio schedule: Reinforcement is based on the
number of times the behavior occurs
– interval schedule: Reinforcement is provided after
a specific unit of time
• Ratio reinforcement generally leads to greater
responding than does interval reinforcement
59. Fixed and Variable Schedules
• Partial reinforcement can also be given on a
fixed schedule or a variable schedule
– fixed schedule: Reinforcement is provided after a
specific number of occurrences or after a specific
amount of time
– variable schedule: Reinforcement is provided at
different rates or at different times
60.
61. Behavioral Persistence
• Continuous reinforcement is highly effective for
teaching a behavior. If the reinforcement is stopped,
however, the behavior extinguishes quickly
• variable-ratio schedule: persistent behavior thatonly
sometimesresults in reward
• partial-reinforcement extinction effect: Behavior is
more persistent under partial reinforcement than
under continuous reinforcement
– Can this explain why gambling is so addictive?
62. Psychology: Knowledge You Can Use—
Can Behavior Modification Help Me
Stick with an Exercise Program?
• Consider these steps:
– Identify a behavior you wish to change
– Set goals
– Monitor your behavior
– Select a reinforcer and decide on a reinforcement
schedule
– Reinforce the desired behavior
– Modify your goals, reinforcements, or
reinforcement schedules, as needed
63. Behavior Modification
• Behavior modification: the use of operantconditioning techniques to eliminate
unwanted behaviors and replace them
withdesirable ones
• Token economies operate on the principle of
secondary reinforcement. Tokens are earned
for completing tasks and lost for bad behavior.
Tokens can later be traded for objects or
privileges
64. Biology and Cognition Influence
Operant Conditioning
• Behaviorists such as Skinner believed that all
behavior could be explained by
straightforward conditioning principles
• However, a great deal about behavior remains
unexplained
• Biology constrains learning, and reinforcement
does not always have to be present for
learning to take place
65. Biological Constraints
• Animals have a hard time learning behaviors that run
counter to their evolutionary adaptation
• Marian and Keller Breland used operant-conditioning
techniques to train animals but ran into difficulty
when the tasks were incompatible with innate
adaptive behaviors
• Conditioning is most effective when the association
between the response and the reinforcement is
similar to the animal’s built-in predispositions
– For example, Bolles argued that animals have built-in
defense reactions to threatening stimuli
66. Acquisition/Performance Distinction
• Tolman argued that learning can take place without
reinforcement
– latent learning: takes place in the absence of reinforcement
– insight learning: A solution suddenly emerges after either a period of
inaction or of contemplation
• Tolman’s studies involved rats running through mazes
– cognitive map: a visual/spatial mental representation of an
environment
• The presence of reinforcement does not adequately explain
insight learning, but it helps determine whether the behavior
is subsequently repeated
67.
68. 6.3 Does Watching Others
Affect Learning?
• Describe the concept of the meme.
• Define observational learning.
• Generate examples of observational learning,
modeling, and vicarious learning.
• Discuss contemporary evidence regarding the
role of mirror neurons in learning.
69. 6.3 Does Watching Others
Affect Learning?
• Teaching someone to perform a complex task
requires more than reinforcing arbitrary
correct behaviors.
• We learn many behaviors, including attitudes,
through observation.
70. Learning Can Be Passed On
through Cultural Transmission
• Meme: a unit of knowledge transmitted
within a culture
• Memes can be conditioned through
association or reinforcement, but are often
learned by watching the behavior of other
people
• Through social learning, some behaviors are
passed along from one generation to the next
71. Learning Can Occur
through Observation and Imitation
• Observational learning: the acquisition or
modification of a behavior after exposure to at
least one performance of that behavior
• Observational learning is a powerful adaptive
tool for humans and other animals
– Can you think of some examples of observational
learning in animals?
72. Bandura’s Observational Studies
• Bandura’s studies suggest that exposing
children to violence may encourage them to
act aggressively
73.
74. Media and Violence
• The extent to which media violence impacts
aggressive behavior in children is debated
• Some studies demonstrate desensitization to
violence after exposure to violent video games
• However, it is difficult to draw the line between
“playful” and “aggressive” behaviors in children
• There may be extraneous variables that affect both
TV habits AND violent tendencies
• Based on what you have just learned, how might
media impact behavior?
75.
76. Social Learning of Fear
• Susan Mineka noticed that lab-reared
monkeys were not afraid of snakes the way
monkeys in the wild are
• Her research demonstrated that animals’ fears
can be learned through observation
• Social forces play a role in fear-learning in
humans too
77.
78. Demonstration and Imitation
• modeling: the imitation of behavior through
observational learning
• Modeling is effective only if the observer is
physically capable of imitating the behavior
• Imitation is much less common in nonhuman
animals than in humans
• Adolescents who associate smoking with
admirable figures are more likely to begin
smoking
79.
80. Vicarious Reinforcement
• vicarious learning: learning the consequences
of an action by watching others being
rewarded or punished for performing the
action
• A key distinction in learning is between the
acquisition of a behavior and its performance
• In other words, learning a behavior does not
necessarily lead to performing that behavior
81. Mirror Neurons
• What happens in the brain during imitation learning?
• mirror neurons: neurons that are activated when one
observes another individual engaging in an action and when
one performs the action that was observed
• May serve as the basis of imitation learning, but the firing of
mirror neurons does not always lead to imitative behavior
• May be the neural basis for empathy and play a role in
humans’ ability to communicate through language
• Debatable if brain activity reflects prior learning rather than
imitation
82. 6.4 What Is the Biological
Basis of Learning?
• Discuss the role of dopamine and the nucleus
accumbens in the experience of
reinforcement.
• Define habituation, sensitization, and longterm potentiation.
• Describe the neural basis of habituation,
sensitization, long-term potentiation, and fear
conditioning.
83. 6.4 What Is the Biological
Basis of Learning?
• When animals and people learn, what
changes in the brain?
• Researchers are rapidly identifying the
neurophysiological basis of learning.
• Similar brain activity occurs for most
rewarding experiences.
84. Dopamine Activity
Underlies Reinforcement
• Positive reinforcement works in two ways:
– provides the subjective experience of pleasure
– increases wanting for the object or event that
produced the reward
• The neurotransmitter dopamine is involved in
addictive behavior and plays an important role
in reinforcement
85. Pleasure Centers
• intracranial self-stimulation: self-administered shock to
pleasure centers of the brain
• Starving rats prefer ICSS to food over 80 percent of the time
• The neural mechanisms underlying both ICSS and natural
reward appear to use the same neurotransmitter: dopamine
• This suggests dopamine serves as the neurochemical basis of
positive reinforcement in operant conditioning
• Interfering with dopamine eliminates self-stimulation as well
as naturally motivated behaviors
86.
87. Dopamine and Reward
• The nucleus accumbens is a subcortical brain region that is part of the
limbic system
• More dopamine is released under deprived conditions than under
nondeprivedconditions
– Do you have the intuition that food tastes better when you are
hungry?
• In operant conditioning, dopamine release sets the value of a reinforcer,
and blocking dopamine decreases reinforcement
– Dopamine blockers are can also help people with Tourette’s
syndrome regulate their involuntary body movements
• Robinson and Berridge (1993) introduced an important distinction
between the wanting and liking aspects of reward
– For example, a smoker may want a cigarette but not especially
enjoy it
• Dopamine appears to be especially important in wanting a reward
88.
89. Secondary Reinforcers
Also Rely on Dopamine
• Natural reinforcers appear to signal dopamine
reward directly
• Secondary reinforcers at first fail to trigger
dopamine release but may do so readily after
they are paired with unconditioned stimuli
• Money is a secondary reinforcer that activates
dopamine systems
90. Habituation and Sensitization
Are Simple Models of Learning
• Kandel’s work on the aplysia has shown that
habituation and sensitization, two simple
forms of learning, occur through alteration in
neurotransmitter release
– habituation: a decrease in behavioral response
after repeated exposure to a nonthreatening
stimulus
– sensitization: an increase in behavioral response
after exposure to a threatening stimulus
91. Long Term Potential Is a Candidate
for the Neural Basis of Learning
• long-term potentiation (LTP): the strengthening of a
synaptic connection, making the postsynaptic
neurons more easily activated
• Through LTP, intense stimulation of neurons
strengthens synapses, increasing the likelihood that
one neuron’s activation will increase the firing of
other neurons
• LTP effects are most easily observed in brain sites
known to be involved in learning and memory, such
as the hippocampus
• Research has also supported Hebb’s rule that
neurons that fire together wire together
92. LTP and the NMDA Receptor
• LTP occurs when NMDA receptors are
stimulated by nearby neurons
• Joseph Tsien modified genes in mice to make
the genes’ NMDA receptors more efficient
• Tsein’s “Doogie Mice” learned novel tasks
quicker and showed increased fear
conditioning
93.
94.
95. Fear Conditioning
• LTP in the amygdala appears to play a role in fear
conditioning
• Joseph LeDoux’s research suggests that
fearconditioning might produce long-lasting learning
through the induction of LTP
• Heightened activity in the amygdala, when subjects
watched another person’s distress, suggests that
similar mechanisms are involved in conditioned and
observational fear learning
Editor's Notes
6.1 What Ideas Guide the Study of Learning?Learning Results from Experience Behavioral Responses Are ConditionedPavlov’s ExperimentsAcquisition, Extinction, and Spontaneous RecoveryGeneralization, Discrimination, and Second Order ConditioningPhobias and Addictions Have Learned Components Phobias and their TreatmentDrug Addiction Classical Conditioning Involves More Than Events Occurring at the Same TimeEvolutionary SignificanceLearning Involves Cognition Critical Thinking Skill: Avoiding the Association of Events with Other Events That Occur at the Same TimeSumming Up: What Ideas Guide the Study of Learning?Measuring Up
6.1 What Ideas Guide the Study of Learning?Learning Results from Experience Behavioral Responses Are ConditionedPavlov’s ExperimentsAcquisition, Extinction, and Spontaneous RecoveryGeneralization, Discrimination, and Second Order ConditioningPhobias and Addictions Have Learned Components Phobias and their TreatmentDrug Addiction Classical Conditioning Involves More Than Events Occurring at the Same TimeEvolutionary SignificanceLearning Involves Cognition Critical Thinking Skill: Avoiding the Association of Events with Other Events That Occur at the Same TimeSumming Up: What Ideas Guide the Study of Learning?Measuring Up
6.2 How Does Operant Conditioning Differ from Classical Conditioning?Reinforcement Increases BehaviorThe Skinner BoxShaping Reinforcers Can Be ConditionedReinforcer PotencyBoth Reinforcement and Punishment Can Be Positive or Negative Positive and Negative Reinforcement Positive and Negative PunishmentEffectiveness of Parental PunishmentOperant Conditioning is Influenced by Schedules of Reinforcement Ratio and Interval SchedulesFixed and Variable Schedules Behavioral Persistence Psychology: Knowledge You Can Use—Can Behavior Modification Help Me Stick with an Exercise Program? Behavior ModificationBiology and Cognition Influence Operant Conditioning Biological ConstraintsAcquisition/Performance Distinction Summing Up: How Does Operant Conditioning Differ from Classical Conditioning?Measuring Up
6.2 How Does Operant Conditioning Differ from Classical Conditioning?Reinforcement Increases BehaviorThe Skinner BoxShaping Reinforcers Can Be ConditionedReinforcer PotencyBoth Reinforcement and Punishment Can Be Positive or Negative Positive and Negative Reinforcement Positive and Negative PunishmentEffectiveness of Parental PunishmentOperant Conditioning is Influenced by Schedules of Reinforcement Ratio and Interval SchedulesFixed and Variable Schedules Behavioral Persistence Psychology: Knowledge You Can Use- Can Behavior Modification Help Me Stick with an Exercise Program? Behavior ModificationBiology and Cognition Influence Operant Conditioning Biological ConstraintsAcquisition/Performance Distinction Summing Up: How Does Operant Conditioning Differ from Classical Conditioning?Measuring Up
6.3 Does Watching Others Affect Learning? Learning Can Be Passed On through Cultural TransmissionLearning Can Occur through Observation and ImitationBandura’s Observational StudiesMedia and ViolenceSocial Learning of FearDemonstration and ImitationVicarious Reinforcement Mirror NeuronsSumming Up: Does Watching Others Affect Learning? Measuring Up
6.3 Does Watching Others Affect Learning? Learning Can Be Passed On through Cultural TransmissionLearning Can Occur through Observation and ImitationBandura’s Observational StudiesMedia and ViolenceSocial Learning of FearDemonstration and ImitationVicarious Reinforcement Mirror NeuronsSumming Up: Does Watching Others Affect Learning? Measuring Up
6.4 What Is the Biological Basis of Learning?Dopamine Activity Underlies ReinforcementPleasure SensorsDopamine and RewardSecondary Reinforcers Also Rely on Dopamine Habituation and Sensitization Are Simple Models of LearningLong Term Potential Is a Candidate for the Neural Basis of LearningLTP and the NMDA ReceptorFear Conditioning Summing Up: What Is the Biological Basis of Learning?Measuring Up
6.4 What Is the Biological Basis of Learning?Dopamine Activity Underlies ReinforcementPleasure SensorsDopamine and RewardSecondary Reinforcers Also Rely on Dopamine Habituation and Sensitization Are Simple Models of LearningLong Term Potential Is a Candidate for the Neural Basis of LearningLTP and the NMDA ReceptorFear Conditioning Summing Up: What Is the Biological Basis of Learning?Measuring Up