The document discusses concepts from B.F. Skinner's work on operant conditioning including reinforcement schedules. It defines shaping as reinforcing successive approximations towards a desired behavior. It also discusses different types of reinforcement schedules such as continuous, fixed ratio, variable ratio, fixed interval, and variable interval. Delayed reinforcement is discussed in relation to the marshmallow test which found children able to delay gratification tend to be more successful.

2. October 23
Thorndike
Skinner
Reinforcement
Cognition and Learning
Reading/Class Quiz: Thursday,
read/review p. 247-256
Optional Experiment, due Friday

3. B.F. Skinner

5. Operant chamber (Skinner Box)

6. Operant chamber (Skinner Box)

7. A pigeon turning
• SHAPING—an operant conditioning
procedure in which successive
approximations of a desired outcome are
reinforced
• SUCCESSIVE APPROXIMATIONS—
behaviors that are ordered in terms of
increasing similarity or closeness to the
desired outcome

8. Reinforcers: Immediate vs.
Delayed?

10. Immediate vs. Delayed
Immediate Reinforcers vs.
Delayed Reinforcers: Walter
Mischel developed the
"Marshmallow Test" in the late
1960's and found children who
are able to delay gratification
tend to become socially
competent and high-achieving
adults (1989).

11. Reinforcement Schedules

12. Types of Reinforcement
• CONTINUOUS
• INTERMITTENT
–
–
–
–
Fixed ratio
Variable ratio
Fixed interval
Variable interval

14. Reinforcement
• CONTINUOUS—a reinforcer for each
and every correct response/behavior
• INTERMITTENT
–
–
–
–
Fixed ratio
Variable ratio
Fixed interval
Variable interval

15. Types of Reinforcement
• CONTINUOUS—a reinforcer for each
and every correct response/behavior
• INTERMITTENT (Partial)—the
tendency for a response that is reinforced
after some, but not all, correct responses
–
–
–
–
Fixed ratio
Variable ratio
Fixed interval
Variable interval

16. •
INTERMITTENT (Partial)—the tendency for a response that is
reinforced after some, but not all, correct responses
– Fixed ratio—schedule of reinforcement in
which the NUMBER OF RESPONSES
required for reinforcement is ALWAYS THE
SAME
– Variable ratio
– Fixed interval
– Variable interval

17. •
INTERMITTENT (Partial)—the tendency for a response that is
reinforced after some, but not all, correct responses
– Fixed ratio—schedule of reinforcement in which the NUMBER
OF RESPONSES required for reinforcement is ALWAYS THE
SAME
– Variable ratio—schedule of
reinforcement in which the NUMBER
OF RESPONSES required for
reinforcement is DIFFERENT for each
trial or event
– Fixed interval
– Variable interval

18. •
INTERMITTENT (Partial)—the tendency for a response that is
reinforced after some, but not all, correct responses
– Fixed ratio—schedule of reinforcement in which the NUMBER
OF RESPONSES required for reinforcement is ALWAYS THE
SAME
– Variable ratio—schedule of reinforcement in which the
NUMBER OF RESPONSES required for reinforcement is
DIFFERENT for each trial or event
– Fixed interval—schedule of
reinforcement in which the interval of
time that must pass before
reinforcement becomes possible is
always the same
– Variable interval

19. •
INTERMITTENT (Partial)—the tendency for a response that is reinforced
after some, but not all, correct responses
– Fixed ratio—schedule of reinforcement in which the NUMBER OF
RESPONSES required for reinforcement is ALWAYS THE SAME
– Variable ratio—schedule of reinforcement in which the NUMBER OF
RESPONSES required for reinforcement is DIFFERENT for each trial
or event
– Fixed interval—schedule of reinforcement in which the interval of time
that must pass before reinforcement becomes possible is always the
same
– Variable interval—schedule of
reinforcement in which the interval of
time that must pass before
reinforcement becomes possible is
different for each trial or event