Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

092408 324 Lecture


Published on

A series of lectures on issues related to human learning.

  • Be the first to comment

092408 324 Lecture

  1. 1. CEDP 324 Human Learning
  2. 2. Classical Conditioning Applications <ul><li>Little Albert </li></ul><ul><ul><li>Watson and Rayner </li></ul></ul><ul><ul><li>Exposed Albert to a white lab rat </li></ul></ul><ul><ul><ul><li>Child played with the rat – displaying no fear </li></ul></ul></ul><ul><ul><ul><li>NS = Rat </li></ul></ul></ul><ul><ul><li>He then made a loud sound as Albert touched the rat </li></ul></ul><ul><ul><ul><li>CS = Rat; US = hammer strike on steel </li></ul></ul></ul><ul><ul><li>This made albert cry in the presence of the rat </li></ul></ul><ul><ul><li>And other white furry items </li></ul></ul><ul><ul><li>They never extinguished the response </li></ul></ul>
  3. 3. More on fear - treatment <ul><li>You can also treat fears using classical conditioning </li></ul><ul><ul><li>Fear existed for rabbits </li></ul></ul><ul><ul><li>Slow exposure at closer intervals – to the rabbit </li></ul></ul><ul><ul><li>Paired with food as well </li></ul></ul><ul><ul><li>An example of counterconditioning (exposure therapy – systematic desensitization) </li></ul></ul><ul><li>Hate! </li></ul>
  4. 4. Aversion therapy <ul><li>Paraphilia treatment </li></ul><ul><ul><li>Pair inappropriate sexual arousal with an unpleasant experience </li></ul></ul>
  5. 5. Natural Selection <ul><li>What is it? </li></ul><ul><ul><li>Survival of the fittest? </li></ul></ul><ul><ul><li>Survival of the most fit? </li></ul></ul><ul><ul><li>Survival of the fit enough? </li></ul></ul><ul><li>Variation in species </li></ul><ul><ul><li>Some variation is better suited for the conditions than other variations </li></ul></ul><ul><ul><li>Favorable ones are able to reproduce </li></ul></ul><ul><li>THE ENVIRONMENT DOES THE SELECTING </li></ul><ul><ul><li>The organism does not have a choice in the matter </li></ul></ul>
  6. 6. Natural Selection and Moral Value <ul><li>Natural Selection is neither good or bad </li></ul><ul><li>A given environment may select a given trait - but as the environment changes, that trait may become undesirable and the species less fit </li></ul><ul><li>Some selected traits may have negative and positive effects </li></ul>
  7. 7. Natural Selection - examples <ul><li>The Blind Watchmaker </li></ul><ul><li>The peppered moth </li></ul><ul><ul><li>Humans caused a change in environment </li></ul></ul><ul><ul><li>Predators did the selecting </li></ul></ul><ul><li>Rock pocket mouse </li></ul><ul><ul><li>Owls did the selecting </li></ul></ul>
  8. 8. Natural Selection, Creationism, Evolution - MYTHS <ul><li> </li></ul><ul><li>Please review all articles in this area </li></ul>
  9. 9. Natural Selection in other forms <ul><li>There are two more levels of natural selection </li></ul><ul><li>One that happens on a cultural level </li></ul><ul><ul><li>Selection of behavior in a society – this leads to customs, etc. </li></ul></ul><ul><li>One that happens on an individual level </li></ul><ul><ul><li>You learn to do a given behavior in a given environment and not in others </li></ul></ul>
  10. 10. How has natural selection prepared us? <ul><li>Reflexes </li></ul><ul><ul><li>A relationship between an event and a behavior </li></ul></ul><ul><ul><ul><li>They serve some function to the organism </li></ul></ul></ul><ul><ul><ul><ul><li>Dust in your eye – you blink (protective function) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Too much tequila – you vomit (protective function) </li></ul></ul></ul></ul><ul><ul><li>The key here is the relationship (not the behavior itself)! </li></ul></ul><ul><ul><li>Occur in nearly all members of the species and appear at predictable developmental stages. </li></ul></ul><ul><ul><li>They may not be useful to the organism </li></ul></ul>
  11. 11. Reflexes – can be modified <ul><li>Sensitization – eliciting a response may increase the probability of the response to stimuli </li></ul><ul><ul><ul><li>Loud sounds </li></ul></ul></ul><ul><li>Habituation – evoking a given reflex response repeatedly will result in a reduction in the intensity or probability of that response </li></ul><ul><ul><ul><li>Loud sounds </li></ul></ul></ul>
  12. 12. Modal Action Patterns <ul><li>Similar to reflexes </li></ul><ul><ul><li>Found in nearly all members of a species </li></ul></ul><ul><ul><li>Strong genetic basis </li></ul></ul><ul><ul><li>Elicited by “releasing stimuli” </li></ul></ul><ul><li>Different than reflexes </li></ul><ul><ul><li>Involve the entire organism </li></ul></ul><ul><ul><li>More variability in the actual behavior </li></ul></ul><ul><li>Examples: </li></ul><ul><ul><li>Cats confronting a dog </li></ul></ul><ul><ul><li>Migration in a “v” formation </li></ul></ul>
  13. 13. General Behavior Traits <ul><li>Current thinking is that humans probably don’t have MAPs or Instincts </li></ul><ul><li>We do have GBTs </li></ul><ul><li>Wide range of stimuli elicit a wide range of responses – aversives and aggression </li></ul>
  14. 14. Evolved Modifiability <ul><li>Learning! </li></ul><ul><li>What changes when learning occurs is behavior. </li></ul><ul><ul><li>Behavior is a reliable measure </li></ul></ul><ul><li>What changes behavior is experience </li></ul><ul><ul><li>Stimuli – anything that can be detected </li></ul></ul><ul><li>Learning was selected for </li></ul><ul><li>Learning increases survival rate </li></ul>
  15. 15. Studying Learning <ul><li>Only been studying learning scientifically for about 100 years. </li></ul><ul><li>Explanations must refer to physical events </li></ul><ul><ul><li>Identifying the events that produce something </li></ul></ul><ul><ul><li>Falling bodies – greeks – “need to return to it’s natural place” </li></ul></ul><ul><li>We must avoid circular arguments </li></ul><ul><ul><li>Bob doesn’t work because he’s lazy </li></ul></ul><ul><ul><li>He’s lazy cause he doesn’t work </li></ul></ul>
  16. 16. Operational Definitions <ul><li>Must define behavior in terms of how to measure it </li></ul><ul><ul><li>Lever press </li></ul></ul><ul><ul><li>Key pecking </li></ul></ul><ul><ul><li>Running a maze </li></ul></ul><ul><li>Defining feeling and thinking in operational terms </li></ul><ul><li>Must be observable </li></ul>
  17. 17. Measuring learning <ul><li>How do we measure learning? </li></ul><ul><li>If defined incorrectly, we may not observe learning when it is happening </li></ul><ul><ul><li>Maze completion vs. errors </li></ul></ul><ul><li>Examples of ways to measure: </li></ul><ul><ul><li>Learning as error reduction (ebbinghaus) </li></ul></ul><ul><ul><li>Learning as a change in topography (mirror art) </li></ul></ul><ul><ul><li>Learning as intensity of behavior (strength, etc) </li></ul></ul><ul><ul><li>Learning as speed </li></ul></ul><ul><ul><li>Learning as latency (time from stimulus to response </li></ul></ul><ul><ul><li>Learning as a rate </li></ul></ul><ul><ul><li>Learning as fluency (errors and rate) </li></ul></ul>
  18. 18. Measuring learning <ul><li>How? What do we use? </li></ul><ul><li>Cumulative recorder </li></ul><ul><ul><li>Instances of behavior recorded and plotted with time to produce a rate </li></ul></ul><ul><li>Computers </li></ul><ul><li>Stop watches </li></ul><ul><li>Exam scores </li></ul>
  19. 19. Research Designs <ul><li>Anecdotal Evidence </li></ul><ul><ul><li>First or secondhand reports of personal experience </li></ul></ul><ul><ul><li>Not scientifically sound but provide research questions and areas of further study </li></ul></ul><ul><li>Case Study </li></ul><ul><ul><li>A highly detailed analysis of a person or problem </li></ul></ul><ul><ul><li>No ability to detect cause </li></ul></ul><ul><li>Descriptive Study </li></ul><ul><ul><li>More representative than a case study </li></ul></ul><ul><ul><li>Still no experimental control </li></ul></ul><ul><ul><li>Cannot detect cause – they are correlational in nature </li></ul></ul>
  20. 20. Experiments <ul><li>Researcher manipulates one or more variables and measures the effect of this manipulation on other variables </li></ul><ul><ul><li>Independent and dependent variables </li></ul></ul><ul><li>Between subjects designs </li></ul><ul><ul><li>Comparing groups </li></ul></ul><ul><ul><li>Random assignment </li></ul></ul><ul><li>Within subjects designs – single subject design </li></ul><ul><ul><li>Comparing a group to itself </li></ul></ul>
  21. 21. Non-human research <ul><li>High levels of control </li></ul><ul><ul><li>Genetic </li></ul></ul><ul><ul><li>Learning </li></ul></ul><ul><li>Ethical reasons </li></ul><ul><ul><li>Cannot do some research on humans </li></ul></ul><ul><li>Objections </li></ul><ul><ul><li>Not ethical </li></ul></ul><ul><ul><li>People are not rats </li></ul></ul><ul><ul><li>No practical value </li></ul></ul><ul><ul><li>IACUC </li></ul></ul>
  22. 22. Explaining behavior <ul><li>Mentalism </li></ul><ul><ul><li>Events happen in the environment – they in turn generate an idea and the idea causes the behavior (the organism decides what to do) </li></ul></ul><ul><li>Natural science approach </li></ul><ul><ul><li>Behavior is caused </li></ul></ul><ul><ul><li>Causes precede their effect </li></ul></ul><ul><ul><li>Only natural phenomena are employed </li></ul></ul><ul><ul><li>parsimony </li></ul></ul>
  23. 23. Classical Conditioning <ul><li>Studying gastric secretions in dogs </li></ul><ul><li>Noticed “psychic secretions” </li></ul><ul><ul><li>Mental events are tied to biological outputs </li></ul></ul><ul><li>Experience altered the actions of the glands </li></ul><ul><ul><li>The gland matched the stimulus </li></ul></ul><ul><ul><li>The gland became active at other stimuli </li></ul></ul>
  24. 24. Classical Conditioning – the process <ul><li>Identified two types of stimuli </li></ul><ul><li>Unconditional responses </li></ul><ul><ul><li>The natural reflex to a stimulus </li></ul></ul><ul><ul><ul><li>permanent </li></ul></ul></ul><ul><li>Conditional responses </li></ul><ul><ul><li>A reflex develops through experience </li></ul></ul><ul><ul><ul><li>Not permanent </li></ul></ul></ul>
  25. 25. Classical Conditioning – the components <ul><li>A stimulus </li></ul><ul><li>A response to that stimulus </li></ul><ul><li>Unconditional reflex </li></ul><ul><ul><li>US  UR </li></ul></ul><ul><li>Conditional reflex </li></ul><ul><ul><li>NS </li></ul></ul><ul><ul><li>CS  CR </li></ul></ul>
  26. 26. Classical Conditioning - Examples <ul><li>Eyeblink conditioning </li></ul><ul><li>Galvanic skin response </li></ul><ul><ul><li>Change in conductivity of the skin </li></ul></ul><ul><ul><li>Increase conductivity when paired with shock </li></ul></ul><ul><li>Commercials </li></ul><ul><li>Sex </li></ul><ul><li>Conditioned suppression </li></ul><ul><ul><li>Suppression of behavior when paired with a shock </li></ul></ul><ul><ul><ul><li>Critter is responding at a given rate – we can suppress it </li></ul></ul></ul><ul><ul><li>Long presentation of the CS followed by shock </li></ul></ul><ul><ul><ul><li>Decrease in responding in the presence of that stimulus (CS) </li></ul></ul></ul><ul><li>Taste aversion learning </li></ul><ul><ul><li>Food (cs) – poison (us) </li></ul></ul><ul><ul><li>Rule out remaining illness </li></ul></ul><ul><ul><ul><li>Two groups – one receives cs and us. One receives us. Measure food eating behavior later – it suppresses. </li></ul></ul></ul>
  27. 27. Classical Conditioning - Trace <ul><li>Trace conditioning </li></ul><ul><ul><li>Present CS – turn it off – allow time – present US </li></ul></ul><ul><ul><li>Term came from a “memory trace” </li></ul></ul><ul><ul><li>As the time interval increases – conditioning decreases </li></ul></ul>
  28. 28. Classical Conditioning - Delay <ul><li>Short – present the CS before the beginning of the US – leave them both on – then turn off at the same time </li></ul><ul><ul><li>For eyeblink – between .5-1 second delay </li></ul></ul><ul><ul><li>Overlap is the key here </li></ul></ul><ul><li>Long – present the CS earlier and for longer – slightly weaker conditioning </li></ul>
  29. 29. Classical Conditioning - Simultaneous <ul><li>Not a very effective method for conditioning </li></ul><ul><li>CS and US coincide at the exact same moments </li></ul><ul><li>Seems to act as a different stimulus (the combination) </li></ul>
  30. 30. Classical conditioning - backward <ul><li>The CS comes on after the US </li></ul><ul><li>Not very effective – if effective at all </li></ul><ul><li>Not efficient </li></ul>
  31. 31. Contingency and Contiguity <ul><li>Contingency is a major key! </li></ul><ul><ul><li>the degree of prediction from the CS to the US effects the amount of conditioning </li></ul></ul><ul><ul><li>Rescorla – p(us/cs) and p(us/no cs) </li></ul></ul><ul><ul><ul><li>Vary these probabilities using a 2 minute tone at random intervals </li></ul></ul></ul><ul><ul><ul><li>.4 that the US would occur during a CS; .2 a US would occur during a noCS </li></ul></ul></ul><ul><ul><ul><li>When the first was higher than the second – you would see suppression </li></ul></ul></ul><ul><li>Contiguity also plays a role </li></ul><ul><ul><li>Interstimulus interval (ISI) – time between the termination of the CS and the onset of the US (trace) </li></ul></ul><ul><ul><li>Time from onset of CS and onset of US (delay) </li></ul></ul><ul><ul><li>Typically the shorter the interval the more effective the conditioning </li></ul></ul><ul><ul><li>The response matters! Taste aversions can have long ISIs and still produce learning, other stimuli are not so effective. </li></ul></ul>
  32. 32. Compound Stimuli <ul><li>Two or more stimuli occurring together (sound and sight - CR) then paired with a US </li></ul><ul><li>Can test the effects of this by presenting one of the CSs alone after pairings </li></ul><ul><li>Often you get conditioning to both </li></ul><ul><li>But not always </li></ul>
  33. 33. Blocking <ul><li>Kamin – conditioned suppression procedure (css = light, tone, light tone; cr = shock) </li></ul><ul><li>Two groups: blocking and control </li></ul><ul><li>One stimulus seems to block conditioning to the other – no new predictability. </li></ul>Group Phase 1 Phase 2 Test Phase Result Blocking 1 Light Light/tone Tone Tone elicits no CR Control ------- Light/tone Tone Tone elicits CR
  34. 34. Overshadowing <ul><li>Intensity of the CS effects conditioning trials </li></ul><ul><li>Loud CS and soft CS  US = CR </li></ul><ul><li>Test with either CS </li></ul><ul><ul><li>+CS = CR </li></ul></ul><ul><ul><li>-CS ≠ CR </li></ul></ul><ul><li>But you can then use the –CS by itself and get conditioning </li></ul><ul><li>One seems to overshadow the other </li></ul>
  35. 35. Experience with the CS <ul><li>Latent inhibition </li></ul><ul><ul><li>Presence of a CS in the absence of the US </li></ul></ul><ul><ul><ul><li>Delays acquisition in the future </li></ul></ul></ul><ul><ul><ul><li>Prediction is decreased </li></ul></ul></ul>
  36. 36. Acquisition Strength of CR Number of trials <ul><li>CR is increasing in strength </li></ul><ul><li>Learn more on early trials than on later ones </li></ul>
  37. 37. Extinction <ul><li>Passage of time has very little effect on strength of CR </li></ul><ul><li>Use extinction to remove or reduce the CR </li></ul><ul><li>Present the CS without the US </li></ul><ul><ul><li>Remember predictability! </li></ul></ul>
  38. 38. Spontaneous Recovery <ul><li>The response returns </li></ul><ul><li>Time between extinction trials will affect this </li></ul><ul><ul><li>The larger the gap the larger the SR </li></ul></ul><ul><li>On each trial you will see less and less SR </li></ul>
  39. 39. Rapid Reacquisition <ul><li>Acquisition – extinction – reacquisition </li></ul><ul><li>With each extinction/reacquisition the organism learns the CR quicker </li></ul>
  40. 40. Generalization and Discrimination <ul><li>Generalizability curve </li></ul><ul><ul><li>Basically a normal curve </li></ul></ul><ul><li>Response to stimuli follows a predicable pattern </li></ul><ul><ul><li>The further away from the original stimuls the less likely the CR will be elicited </li></ul></ul><ul><li>Discrimination </li></ul><ul><ul><li>The above allows for discrimination – to respond to one CS but not a similar NS </li></ul></ul>
  41. 41. Classical Conditioning Apps <ul><li>Little Albert and fear conditioning – watson and raynor </li></ul><ul><ul><li>NS = White rat </li></ul></ul><ul><ul><ul><li>Response was playing </li></ul></ul></ul><ul><ul><li>CS  US (hammer on metal) </li></ul></ul><ul><ul><ul><li>CR = screaming, etc (fear) </li></ul></ul></ul><ul><ul><li>This generalized to other small white furry objects </li></ul></ul><ul><ul><li>Did not extinguish this response </li></ul></ul>
  42. 42. Other applications <ul><li>Paraphilia treatment </li></ul><ul><ul><li>Aversion therapy </li></ul></ul><ul><ul><ul><li>Pairing unpleasant stimuli with inappropriate sexual arousal </li></ul></ul></ul><ul><li>Conditioned taste aversions </li></ul><ul><ul><li>Latent inhibition holds </li></ul></ul><ul><ul><ul><li>New foods are more likely to develop in to taste aversions </li></ul></ul></ul><ul><ul><li>Chemotherapy </li></ul></ul>
  43. 43. More applications <ul><li>Drug Overdosing </li></ul><ul><ul><li>Compensatory conditioned response </li></ul></ul><ul><ul><ul><li>You develop CR to the environment and method of ingestion </li></ul></ul></ul><ul><ul><ul><li>Here’s a case where the CR is different from the UR </li></ul></ul></ul><ul><ul><ul><li>US for taking marijuana is tachycardia (fast heart rate) </li></ul></ul></ul><ul><ul><ul><li>The CS is a friends house. </li></ul></ul></ul><ul><ul><ul><li>You go to the house, your heart rate DROPS (CR = bradycardia) </li></ul></ul></ul><ul><ul><ul><ul><li>You then take the drug </li></ul></ul></ul></ul><ul><ul><ul><li>This is a partial explanation for tolerance </li></ul></ul></ul><ul><ul><ul><li>Effects of a different environment can produce overdosing. </li></ul></ul></ul>
  44. 44. Your experiment <ul><li>In groups of two </li></ul><ul><li>You will classically condition each person to blink their eyes to a CS (of your choosing) </li></ul><ul><li>Need </li></ul><ul><ul><li>CS (preferably something that produces a stable, consistent, repeatable sound) </li></ul></ul><ul><ul><li>Straw </li></ul></ul><ul><ul><li>Table with books </li></ul></ul><ul><li>Procedure </li></ul><ul><ul><li>Use a trace conditioning procedure </li></ul></ul><ul><ul><li>Measure eye blinks (count them) </li></ul></ul><ul><ul><li>Acquisition (until the behavior stabilizes) </li></ul></ul><ul><ul><li>Extinction (until the behavior stabilizes at zero) </li></ul></ul><ul><ul><li>Test for spontaneous recovery </li></ul></ul><ul><li>Write up </li></ul><ul><ul><li>3 total references – two from journal articles (no magazines) – apa 5 </li></ul></ul><ul><ul><li>Introduction </li></ul></ul><ul><ul><li>Method </li></ul></ul><ul><ul><li>Results – include charts </li></ul></ul>
  45. 45. Operant conditioning <ul><li>Eliciting vs. Emitting </li></ul><ul><ul><li>In classical conditioning – responses are elicited from a stimulus </li></ul></ul><ul><ul><ul><li>Think reflex </li></ul></ul></ul><ul><ul><li>In operant – the organism emits a response that is then acted upon by the environment </li></ul></ul><ul><ul><ul><li>Called operant because the behavior operates on the environment and a consequence is produced </li></ul></ul></ul><ul><ul><ul><li>Also called instrumental conditioning </li></ul></ul></ul>
  46. 46. E. L. Thorndike <ul><li>Wanted to study behavior systematically </li></ul><ul><li>Worked frequently with cats </li></ul><ul><ul><li>Hungry cat in a puzzle box </li></ul></ul><ul><ul><li>Could escape by pulling a string or pressing a lever </li></ul></ul><ul><ul><li>Response latency decreased, showing learning </li></ul></ul><ul><li>Developed the law of effect </li></ul><ul><ul><li>Behaviors are stamped in (led to a satisfying state of affairs) or stamped out (unsatisfying or annoying state of affairs) </li></ul></ul>
  47. 47. Law of Effect <ul><li>Focuses on consequences of behavior </li></ul><ul><li>Requires an inference to the state of the organism </li></ul><ul><ul><li>Satisfying </li></ul></ul><ul><ul><li>Unsatisfying or annoying </li></ul></ul><ul><li>Skinner removed the inference and changed the type of responding that was studied (from a discrete trial to a free operant response) </li></ul>
  48. 48. Operant conditioning <ul><li>Behavior seems voluntary in nature </li></ul><ul><li>Behavior is controlled by consequences </li></ul><ul><ul><li>Not by the stimuli that elicit them </li></ul></ul><ul><li>Future probability of a given behavior (or class) is affected by its consequences </li></ul><ul><ul><li>Used probability to get rid of the inference to an organisms state </li></ul></ul><ul><li>Three components </li></ul><ul><ul><li>A response that produces a consequence </li></ul></ul><ul><ul><li>The consequence </li></ul></ul><ul><ul><li>A discriminative stimulus – signals that a certain consequence is now available </li></ul></ul>
  49. 49. Operants and behavior classes <ul><li>Prediction of a specific response is very difficult – so skinner talked about ‘classes’ of behavior. </li></ul><ul><li>It’s easier to predict a class of responses than a specific one </li></ul><ul><li>Behavior tends to be of a ‘class’ of behaviors that produce the same outcome </li></ul><ul><ul><li>Thorndike’s cats could have pressed the lever, sat on the lever, leaned against it, etc. </li></ul></ul><ul><ul><li>Each of these behaviors produce the same outcome hence they are called a class of behavior </li></ul></ul>
  50. 50. Reinforcement <ul><li>Any stimulus added or removed contingent upon a behavior that maintains or increases the strength of the behavior </li></ul><ul><li>The reinforcement matrix </li></ul>Probability of behavior increases Stimulus is Added Positive reinforcement Removed Negative reinforcement
  51. 51. Reinforcement cont. <ul><li>Strength can be defined as: </li></ul><ul><ul><li>Rate, frequency, probability, resistance to extinction </li></ul></ul><ul><ul><li>Increasing strength means that it has a measurable effect on behavior </li></ul></ul><ul><li>But we have to have a behavior first! </li></ul><ul><ul><li>Dead person’s test </li></ul></ul>
  52. 52. Positive Reinforcement <ul><li>Contingently adding a stimulus following a behavior that increases the probability of that behavior occurring in the future </li></ul><ul><ul><li>Strengthening a behavior by adding a stimulus </li></ul></ul><ul><ul><ul><li>Score on a test reinforces studying </li></ul></ul></ul><ul><ul><ul><li>Dog greets you is reinforced by petting </li></ul></ul></ul><ul><li>The positive does not mean good – simply means added </li></ul>
  53. 53. Negative Reinforcement <ul><li>Contingently removing a stimulus following a behavior that increases the probability of that behavior occurring in the future </li></ul><ul><ul><li>Strengthens a behavior by removing a stimulus </li></ul></ul><ul><ul><ul><li>Cutting up money – increase weight loss behavior </li></ul></ul></ul><ul><ul><ul><li>Remove headache – increase aspirin taking </li></ul></ul></ul><ul><ul><li>Negative does not mean bad!!!! </li></ul></ul><ul><ul><li>Often considered escape or avoidance </li></ul></ul><ul><ul><li>Usually these stimuli that you escape or remove are aversive – but that is an inference </li></ul></ul>
  54. 54. Contingency is the key <ul><li>The stimuli must be added or removed CONTINGENT upon a behavior </li></ul><ul><li>Even b will occur if and only if event A occurs. </li></ul>
  55. 55. Types of reinforcers <ul><li>Primary </li></ul><ul><ul><li>Not dependent on their association with other S r </li></ul></ul><ul><ul><li>Food, water, sex, drugs </li></ul></ul><ul><ul><ul><li>Not money! </li></ul></ul></ul><ul><li>Secondary </li></ul><ul><ul><li>Pair a stimulus with one of the above it becomes an S r </li></ul></ul><ul><ul><ul><li>Buzzer paired with water </li></ul></ul></ul>
  56. 56. Complex Behavior through Reinforcement <ul><li>Shaping </li></ul><ul><ul><li>Successive approximations of desired behavior </li></ul></ul><ul><ul><li>Shaping lever pressing in rats </li></ul></ul><ul><ul><ul><li>Secondary sr = sound of pellet dispenser </li></ul></ul></ul><ul><ul><ul><li>Quick, immediate </li></ul></ul></ul><ul><ul><li>Use your clicker! </li></ul></ul><ul><li>Chaining – longer chains can break easier than shorter ones </li></ul><ul><ul><li>Task analysis </li></ul></ul><ul><ul><li>Forward chaining </li></ul></ul><ul><ul><li>Backward chaining </li></ul></ul><ul><ul><li>You can ‘break’ the chain at any link and it won’t continue </li></ul></ul>
  57. 57. Extinction of S r responses <ul><li>Similar to classical </li></ul><ul><li>Behavior followed by no consequence </li></ul><ul><li>Produces an extinction burst </li></ul><ul><li>You also get spontaneous recovery </li></ul><ul><li>Resurgence </li></ul><ul><ul><li>As one response is extinguished – other previously reinforced responses tend to appear </li></ul></ul><ul><ul><ul><li>Asking nicely is getting extinguished. </li></ul></ul></ul><ul><ul><ul><li>The child may then scream (Something they learned as a younger child) </li></ul></ul></ul>
  58. 58. Variables effecting reinforcement <ul><li>Contingency </li></ul><ul><ul><li>Like classical conditioning – as you vary the probability of reinforcement for a given behavior then the behavior varies </li></ul></ul><ul><ul><li>In other words – you’re developing a sort of ‘rule’: if this, then that. </li></ul></ul><ul><li>Contiguity </li></ul><ul><ul><li>The more immediate you can reinforce the better </li></ul></ul><ul><ul><li>Prevents other behavior from being reinforced </li></ul></ul>
  59. 59. Schedules of Reinforcement <ul><li>Ferster and Skinner – 1957 </li></ul><ul><li>A pattern of SR based on numbers of responses, time and or other factors </li></ul><ul><li>Different schedules produce different patters of responding – extremely reliable even across species </li></ul>
  60. 60. Continuous Reinforcement <ul><li>CRF </li></ul><ul><ul><li>Continuous reinforcement </li></ul></ul><ul><ul><li>Great for training </li></ul></ul><ul><ul><li>Not so great for the real world </li></ul></ul><ul><ul><li>Extinguishes fast </li></ul></ul><ul><ul><li>Basically a soda machine </li></ul></ul>
  61. 61. Intermittent Schedules - FR <ul><li>Fixed ratio </li></ul><ul><ul><li>Sr is delivered after a fixed number of responses </li></ul></ul><ul><ul><ul><li>The post reinforcer pause </li></ul></ul></ul><ul><ul><ul><ul><li>Tenure, piece work, exam taking? </li></ul></ul></ul></ul><ul><ul><ul><ul><li>The pause increases as the ratio increases </li></ul></ul></ul></ul><ul><ul><ul><li>Rapid responding otherwise </li></ul></ul></ul><ul><ul><ul><li>Ratio strain – organism takes breaks before the SR is delivered </li></ul></ul></ul>
  62. 62. Intermittent Schedules - VR <ul><li>ON average – a given number of responses will be followed by a SR </li></ul><ul><ul><li>VR10 = 1,2,3,4,5,6,10,19,40 </li></ul></ul><ul><ul><li>Produces a strong rate of responding </li></ul></ul><ul><ul><li>No post reinforcer pause </li></ul></ul><ul><ul><ul><li>Except on thin schedules, but the pauses are smaller than FR schedules </li></ul></ul></ul><ul><li>Gambling </li></ul><ul><ul><li>Slot machines </li></ul></ul><ul><ul><li>This is essentially the addiction </li></ul></ul><ul><ul><ul><li>Strong steady rate of behavior </li></ul></ul></ul><ul><li>Sports </li></ul><ul><ul><li>A good day in golf is essentially random </li></ul></ul><ul><ul><li>You don’t know if that next shot will be the best shot of your life! </li></ul></ul>
  63. 63. Intermittent schedules – Fixed interval <ul><li>After a fixed amount of time has passed the next response will be reinforced </li></ul><ul><ul><li>Could produce very low rates of responding </li></ul></ul><ul><ul><ul><li>Perfect timing or a clock </li></ul></ul></ul><ul><li>There is a post reinforcer pause </li></ul><ul><ul><li>Follwed by a slow acceleration of responding rate </li></ul></ul><ul><ul><li>The fixed interval scallop </li></ul></ul><ul><li>Waiting for a bus </li></ul><ul><ul><li>Reading the paper for 5 or 10 min – look up once </li></ul></ul><ul><ul><li>Next minute look up once, then twice and so on </li></ul></ul>
  64. 64. Intermittent Schedules – Variable Interval <ul><li>Average amount of time passes, the next response is followed by an SR </li></ul><ul><ul><li>1,2,3,4,5,6,10,19,40 </li></ul></ul><ul><li>Steady rate of responding </li></ul><ul><li>No PRP </li></ul><ul><li>Checking the mail </li></ul>
  65. 65. Other schedules <ul><li>DRA (alternative), DRI (incompatible), DR0 (zero), DRH (behavior a minimum number of times) </li></ul><ul><li>Fixed duration – set time then get SR </li></ul><ul><ul><li>Studying </li></ul></ul><ul><li>Fixed time </li></ul><ul><ul><li>Reinforcer delivered after a set amount of time – regardless of behavior </li></ul></ul><ul><ul><li>Similar to welfare </li></ul></ul>
  66. 66. Complex schedules <ul><li>Multiple schedules </li></ul><ul><ul><li>Behavior is under the influence of two ore more simple schedules, each associated with a stimulus </li></ul></ul><ul><ul><li>Red light = VI10 green light = FI5 </li></ul></ul><ul><ul><ul><li>Two schedules alternate on the same key </li></ul></ul></ul><ul><ul><ul><li>Good for studying stimulus control </li></ul></ul></ul><ul><li>Mixed schedules </li></ul><ul><ul><li>Same as above – but no SD. </li></ul></ul><ul><li>Chain schedule </li></ul><ul><ul><li>Sr is delivered on the completion of the last in a series of schedules </li></ul></ul><ul><ul><li>Red disk (FR 10) changes after the 10 th response, to yellow disk (FI 15) after the response it changes again to green on a VR 20. The last peck is then reinforced. </li></ul></ul><ul><li>Concurrent schedules </li></ul><ul><ul><li>Two ore more schedules available at a given time </li></ul></ul><ul><ul><li>Great for studying choice </li></ul></ul><ul><li>Cooperative schedules </li></ul><ul><ul><li>Two organisms working on different or same schedules – but SR for either is dependent on both </li></ul></ul><ul><ul><ul><li>Total of 100R between both birds – then both receive SR </li></ul></ul></ul><ul><ul><ul><li>Both must make at least 10 before either gets SR though </li></ul></ul></ul>
  67. 67. Punishment <ul><li>Still operant conditioning </li></ul><ul><li>Contingency is equally as important </li></ul><ul><li>The punishment chart: </li></ul>Probability of behavior decreases Stimulus is Added Positive Punishment Removed Negative Punishment
  68. 68. Punishment cont. <ul><li>Contiguity is also important </li></ul><ul><ul><li>The longer the delay – the less effective the punisher </li></ul></ul><ul><li>Intensity is also important </li></ul><ul><ul><li>Use a stimulus that is only as strong as you need it to be </li></ul></ul>
  69. 69. Positive punishment <ul><li>Contingently adding a stimulus following a behavior that decreases the probability of that behavior occurring in the future </li></ul><ul><li>Again – there is no good and bad here </li></ul><ul><ul><li>You are adding a stimulus (spank, noise, etc) </li></ul></ul><ul><ul><li>It is usually a stimulus the organism finds aversive </li></ul></ul>
  70. 70. Negative Punishment <ul><li>Contingently removing a stimulus following a behavior that decreases the probability of that behavior occurring in the future </li></ul><ul><ul><li>Response cost </li></ul></ul><ul><ul><li>Things taken away – grounding </li></ul></ul>
  71. 71. Punishment - more <ul><li>Difference between SR and SP </li></ul><ul><ul><li>Skinner argues that they are not opposite </li></ul></ul><ul><ul><li>Punishment is temporary and can be thought of as suppression </li></ul></ul><ul><ul><ul><li>Often the behavior will decreases in a long term sense though </li></ul></ul></ul><ul><ul><li>Organisms habituate to some punishers </li></ul></ul>
  72. 72. Things affecting punishment <ul><li>It’s a contingency! </li></ul><ul><li>As long as the punishment contingency is in place then behavior will be reduced </li></ul><ul><ul><li>Remove the contingency and behavior will likely return </li></ul></ul><ul><ul><ul><li>There is no behavioral vacuum </li></ul></ul></ul><ul><li>Reinforcement and punishment </li></ul><ul><ul><li>A punished behavior may still be receiving reinforcement </li></ul></ul><ul><ul><li>So punishment depends on reinforcement – in a sense </li></ul></ul><ul><li>Motivation to respond </li></ul><ul><ul><li>Vary levels of deprivation on a food SR schedule </li></ul></ul><ul><ul><li>Punish for producing the same response that produces SR </li></ul></ul><ul><ul><li>The more deprivation the less effective the punisher was </li></ul></ul><ul><li>Availability of alternative behaviors </li></ul><ul><ul><li>You need to teach correct responses as well! </li></ul></ul><ul><ul><li>One key – pigeons press for SR – occasionally punish. Rate of responding decreases but not to zero </li></ul></ul><ul><ul><li>Two keys – left produces SR and punishment – right produces SR </li></ul></ul><ul><ul><ul><li>Learn to respond on the right key </li></ul></ul></ul><ul><ul><ul><li>Rate of responding dropped to zero on the left key </li></ul></ul></ul>
  73. 73. Punishment effects and problems <ul><li>We use punishment because it’s reinforcing to us. </li></ul><ul><ul><li>Positive punishment, negative punishment usually lead to a negatively reinforcing situation for the punisher. </li></ul></ul><ul><li>Can be useful because it’s effects are fast. Especially if we DRO/A/I and stop reinforcing the behavior we are trying to punish </li></ul><ul><ul><li>Injurious behavior </li></ul></ul><ul><li>Sometimes has positive side effects </li></ul><ul><ul><li>Mentally disabled folks that were punished for self injurious behavior also seemed happier and more outgoing after the treatment </li></ul></ul>
  74. 74. Problems cont. <ul><li>Escape / avoidance </li></ul><ul><ul><li>The punished often try to avoid or escape the punishment </li></ul></ul><ul><ul><li>This is a negatively reinforcing situation for them – escaping the punishment reinforces whatever they just did (to escape) </li></ul></ul><ul><ul><ul><li>Tuning out, lying </li></ul></ul></ul><ul><li>Aggression </li></ul><ul><ul><li>Likely when escape is possible </li></ul></ul><ul><ul><li>We attack the punisher </li></ul></ul><ul><li>Apathy </li></ul><ul><ul><li>If aversive stimuli are common then you can get a suppression of wide ranges of behavior </li></ul></ul><ul><ul><ul><li>Use SR to counteract this. </li></ul></ul></ul><ul><li>Abuse </li></ul><ul><ul><li>Easy to abuse </li></ul></ul><ul><ul><ul><li>Starting with weak punishers and escalating </li></ul></ul></ul><ul><ul><ul><li>Extinction bursts – reinforced leads to outlandish behavior – then punished severely. </li></ul></ul></ul><ul><li>Imitation </li></ul><ul><ul><li>You learn to punish by being punished (observational learning) </li></ul></ul>
  75. 75. Ethics and alternatives <ul><li>Is it OK to punish? </li></ul><ul><ul><li>Not a question for science </li></ul></ul><ul><li>Response prevention </li></ul><ul><ul><li>Works wonders with cats </li></ul></ul><ul><li>DRL </li></ul><ul><li>DR0 – period of time without providing the problem response is reinforced – then change criteria </li></ul><ul><li>DRI </li></ul>
  76. 76. Self Control <ul><li>Clear definition </li></ul><ul><ul><li>Behavior, not outcome </li></ul></ul><ul><li>A contract – signed and posted </li></ul><ul><ul><li>Public commitment </li></ul></ul><ul><li>Tracking behavior – baseline </li></ul><ul><ul><li>Stability </li></ul></ul><ul><ul><li>A change technique in itself </li></ul></ul><ul><ul><li>Graph it </li></ul></ul><ul><li>Modifying your SDs </li></ul><ul><ul><li>Adding </li></ul></ul><ul><ul><li>Removing </li></ul></ul><ul><ul><li>Delay from SD to behavior </li></ul></ul>
  77. 77. Self control - cont <ul><li>Modifying your SR </li></ul><ul><ul><li>Identify them first (Very difficult) </li></ul></ul><ul><ul><li>Make a list of possible sr </li></ul></ul><ul><ul><li>Add or remove </li></ul></ul><ul><ul><ul><li>Be ready for extinction bursts </li></ul></ul></ul><ul><ul><li>Do not use something that you do or obtain often </li></ul></ul><ul><ul><li>Delay from R to SR </li></ul></ul><ul><li>Thoughts – these serve as SDs for placeholders for SRs – very useful </li></ul><ul><li>Using friends </li></ul><ul><ul><li>Contract – make them stick to it </li></ul></ul><ul><li>The self management problem </li></ul>
  78. 78. Educational Applications <ul><li>Behavior Analysis in the classroom </li></ul><ul><ul><li>Behavior analysis is the field in which experts in human learning apply their trade. </li></ul></ul><ul><ul><ul><li>Working in the schools is a common occurrence </li></ul></ul></ul><ul><ul><li>Misbehaving students are dealt with by reprimands and punishment but appropriate behavior is ignored </li></ul></ul><ul><ul><ul><li>Reverse this – focus on the good behavior – ignore the bad. </li></ul></ul></ul><ul><ul><ul><li>The result was that student behavior changed significantly </li></ul></ul></ul><ul><ul><ul><li>Instructor behavior changed too – she was reinforced for reinforcing. </li></ul></ul></ul><ul><li>No child left behind act </li></ul><ul><ul><li>Punitive vs reinforcing </li></ul></ul>
  79. 79. More on education <ul><li>Programmed instruction </li></ul><ul><ul><li>Teaching Machines </li></ul></ul><ul><li>Personalized system of instruction </li></ul><ul><ul><li>Used for university course </li></ul></ul><ul><li>Implications </li></ul><ul><ul><li>State your objectives </li></ul></ul><ul><ul><li>Test over small amounts </li></ul></ul><ul><ul><li>Provide Sr whenever possible </li></ul></ul><ul><ul><li>Establish stimulus control </li></ul></ul>
  80. 80. Clicker Training <ul><li>Karen Pryor and the clicker </li></ul><ul><li>The logic of the clicker </li></ul><ul><ul><li>Conditioned reinforcer </li></ul></ul><ul><ul><li>Immediate and salient </li></ul></ul><ul><li>“ Don’t shoot the Dog!” </li></ul><ul><ul><li>Title of her book – but it has a good point </li></ul></ul><ul><ul><li>We often think the dog or the child is at ‘fault’ but we must look at the conditions they are operating under. </li></ul></ul>
  81. 81. Learned Helplessness <ul><li>Dogs are restrained and given a tone-shock </li></ul><ul><li>They are later moved to a shuttle box (two sides of a large chamber) and given a shock – naïve animals move to the side that does not produce shock. Even at the presentation of the tone. </li></ul><ul><li>The dogs that were restrained – remained in the shock part of the box – laying down to accept shock – even with coaxing (including food) they could not get the dogs to escape. </li></ul><ul><li>Learned industriousness </li></ul><ul><ul><li>Rats trained that a lever press will escape shock </li></ul></ul><ul><ul><li>Other rats given inescapable shock </li></ul></ul><ul><ul><li>Then exposed to a shuttle box with shock on BOTH sides. </li></ul></ul><ul><ul><li>The rats that learned they could escape continued to move to the other side of the box – even though they still got shocked. The helpless ones just stayed put. </li></ul></ul><ul><ul><li>Reinforce a high level of effort and persistence increases probability that they will work hard at difficult tasks for a prolonged period. </li></ul></ul>
  82. 82. Gambling <ul><li>What is compulsive gambling? </li></ul><ul><li>Is it a person issue? (“there must be something wrong with them”) </li></ul><ul><li>How can you gamble sometimes and not get hooked while others cant? </li></ul><ul><li>Pigeons gamble too </li></ul><ul><ul><li>3s access to food for 50 key pecks (work) </li></ul></ul><ul><ul><li>Then set up a gambling situation with a key that acts like a slot machine with the payout being longer access to food – first three days set up to be a lucky bird – with 15s access to food. After that they are better off working to get the right amount of food for the day. </li></ul></ul><ul><ul><li>Pigeons became hooked and continued to gamble </li></ul></ul><ul><ul><li>Removed the gambling component - ethics </li></ul></ul><ul><ul><li>Reinstated it and the birds went back to gambling </li></ul></ul>
  83. 83. Superstition <ul><li>Noncontingent reinforcement can reinforce behavior that has no connection to the reinforcer </li></ul><ul><ul><li>Superstition </li></ul></ul><ul><li>Maintained by either SR+ or SR- </li></ul>
  84. 84. Observational Learning <ul><li>Change in behavior due to the experience of observing a model </li></ul><ul><li>Observation and classical conditioning </li></ul><ul><ul><li>Confederate and observer </li></ul></ul><ul><ul><ul><li>Confederate receives shock after a buzzer sounds (acting) – observer watches </li></ul></ul></ul><ul><ul><ul><li>Observer later showed conditioning to the buzzer </li></ul></ul></ul><ul><ul><li>Eyelid conditioning </li></ul></ul><ul><ul><ul><li>Observer watched conditioning trials – they eventually produces a CR to the CS </li></ul></ul></ul>
  85. 85. Observational learning cont. <ul><li>Alternate explanation </li></ul><ul><ul><li>Maybe watching a blink is a CS for blinking </li></ul></ul><ul><ul><ul><li>Tone paired with the sight – now produces the blink </li></ul></ul></ul><ul><ul><li>Might be higher order conditioning </li></ul></ul><ul><li>Monkeys reared in captivity with wild parents </li></ul><ul><ul><li>Parents show fear of snakes – subjects do not </li></ul></ul><ul><ul><li>Subjects will reach across a snake for food in the same compartment </li></ul></ul><ul><ul><ul><li>Then have them watch a parent in the presence of a snake </li></ul></ul></ul><ul><ul><ul><li>The subjects then show fear of snakes. </li></ul></ul></ul>
  86. 86. Observational Learning - operant <ul><li>Monkey learned to do a task to receive SR (pull a chain) </li></ul><ul><li>An observer watched the model perform the task 5 times </li></ul><ul><ul><li>Observer get’s a chance to perform task </li></ul></ul><ul><ul><li>Given six trials </li></ul></ul><ul><ul><li>Observers benefitted </li></ul></ul><ul><ul><ul><li>Many responded correctly on 1 st trial </li></ul></ul></ul><ul><ul><ul><li>75% of solutions 30s 47% in 10s </li></ul></ul></ul><ul><ul><ul><li>Failures were close to correct </li></ul></ul></ul><ul><ul><ul><ul><li>Did the correct action just with not enough force </li></ul></ul></ul></ul>
  87. 87. Observational Learning - Operant <ul><li>Cats solving a problem </li></ul><ul><ul><li>Spin a disk to receive SR </li></ul></ul><ul><ul><li>4 Watched while one worked </li></ul></ul><ul><ul><ul><li>Two watched for the full 30 trials </li></ul></ul></ul><ul><ul><ul><li>Two watched for the last 15 trials </li></ul></ul></ul><ul><ul><li>Observers OUTPERFORMED the models </li></ul></ul><ul><ul><ul><li>Models – 62s to solve trial 1 </li></ul></ul></ul><ul><ul><ul><li>Observers 15 trials – 57s to solve on trial 1 </li></ul></ul></ul><ul><ul><ul><li>Observers 30 trials – 16s to solve on trial 1 </li></ul></ul></ul>
  88. 88. Imitation and generalized imitation <ul><li>When an observer duplicates the behavior of a model </li></ul><ul><li>Imitation of a behavior may not lead to the consequence (contingency) </li></ul><ul><li>Generalized imitation (getting SR for imitating in general) </li></ul><ul><ul><li>Baer and Sherman used a puppet to provide SR for imitative behavior </li></ul></ul><ul><ul><ul><li>Puppet modeled 4 behaviors (mouthing, head nodding, speaking nonsense and lever pressing) </li></ul></ul></ul><ul><ul><ul><li>First three when imitated resulted in positive feedback from the puppet </li></ul></ul></ul><ul><ul><ul><ul><li>Imitation of the lever press was never SRed </li></ul></ul></ul></ul><ul><ul><ul><ul><li>All imitating increased </li></ul></ul></ul></ul><ul><ul><ul><li>Reinforced the general tendency to imitate </li></ul></ul></ul>
  89. 89. Variables effecting observational learning <ul><li>Consequences of a model’s behavior </li></ul><ul><ul><li>Consistency is important </li></ul></ul><ul><li>Consequences of the observers behavior </li></ul><ul><ul><li>Learning history </li></ul></ul><ul><ul><li>Have you been reinforced for observing/imitating in the past </li></ul></ul><ul><li>Model characteristics influence learning </li></ul><ul><ul><li>Attractive </li></ul></ul><ul><ul><li>Competent – fellow student vs. lab assistant – learned more from the assistant </li></ul></ul><ul><ul><li>Likable </li></ul></ul><ul><ul><li>Prestigious </li></ul></ul>
  90. 90. other characteristics <ul><li>Attention getting </li></ul><ul><ul><li>The eye patch – those that saw a model with an eye patch were more likely to remember </li></ul></ul><ul><ul><li>The mood – those that saw a model display a mood (good or bad) were more likely to remember what the model said – compared to neutral </li></ul></ul><ul><li>Age </li></ul><ul><ul><li>Young ones don’t necessarily learn more than older </li></ul></ul><ul><ul><ul><li>Recalling what you saw (novel performances of a model)– adults were much better </li></ul></ul></ul><ul><li>Survival </li></ul><ul><ul><li>Polar bears and the Inuit – dangle seals </li></ul></ul><ul><ul><li>So observing (and imitating) can increase survivability </li></ul></ul>
  91. 91. Generalization and stimulus control <ul><li>Watson and SR psychology </li></ul><ul><ul><li>Too simple – behavior is much more complex </li></ul></ul><ul><ul><li>Not misguided – antecedent stimuli play a role </li></ul></ul><ul><ul><li>We need to understand how a creature will respond to a given stimulus, similar stimuli and new stimuli </li></ul></ul><ul><li>Generalization gradient </li></ul><ul><ul><li>Train on a red light – VI 1 </li></ul></ul><ul><ul><li>Now test to see if a blue light will work </li></ul></ul><ul><ul><ul><li>This produces extinction (problem) </li></ul></ul></ul><ul><ul><ul><li>Reinforcement problem </li></ul></ul></ul><ul><ul><ul><li>So we do probe trials (single extinction trial) mixed in the session (90% red, 10% blue) </li></ul></ul></ul>
  92. 92. Generalization <ul><li>Response generalization </li></ul><ul><ul><li>To a given stimulus – response may be slightly different each time </li></ul></ul><ul><li>Stimulus generalization </li></ul><ul><ul><li>To different stimuli you will get similar responses </li></ul></ul><ul><ul><li>This follows a generalization gradient </li></ul></ul><ul><ul><li>Semantic generalization </li></ul></ul><ul><ul><ul><li>CSs were words (presented while they were having sweet snacks) – salivation was the CR </li></ul></ul></ul><ul><ul><ul><ul><li>Synonyms and homophones were the test </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Synonyms produced stronger responding than homophones </li></ul></ul></ul></ul><ul><ul><li>After 9/11 there were many crimes of those against Arab descent or the Muslim faith. </li></ul></ul>
  93. 93. More generalization <ul><li>Training effects generalization </li></ul><ul><ul><li>Two sets of pigeons </li></ul></ul><ul><ul><ul><li>One group trained to respond to a lit key with a 1000mhz tone on a VI schedule </li></ul></ul></ul><ul><ul><ul><li>One group received presence and absence training </li></ul></ul></ul><ul><ul><ul><ul><ul><li>Respond to the presence of a given stimulus and not to others (1000mhz) </li></ul></ul></ul></ul></ul><ul><ul><ul><ul><li>Some trials were identical </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Other trials included no tone but a lit key with no SR available </li></ul></ul></ul></ul><ul><ul><ul><li>Extinction trials with different freq of tone present to test for generalization </li></ul></ul></ul><ul><ul><ul><li>The birds in the latter group developed generalization to the sound </li></ul></ul></ul><ul><ul><ul><li>Initial birds responded to all tones </li></ul></ul></ul>
  94. 94. Discrimination <ul><li>Behavior occurs in the presence of a given stimulus but not in the presence of others </li></ul><ul><ul><li>Light on = S+ light off = S- </li></ul></ul><ul><li>Inverse relation between generalization and discrimination </li></ul><ul><ul><li>Detecting discrimination in the generalization gradient </li></ul></ul><ul><ul><ul><li>Flat means no discrimination </li></ul></ul></ul><ul><ul><ul><li>Steep means high levels of discrimination </li></ul></ul></ul>
  95. 95. Pavlovian discrimination <ul><li>CS+ is paired with the US </li></ul><ul><li>CS- appears without the US present </li></ul><ul><ul><li>Dogs learned to respond differently to a 100bpm and 96bpm metronome </li></ul></ul><ul><ul><ul><li>That’s 4 beats a minute difference!!! </li></ul></ul></ul>
  96. 96. Operant discrimination training <ul><li>S+ and S- are types of SDs </li></ul><ul><li>Examples </li></ul><ul><ul><li>Red light (S+) </li></ul></ul><ul><ul><li>Blue light (S-) </li></ul></ul><ul><ul><li>Bach and Stravinsky (birds learned to detect the difference between the two) </li></ul></ul><ul><ul><li>Picasso and Monet – birds learned to discriminate – and to pics by the same artists that they had never seen before! </li></ul></ul><ul><ul><ul><li>Could even discriminate between other painters in the same schools. </li></ul></ul></ul>
  97. 97. Attending to Specific Properties <ul><li>S+ = triangle on red key </li></ul><ul><li>S- = circle on green </li></ul><ul><li>Bird 107 is attending to the red and bird 105 is attending to the triangle </li></ul>
  98. 98. Fading procedures <ul><li>Start with one stimuli </li></ul><ul><li>Change properties of that stimulus until the desired discrimination is being made </li></ul><ul><li>Pigeons have a hard time discriminating between horizontal and vertical lines but red and green are easy </li></ul><ul><ul><li>Start with red and green </li></ul></ul><ul><ul><li>Superimpose vertical on red and horizontal on green and slowly remove the color </li></ul></ul><ul><ul><li>Now the bird can discriminate </li></ul></ul>
  99. 99. Errorless discrimination <ul><li>Shape a pigeon to respond on a red key for food </li></ul><ul><ul><li>3 min periods </li></ul></ul><ul><ul><li>Alternated with dark key as S- (only 5 seconds) </li></ul></ul><ul><ul><li>Duration was gradually lengthened </li></ul></ul><ul><ul><li>Then from dark to dim to brighter and so on until the green key is as bright as the red </li></ul></ul><ul><ul><li>At end red is S+ </li></ul></ul><ul><ul><li>Green produces extinction </li></ul></ul><ul><ul><ul><li>Only 10 pecks on the green key for ALL birds </li></ul></ul></ul><ul><ul><ul><li>If we just trained the discrimination without fading then birds would have made 100s of responses </li></ul></ul></ul>
  100. 100. Matching to sample <ul><li>Select from two or more alternatives (comparison stimuli) the stimulus that matches the standard (sample) </li></ul><ul><li>Comparison stimuli </li></ul><ul><li>One is S+ one or more is S- </li></ul><ul><li>Illuminate light (red / green) then go dark (need an observing response) </li></ul><ul><li>Two or more selection keys – all lit at the same time, one red, one green </li></ul><ul><li>S+ is the key that matched the sample </li></ul><ul><li>Can teach them to select the opposite </li></ul><ul><li>Colors and positions change from trial to trial </li></ul><ul><li>Correction procedures – no switching if an error was made </li></ul><ul><ul><li>This gets rid of ‘side preferences’ </li></ul></ul>
  101. 101. Equivalence relations <ul><li>Reflexivity – A=A </li></ul><ul><li>Symmetry – A=B then B=A </li></ul><ul><li>Transitivity – A=B and B=C then A=C </li></ul>
  102. 102. Stimulus control <ul><li>Discrimination training brings behavior under the influence of SDs </li></ul><ul><li>We learn when to engage in a given behavior </li></ul><ul><li>We learn when a given behavior is unlikely to receive SR </li></ul><ul><li>The SD in the 3term contingency is there because of this effect. </li></ul>
  103. 103. Applications <ul><li>Concept formation </li></ul><ul><ul><li>We don’t have ‘concepts’ per say any more than we have extinction </li></ul></ul><ul><ul><li>You demonstrate conceptual behavior </li></ul></ul><ul><ul><li>You must generalize within classes </li></ul></ul><ul><ul><li>You must discriminate between classes </li></ul></ul><ul><ul><li>Pigeons and trees </li></ul></ul><ul><ul><ul><li>Peck a disk when a picture is displaying a tree </li></ul></ul></ul><ul><ul><ul><li>They then demonstrated the concept of tree </li></ul></ul></ul><ul><ul><li>Pigeons and humans </li></ul></ul><ul><ul><ul><li>Peck a disk when a picture is displaying a human </li></ul></ul></ul><ul><ul><ul><ul><li>Alone, groups, diff sizes, shapes, ages, sexes, clothing or no clothing, full view, partially hidden, etc. </li></ul></ul></ul></ul><ul><ul><ul><li>Another where they pecked where humans were in the picture </li></ul></ul></ul><ul><ul><ul><ul><li>Got this overwhelmingly right – even without SR for that part of the task </li></ul></ul></ul></ul>
  104. 104. Forgetting and Remembering <ul><li>The metaphor </li></ul><ul><ul><li>Is a reflection of our times </li></ul></ul><ul><ul><ul><li>Wax tablet, blank slate, filing cabinet, computer, etc </li></ul></ul></ul><ul><ul><li>All of these posit a place called memory (where memories are stored) </li></ul></ul><ul><li>Where is the memory itself? </li></ul><ul><ul><li>It doesn’t seem to be in one location </li></ul></ul><ul><ul><li>The hippocampus is involved in forming long term memories – but they are not ‘stored’ there. </li></ul></ul><ul><li>The changed organism </li></ul><ul><ul><li>The physiological process of the neurons firing is what we call memory – but its not a thing that is moved around, etc </li></ul></ul><ul><ul><li>Instead of positing a structure – suggest change. </li></ul></ul>
  105. 105. Forgetting in learning <ul><li>To study memory in learning we are really studying “the study of memory is properly the study of the factors that affect our performance … after a period of no practice.” Malone </li></ul><ul><li>Durability of learned behavior </li></ul><ul><li>Deterioration in learned behavior following a period without practice. </li></ul><ul><ul><li>Do you remember = can you describe </li></ul></ul><ul><ul><li>Have you forgotten = can you still do </li></ul></ul>
  106. 106. Measuring learning <ul><li>Retention interval </li></ul><ul><ul><li>Period of time is allowed to pass without the performance of said behavior – then test to see if it persists </li></ul></ul><ul><ul><li>This gap is the retention interval </li></ul></ul><ul><li>Free recall </li></ul><ul><ul><li>Perform previously learned behavior after a retention interval </li></ul></ul>
  107. 107. Measuring forgetting <ul><li>Prompted recall </li></ul><ul><ul><li>Much like wheel of fortune </li></ul></ul><ul><ul><li>Add cues until the item is remembered </li></ul></ul><ul><ul><li>Why is this better than free recall? </li></ul></ul><ul><ul><ul><li>Captures the generalization gradient </li></ul></ul></ul><ul><li>Relearning </li></ul><ul><ul><li>Reinstate original procedure </li></ul></ul><ul><ul><li>Measure how fast the response is acquired compared to trail 1 </li></ul></ul><ul><ul><ul><li>Savings is the measure </li></ul></ul></ul><ul><ul><ul><li>ebbinghaus </li></ul></ul></ul><ul><li>Recognition </li></ul><ul><ul><li>Identify previously learned material </li></ul></ul><ul><ul><li>Delayed match to sample </li></ul></ul><ul><ul><ul><li>Present sample – delay time to response. You are measuring remembering. </li></ul></ul></ul>
  108. 108. Measuring forgetting <ul><li>Extinction method </li></ul><ul><ul><li>Acquisition phase – then a delay to extinction phase </li></ul></ul><ul><ul><ul><li>Faster extinction should occur in the delay conditions </li></ul></ul></ul><ul><li>Gradient degradation </li></ul><ul><ul><li>Flattening the generalization gradient </li></ul></ul><ul><li>Known phenomenon comparison </li></ul><ul><ul><li>Fi schedule </li></ul></ul><ul><ul><li>24hr break, 24 day break – rats in the later condition didn’t show scallop, at first </li></ul></ul>
  109. 109. Time as the variable <ul><li>Many of the above seem to be accounted for by time </li></ul><ul><li>But time is a hypothetical construct </li></ul><ul><li>We are really measuring change </li></ul><ul><li>So the reasons for forgetting is not simply time – but some change in the organism </li></ul>
  110. 110. sleep <ul><li>Sleep helps sometimes! </li></ul><ul><ul><li>In reality, it just doesn’t work against you. </li></ul></ul><ul><li>Lists of nonsense syllables </li></ul><ul><ul><li>Followed by varying lengths of sleep </li></ul></ul><ul><ul><li>Compare groups – other activities </li></ul></ul><ul><ul><li>The sleep groups did better </li></ul></ul><ul><ul><li>Done with inactivity as well </li></ul></ul><ul><ul><ul><li>Immobilized cockroaches </li></ul></ul></ul>
  111. 111. More on remembering <ul><li>Overlearning </li></ul><ul><ul><li>The more you learn something the less likely you are to forget it. </li></ul></ul><ul><li>Prior experience </li></ul><ul><ul><li>Chess masters </li></ul></ul><ul><ul><ul><li>Chess masters compared to a chess club </li></ul></ul></ul><ul><ul><ul><li>Arranged pieces on the board – study for 5 seconds </li></ul></ul></ul><ul><ul><ul><li>90% accurate for the masters – 40% for the chess players for reproductions </li></ul></ul></ul><ul><ul><ul><li>Now arrange randomly </li></ul></ul></ul><ul><ul><ul><ul><li>No better than ordinary players </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Rules out the superior memory argument </li></ul></ul></ul></ul>
  112. 112. Stimulus control and remembering <ul><li>Cue dependent forgetting </li></ul><ul><ul><li>Cue present at learning is not present at test time </li></ul></ul><ul><ul><li>Rats learning to run a white or black maze </li></ul></ul><ul><ul><ul><li>One minute retention interval </li></ul></ul></ul><ul><ul><ul><li>Half of each condition was ran in the other </li></ul></ul></ul><ul><ul><ul><li>Performance decreased for the switch group </li></ul></ul></ul><ul><ul><li>Humans </li></ul></ul><ul><ul><ul><li>Learned lists of words standing or sitting </li></ul></ul></ul><ul><ul><ul><li>Recall was better in the condition you learned in </li></ul></ul></ul><ul><ul><li>State dependent learning </li></ul></ul><ul><ul><ul><li>Organisms state serves as a stimulus </li></ul></ul></ul><ul><ul><ul><li>Hunger, hormones, drunk, etc </li></ul></ul></ul>
  113. 114. APA 5 <ul><li>Cover page </li></ul><ul><ul><li>Running head; header; page numbers </li></ul></ul><ul><ul><li>Centered </li></ul></ul><ul><li>Introduction </li></ul><ul><ul><li>General statement about the issue </li></ul></ul><ul><ul><li>Leads to your study </li></ul></ul><ul><li>Method </li></ul><ul><ul><li>A detailed description of the procedure you used </li></ul></ul><ul><ul><li>How many trials, what conditions, etc. </li></ul></ul><ul><li>Results </li></ul><ul><ul><li>Your findings – include a graph. Graph should have 3 parts. Summarize this graph in text – in terms of the three parts. </li></ul></ul><ul><li>Discussion </li></ul><ul><ul><li>A synopsis of your study in terms of the findings and other literature. Did you expect to get what you got? What problems did you have? Why might have you obtained the results you did? </li></ul></ul><ul><li>References </li></ul><ul><ul><li>Follow APA 5 formatting rules </li></ul></ul><ul><ul><li>Builder, B. (2008). How to build a house. Construction Journal for Little Kids, 123(4) , 176-188 </li></ul></ul><ul><ul><li>Builder, B. (2008). Building Bob Style. London: Norton. </li></ul></ul>