Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The evolutionary conserved neurobiology of operant learning

346 views

Published on

Presentation at the 2016 annual meeting of the Mind and Brain College of the University of Lisbon on the multiple learning systems interacting during operant learning.

Published in: Science
  • Be the first to comment

  • Be the first to like this

The evolutionary conserved neurobiology of operant learning

  1. 1. Björn Brembs Universität Regensburg http://brembs.net
  2. 2. Tone Food Tone: Conditioned stimulus – CS Food: Unconditioned Stimulus – US
  3. 3. > 530 Mya CREB CRE Long- term memory cAMP PKA Cytoplasm Nucleus Nt DNA rutabaga Modified from: "Comparative psychology: Evolution and development of behavior" (2nd Edition, Psychology Press, 2008)
  4. 4. CS US Tone Food Lever- pressing Food Behavior Reinforcement
  5. 5. > 530 Mya CREB CRE Long- term memory cAMP PKA Cytoplasm Nucleus Nt DNA rutabaga Modified from: "Comparative psychology: Evolution and development of behavior" (2nd Edition, Psychology Press, 2008)
  6. 6. Press FoodLever CS? US? Tone Food
  7. 7. Behavioral variability in a constant stimulus situation:
  8. 8. Torque HeatColors operant classical self world
  9. 9. > 530 Mya CREB CRE Long- term memory cAMP PKA Cytoplasm Nucleus Nt DNA rutabaga Modified from: "Comparative psychology: Evolution and development of behavior" (2nd Edition, Psychology Press, 2008)
  10. 10. Brembs & Plendl (2008) Torque HeatColors Torque Heat rut-AC dependent Synaptic Plasticity Protein Kinase C world self rut2080 wtb rut2080 wtb HS noHS PKCi PKCi HS noHS PKCi PKCi
  11. 11. PKC but not rut-AC involved in Aplysia self-learning Aplysia californica F. Lorenzetti, D. Baxter, J. Byrne (2008): Neuron 59, 815-828
  12. 12. PKC involved in self-motion learning Rochefort C, Arabo A, André M, Poucet B, Save E, Rondi-Reig L. (2011) Science 334(6054):385-389
  13. 13. > 530 Mya Aplysia (Mollusks) Drosophila (Arthropods) mice (Chordates)
  14. 14. Torque Heat Colomb & Brembs, 2016
  15. 15. Action – Outcome Evaluation Torque Heat
  16. 16. Generate spontaneous actions (trying out)
  17. 17. Shape behavior by evaluating sensory feedbac
  18. 18. Action – Outcome Evaluation FoxP2
  19. 19. Torque HeatColors Torque Heat world self self WT FoxP RNAi ctrl.
  20. 20. > 530 Mya Aplysia (Mollusks) Drosophila (Arthropods) Humans/mice/birds (Chordates) ??? cAMP PKA Cytoplasm Nucleus Nt DNA Type II cyclase PKC FoxP
  21. 21. Why have more than one learning system?
  22. 22. F1 2005
  23. 23. PI = (tc - th) / (tc + th)
  24. 24. Brembs & Heisenberg (2000) L & M ‘Master’: operant ‘Replay’: classical
  25. 25. Training Test composite: turning + color turning
  26. 26. Training Test composite: turning + color turning WT WT 16min MB Impaired OK OK Self-Learning Test
  27. 27. Training Test composite: turning + color turning color WT WT 16min MB Impaired OK OK Self-Learning Test WT WT 16min MB OK Impaired Impaired World-Learning Test
  28. 28. Training Test composite: turning + color turning color WT 8min WT 16min MB Impaired OK OK Self-Learning Test WT 8min WT 16min MB OK Impaired Impaired World-Learning Test habit formation
  29. 29. Training Test composite: turning + color turning color WT 8min WT 16min FoxP 16min Impaired OK Impaired Self-Learning Test WT 8min WT 16min MB OK Impaired Impaired World-Learning Test
  30. 30. Training Test composite: turning + color turning color WT 8min WT 16min MB 8min Impaired OK OK Self-Learning Test WT 8min WT 16min MB 8min OK Impaired Impaired World-Learning Test Brembs, 2009 MB247 or 17D driving TNT
  31. 31. Brembs (2009) Curr Biol Colomb & Brembs (2010) Commun Integr Biol Brembs (2010) Proc Roy Soc Brembs (2011) Behav Proc
  32. 32. Spontaneous Activity independent of sensory input e.g. exploration Mixed Complex stimuli/variable actions Behavioral set Endogenous evoked responses Closed loop Evoked Fixed stimulus/response at fixed latency e.g. reflex, habit Stimulus-response coupling Predictability
  33. 33. Spontaneous Activity independent of sensory input e.g. exploration Mixed Complex stimuli/variable actions Behavioral set Endogenous evoked responses Closed loop Evoked Fixed stimulus/response at fixed latency e.g. reflex, habit Stimulus-response coupling Predictability/Efficiency
  34. 34. Flexibility Efficiency
  35. 35. Exploration Exploitatio
  36. 36. Goal-directed Habitual
  37. 37. Thinking Slow Thinking Fa

×