SlideShare a Scribd company logo
Local and Global Gating of
        Synaptic Plasticity
         Manuel A. Sanchez-Montañes



                  Hannes Schulz

University of Osnabrück, Department of Cognitive Science



  Action and Cognition II / May 2nd 2005
Learning on Global vs. Local Scale




       Mechanisms for learning in neuronal nets:


Local                         Global
Hebb’s Rule & modifications    Signals to the whole network

   Forms representations on       Modifies local learning
   cortex
Learning Goals


Local Learning:               Global Learning:
    Representation of all         Influence size of
    stimuli                       representation
    Possibility to add new        (→ experimental
    stimuli later on              evidence on basal
                                  forebrain)
    Independence from
    presentation frequency


                  ◮ How to connect both?
The Neuronal Model   Experimental Results   Discussion

Outline


    1    The Neuronal Model
             The Cell
             The Network
             The Inputs


    2    Experimental Results


    3    Discussion




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Outline


    1    The Neuronal Model
             The Cell
             The Network
             The Inputs


    2    Experimental Results


    3    Discussion




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

The Cell Model




               integrate-and-fire
                                                         delayed transmission
                refractory period




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells Inhibitory Cells




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells Inhibitory Cells




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells Inhibitory Cells


                                                                                      Nucleus Basalis




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells Inhibitory Cells


                                                                                      Nucleus Basalis




          Layers 1&2, 3&2 fully connected
          Random weight initialization



                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Network Topology

    Input Cells             Excitatory Cells Inhibitory Cells


                                                                                      Nucleus Basalis




          Layers 1&2, 3&2 fully connected
          Random weight initialization



                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Retrograde Signal Inhibition
              Retrograde Signal


                                Inhibitory Signal
 Dendrit
                                                                       ◮ Retrograde signal
                                                                         of firing cell
                      Firing                                             blocked by
                                                                         inhibitory inputs
                        Cell




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

 Heterosynaptic Long Term Depression


Presynaptic Cell                  Postsynaptic Cell




            “Normal” Condition




                                       Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

 Heterosynaptic Long Term Depression


Presynaptic Cell                  Postsynaptic Cell
                                                                     Heterosynaptic LTD:
                                                                            postsynaptic cell
                                                                            active
                                                                            presynaptic cell
            “Normal” Condition                                              inactive in time
                                                                            window
                                                                        ◮ Synaptic efficacy
                                                                          decrease


                           LTD


                                       Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Relative Timing in Hebb Learning



    Sample interpretations of “Synchronous activity”:

                                                                Symmetric coincidence
                                                                window.




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Relative Timing in Hebb Learning



    Sample interpretations of “Synchronous activity”:

                                                                Symmetric coincidence
                                                                window.
                                                                Asymmetric
                                                                coincidence window.
                                                                Used in this study.




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Input



 Trial I
       Ten different stimuli
       pseudorandom order
       500 examples shown to
       network




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Input



 Trial I                                                 Trial II
       Ten different stimuli                                   9+1 different stimuli
       pseudorandom order                                       pseudorandom order
       500 examples shown to                                    500 examples shown to
       network                                                  network
                                                                One stimulus paired with
                                                                stimulus in basal-neuron




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion   The Cell   The Network   The Inputs

Input



 Trial I                                                 Trial II
       Ten different stimuli                                   9+1 different stimuli
       pseudorandom order                                       pseudorandom order
       500 examples shown to                                    500 examples shown to
       network                                                  network
                                                                One stimulus paired with
                                                                stimulus in basal-neuron

          Both run 40 times with random start parameters




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Outline


    1    The Neuronal Model
             The Cell
             The Network
             The Inputs


    2    Experimental Results


    3    Discussion




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Formed Representations – Trial I




 Neuron Specificity
                                                                Stimuli shown more often
   44.8%       unspecific
                                                                to network not better
   50.5%       specific to 1 stimulus
                                                                represented
    4.7%       intermediate




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Formed Representations – Trial II



                                                                           Number of neurons
                                                                           representing
                                                                           paired stimulus
                                                                           increases

                                                                           Number of neurons
                                                                           representing other
                                                                           stimuli stay the
                                                                           same




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Role of the Global Mechanism



                           1   Basal ganglion neuron fires
                           2   Inhibitory neurons have a
                               prolonged refractory period
                           3   Inhibitory neurons do not fire
                           4   Excitatory neurons can fire
                               and shorten refractory period
                               again

                                                Network Topology




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Role of the Global Mechanism




                     ◮ Unchanged mean activity of
                       inhibitory neurons
                     ◮ Delay of inhibitory activity relative to
                       excitatory activity
                     ◮ Retrograde APs invade dendritic
                       tree

                                                Network Topology




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

The Same, in Graphs




       Delay of inhibitory                                      Number of neurons
       activity relative to                                     representing paired
       excitatory activity                                      stimulus increases
                                                                Number of neurons
                                                                representing other stimuli
                                                                stay the same


                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Outline


    1    The Neuronal Model
             The Cell
             The Network
             The Inputs


    2    Experimental Results


    3    Discussion




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Comparison of Results to Goals




          New stimuli can be trained w/o loss
                 Optimally activated neurons inhibit others
                 Unspecific neurons are result

          Frequency invariance, variable representation size
                 Invariance due to mechanism described above
                 Stimulus representation enhanced by global
                 mechanism




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The Neuronal Model   Experimental Results   Discussion

Predictions for Experimentors




    During basal forbrain stimulation:

          Delayed inhibitory activity
          Invasion of dendritic tree by more retrograde APs




                                      Hannes Schulz      Local and Global Gating of Synaptic Plasticity
The End

More Related Content

Viewers also liked

Create A Stellar Listing
Create A Stellar ListingCreate A Stellar Listing
Create A Stellar Listing
TeachStreet
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
sutrisno2629
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
sutrisno2629
 
From Idea to Exit, the story of our startup
From Idea to Exit, the story of our startupFrom Idea to Exit, the story of our startup
From Idea to Exit, the story of our startup
Natalie Downe
 
1313131
13131311313131
Assessment
AssessmentAssessment
Assessment
Ran Yang
 
Anyway
AnywayAnyway
Anyway
sutrisno2629
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
pmbaird
 
Chineseproverb
ChineseproverbChineseproverb
Chineseproverb
sutrisno2629
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
Ana Cascao
 
Recession
RecessionRecession
Recession
sutrisno2629
 
About Me
About MeAbout Me
About Me
jeanfull
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
Adrián Chávez
 
7 Best Positions
7 Best Positions7 Best Positions
7 Best Positions
sutrisno2629
 
BlackDog Brand Manifesto
BlackDog Brand ManifestoBlackDog Brand Manifesto
BlackDog Brand Manifesto
BlackDog Strategy & Brand
 
Water
WaterWater
Organic Gardener's Guide to Lead Nurturing
Organic Gardener's Guide to Lead NurturingOrganic Gardener's Guide to Lead Nurturing
Organic Gardener's Guide to Lead Nurturing
Pete Jakob
 
Usns Mercy
Usns MercyUsns Mercy
Usns Mercy
soma.sdsu
 
Alfabeto
AlfabetoAlfabeto
Alfabeto
sutrisno2629
 

Viewers also liked (20)

Create A Stellar Listing
Create A Stellar ListingCreate A Stellar Listing
Create A Stellar Listing
 
Color
ColorColor
Color
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
 
From Idea to Exit, the story of our startup
From Idea to Exit, the story of our startupFrom Idea to Exit, the story of our startup
From Idea to Exit, the story of our startup
 
1313131
13131311313131
1313131
 
Assessment
AssessmentAssessment
Assessment
 
Anyway
AnywayAnyway
Anyway
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
 
Chineseproverb
ChineseproverbChineseproverb
Chineseproverb
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
 
Recession
RecessionRecession
Recession
 
About Me
About MeAbout Me
About Me
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
 
7 Best Positions
7 Best Positions7 Best Positions
7 Best Positions
 
BlackDog Brand Manifesto
BlackDog Brand ManifestoBlackDog Brand Manifesto
BlackDog Brand Manifesto
 
Water
WaterWater
Water
 
Organic Gardener's Guide to Lead Nurturing
Organic Gardener's Guide to Lead NurturingOrganic Gardener's Guide to Lead Nurturing
Organic Gardener's Guide to Lead Nurturing
 
Usns Mercy
Usns MercyUsns Mercy
Usns Mercy
 
Alfabeto
AlfabetoAlfabeto
Alfabeto
 

Similar to Local and Global Gating of Synaptic Plasticity

What is (computational) neuroscience?
What is (computational) neuroscience?What is (computational) neuroscience?
What is (computational) neuroscience?
SSA KPI
 
Lec 5
Lec 5Lec 5
Image recognition
Image recognitionImage recognition
Image recognition
Stig-Arne Kristoffersen
 
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdfCCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
Asst.prof M.Gokilavani
 
PhD proposal (December 2010)
PhD proposal (December 2010)PhD proposal (December 2010)
PhD proposal (December 2010)
mpelko
 
Ann first lecture
Ann first lectureAnn first lecture
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
Christy Maver
 
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
Numenta
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Jason Tsai
 
Neural Networks: Self-Organizing Maps (SOM)
Neural Networks:  Self-Organizing Maps (SOM)Neural Networks:  Self-Organizing Maps (SOM)
Neural Networks: Self-Organizing Maps (SOM)
Mostafa G. M. Mostafa
 
Synaptic Transmission
Synaptic TransmissionSynaptic Transmission
Synaptic Transmission
Axiope Limited
 
Artificial neural networks
Artificial neural networksArtificial neural networks
Artificial neural networks
ernj
 
Artificial nueral network slideshare
Artificial nueral network slideshareArtificial nueral network slideshare
Artificial nueral network slideshare
Red Innovators
 
Computational neuropharmacology drug designing
Computational neuropharmacology drug designingComputational neuropharmacology drug designing
Computational neuropharmacology drug designing
Revathi Boyina
 
Ch05
Ch05Ch05
Ch05
Jan Stern
 
Molecular Neurobiology Overview Presentation
Molecular Neurobiology Overview PresentationMolecular Neurobiology Overview Presentation
Molecular Neurobiology Overview Presentation
Rita Barakat
 
Design of Cortical Neuron Circuits With VLSI Design Approach
Design of Cortical Neuron Circuits With VLSI Design ApproachDesign of Cortical Neuron Circuits With VLSI Design Approach
Design of Cortical Neuron Circuits With VLSI Design Approach
ijsc
 
Sporns kavli2008
Sporns kavli2008Sporns kavli2008
Sporns kavli2008
lovelyday410
 
The role of machine learning in modelling the cell
The role of machine learning in modelling the cellThe role of machine learning in modelling the cell
The role of machine learning in modelling the cell
butest
 
Soft computing BY:- Dr. Rakesh Kumar Maurya
Soft computing BY:- Dr. Rakesh Kumar MauryaSoft computing BY:- Dr. Rakesh Kumar Maurya
Soft computing BY:- Dr. Rakesh Kumar Maurya
Rakesh Kumar Maurya Maurya
 

Similar to Local and Global Gating of Synaptic Plasticity (20)

What is (computational) neuroscience?
What is (computational) neuroscience?What is (computational) neuroscience?
What is (computational) neuroscience?
 
Lec 5
Lec 5Lec 5
Lec 5
 
Image recognition
Image recognitionImage recognition
Image recognition
 
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdfCCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
CCS355 Neural Network & Deep Learning UNIT III notes and Question bank .pdf
 
PhD proposal (December 2010)
PhD proposal (December 2010)PhD proposal (December 2010)
PhD proposal (December 2010)
 
Ann first lecture
Ann first lectureAnn first lecture
Ann first lecture
 
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
 
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
 
Neural Networks: Self-Organizing Maps (SOM)
Neural Networks:  Self-Organizing Maps (SOM)Neural Networks:  Self-Organizing Maps (SOM)
Neural Networks: Self-Organizing Maps (SOM)
 
Synaptic Transmission
Synaptic TransmissionSynaptic Transmission
Synaptic Transmission
 
Artificial neural networks
Artificial neural networksArtificial neural networks
Artificial neural networks
 
Artificial nueral network slideshare
Artificial nueral network slideshareArtificial nueral network slideshare
Artificial nueral network slideshare
 
Computational neuropharmacology drug designing
Computational neuropharmacology drug designingComputational neuropharmacology drug designing
Computational neuropharmacology drug designing
 
Ch05
Ch05Ch05
Ch05
 
Molecular Neurobiology Overview Presentation
Molecular Neurobiology Overview PresentationMolecular Neurobiology Overview Presentation
Molecular Neurobiology Overview Presentation
 
Design of Cortical Neuron Circuits With VLSI Design Approach
Design of Cortical Neuron Circuits With VLSI Design ApproachDesign of Cortical Neuron Circuits With VLSI Design Approach
Design of Cortical Neuron Circuits With VLSI Design Approach
 
Sporns kavli2008
Sporns kavli2008Sporns kavli2008
Sporns kavli2008
 
The role of machine learning in modelling the cell
The role of machine learning in modelling the cellThe role of machine learning in modelling the cell
The role of machine learning in modelling the cell
 
Soft computing BY:- Dr. Rakesh Kumar Maurya
Soft computing BY:- Dr. Rakesh Kumar MauryaSoft computing BY:- Dr. Rakesh Kumar Maurya
Soft computing BY:- Dr. Rakesh Kumar Maurya
 

More from cijat

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
cijat
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
cijat
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
cijat
 
The ball is not just orange.
The ball is not just orange.The ball is not just orange.
The ball is not just orange.
cijat
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
cijat
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
cijat
 
Affordances
AffordancesAffordances
Affordances
cijat
 

More from cijat (7)

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
 
The ball is not just orange.
The ball is not just orange.The ball is not just orange.
The ball is not just orange.
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
 
Affordances
AffordancesAffordances
Affordances
 

Recently uploaded

WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Jeffrey Haguewood
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
Shinana2
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
Pravash Chandra Das
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Tatiana Kojar
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
GDSC PJATK
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 

Recently uploaded (20)

WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 

Local and Global Gating of Synaptic Plasticity

  • 1. Local and Global Gating of Synaptic Plasticity Manuel A. Sanchez-Montañes Hannes Schulz University of Osnabrück, Department of Cognitive Science Action and Cognition II / May 2nd 2005
  • 2. Learning on Global vs. Local Scale Mechanisms for learning in neuronal nets: Local Global Hebb’s Rule & modifications Signals to the whole network Forms representations on Modifies local learning cortex
  • 3. Learning Goals Local Learning: Global Learning: Representation of all Influence size of stimuli representation Possibility to add new (→ experimental stimuli later on evidence on basal forebrain) Independence from presentation frequency ◮ How to connect both?
  • 4. The Neuronal Model Experimental Results Discussion Outline 1 The Neuronal Model The Cell The Network The Inputs 2 Experimental Results 3 Discussion Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 5. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Outline 1 The Neuronal Model The Cell The Network The Inputs 2 Experimental Results 3 Discussion Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 6. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs The Cell Model integrate-and-fire delayed transmission refractory period Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 7. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 8. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Inhibitory Cells Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 9. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Inhibitory Cells Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 10. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Inhibitory Cells Nucleus Basalis Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 11. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Inhibitory Cells Nucleus Basalis Layers 1&2, 3&2 fully connected Random weight initialization Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 12. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Network Topology Input Cells Excitatory Cells Inhibitory Cells Nucleus Basalis Layers 1&2, 3&2 fully connected Random weight initialization Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 13. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Retrograde Signal Inhibition Retrograde Signal Inhibitory Signal Dendrit ◮ Retrograde signal of firing cell Firing blocked by inhibitory inputs Cell Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 14. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Heterosynaptic Long Term Depression Presynaptic Cell Postsynaptic Cell “Normal” Condition Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 15. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Heterosynaptic Long Term Depression Presynaptic Cell Postsynaptic Cell Heterosynaptic LTD: postsynaptic cell active presynaptic cell “Normal” Condition inactive in time window ◮ Synaptic efficacy decrease LTD Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 16. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Relative Timing in Hebb Learning Sample interpretations of “Synchronous activity”: Symmetric coincidence window. Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 17. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Relative Timing in Hebb Learning Sample interpretations of “Synchronous activity”: Symmetric coincidence window. Asymmetric coincidence window. Used in this study. Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 18. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Input Trial I Ten different stimuli pseudorandom order 500 examples shown to network Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 19. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Input Trial I Trial II Ten different stimuli 9+1 different stimuli pseudorandom order pseudorandom order 500 examples shown to 500 examples shown to network network One stimulus paired with stimulus in basal-neuron Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 20. The Neuronal Model Experimental Results Discussion The Cell The Network The Inputs Input Trial I Trial II Ten different stimuli 9+1 different stimuli pseudorandom order pseudorandom order 500 examples shown to 500 examples shown to network network One stimulus paired with stimulus in basal-neuron Both run 40 times with random start parameters Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 21. The Neuronal Model Experimental Results Discussion Outline 1 The Neuronal Model The Cell The Network The Inputs 2 Experimental Results 3 Discussion Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 22. The Neuronal Model Experimental Results Discussion Formed Representations – Trial I Neuron Specificity Stimuli shown more often 44.8% unspecific to network not better 50.5% specific to 1 stimulus represented 4.7% intermediate Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 23. The Neuronal Model Experimental Results Discussion Formed Representations – Trial II Number of neurons representing paired stimulus increases Number of neurons representing other stimuli stay the same Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 24. The Neuronal Model Experimental Results Discussion Role of the Global Mechanism 1 Basal ganglion neuron fires 2 Inhibitory neurons have a prolonged refractory period 3 Inhibitory neurons do not fire 4 Excitatory neurons can fire and shorten refractory period again Network Topology Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 25. The Neuronal Model Experimental Results Discussion Role of the Global Mechanism ◮ Unchanged mean activity of inhibitory neurons ◮ Delay of inhibitory activity relative to excitatory activity ◮ Retrograde APs invade dendritic tree Network Topology Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 26. The Neuronal Model Experimental Results Discussion The Same, in Graphs Delay of inhibitory Number of neurons activity relative to representing paired excitatory activity stimulus increases Number of neurons representing other stimuli stay the same Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 27. The Neuronal Model Experimental Results Discussion Outline 1 The Neuronal Model The Cell The Network The Inputs 2 Experimental Results 3 Discussion Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 28. The Neuronal Model Experimental Results Discussion Comparison of Results to Goals New stimuli can be trained w/o loss Optimally activated neurons inhibit others Unspecific neurons are result Frequency invariance, variable representation size Invariance due to mechanism described above Stimulus representation enhanced by global mechanism Hannes Schulz Local and Global Gating of Synaptic Plasticity
  • 29. The Neuronal Model Experimental Results Discussion Predictions for Experimentors During basal forbrain stimulation: Delayed inhibitory activity Invasion of dendritic tree by more retrograde APs Hannes Schulz Local and Global Gating of Synaptic Plasticity