SlideShare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our User Agreement and Privacy Policy.
SlideShare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our Privacy Policy and User Agreement for details.
Successfully reported this slideshow.
Activate your 14 day free trial to unlock unlimited reading.
The 5th WBA Hackathon Orientation -- Cerenaut Part
The presentation by Cerenaut at the orientation (2021-06-05) for the 5th WBA Hackathon, an online AI competition to implement working memory
https://wba-initiative.org/en/18687/
- Neuroscientific issues
- Architecture details
- Instruction on the CodaLab competition
The presentation by Cerenaut at the orientation (2021-06-05) for the 5th WBA Hackathon, an online AI competition to implement working memory
https://wba-initiative.org/en/18687/
- Neuroscientific issues
- Architecture details
- Instruction on the CodaLab competition
The 5th WBA Hackathon Orientation -- Cerenaut Part
1.
International collaborations
● WBAI (Japan)
● Luria (New York)
● Numenta (co-authored Boosted RSM)
Understand animal intelligence / the brain
Improve machine intelligence
○ Independent Research Group
○ Interested in interaction of brain regions for
intelligent behaviour and decision making
Cerenaut
Supervise graduate students at
Monash
Founded in 2018, Publishing since 2012
2.
Working Memory - What is it?
Working memory is a short-term repository for task-relevant information that is critical for the successful
completion of complex tasks (Baddeley, 2003).
E.g. in a spatial working memory task, animals must hold in memory the location of food rewards to
navigate to those locations after a delay.
3.
Primates on DM2S
Figure reproduced from ‘Principles of
Neuroscience’ (Kandel et. al), reproduced from
Rainer, Asaad, and Miller 1998.
4.
Persistent activity in frontal cortex
Figure reproduced from ‘Principles
of Neuroscience’ (Kandel et. al)
5.
Neuroanatomy
What and Where:
● Converge at
Hippocampus.
● A Short Term Memory.
● With strong
projections to PFC.
6.
PFC <> BG <> Thalamus
Girard, Benoît & Tabareau, Nicolas & Berthoz, Alain & Slotine,
Jean-Jacques. (2006). Selective amplification using a contracting
model of the basal ganglia.
Midbrain
VTC, SNc
Trains itself and the actor
Figure reproduced from ‘Computational Cognitive
Neuroscience’ (O’Reilly, Frank et. al)
Via Thalamus
context
7.
Gating stripes
● Persistent neural activity through
two major mechanisms:
○ 1. Intrinsic membrane properties
○ 2. Recurrent connectivity
Figure reproduced from ‘Making Working Memory
Work’, 2016 (O’Reilly and Frank)
8.
DM2S/M2S/M2L
Inherits: ActiveVisionEnv
(Environment)
Config: game_name_env.json
Positional
Encoding
Retina
(DoG +/-
coding)
SuperiorColliculus
(track to position)
SparseAutoencoder
(Visual Cortex)
What
Where
PrefrontalCortex
MedialTemporalLobe
(Short term memory)
Agent
(Actor - BG)
Config:
stub_agent_x.json
Pretrained
network
RL Policy
module
Legend
Reward
AgentEnv (Environment)
Config: stub_env_x.json
Visual Path
Fovea Periph
Gaze
Choices
Data:
what-where
Critic (PVLV)
SparseAutoencoder
(Visual Cortex)
Observation
Action
Gaze position command
(absolute coordinates)
Gaze position
command
Retina
(DoG +/-
coding)
Gym
Environment
Fixed function
Pass-through
Visual Path
Naming:
Class Name
(function)
Delay
9.
Active Vision Fovea
Fovea: Can
recognise shapes,
but can’t see
context.
Periphery: Can see
changes, but can’t
recognise shapes.
Periphery
10.
Positional Encoding
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017).
Attention is all you need. arXiv preprint arXiv:1706.03762.
11.
Software environment
Lots of good information on the Wiki →