On and around the Whole Brain Architecture Approach

2017-07 The Whole Brain Architecture Initiative 02017-07 The Whole Brain Architecture Initiative
On and around
the Whole Brain Architecture
Approach
ARAKAWA, Naoya
NPO: The Whole Brain Architecture Initiative
2017-07-20
@Consciousness Club, Araya, Tokyo

2017-07 The Whole Brain Architecture Initiative 1
Today’s Talk
1. Introduction: the WBA approach & WBAI
2. Software resources
3. Neuroscientific frameworks
4. Related researches & Roadmap
5. WBA Hackathon in September

The WBA Approach
to realize AGI by ‘mimicking’
the architecture of the entire brain
The human brain realizes General Intelligence:
Intelligence not for specific tasks but
capable of adapting to tasks unexpected
at its conception

The Whole Brain Architecture
The Whole Brain Architecture
＝Machine Learning ＋ Cognitive Architecture
(from an engineering perspective)
Background -- Advances in:
• Machine Learning
i.e., Deep Learning
• Neuroscience
Knowledge of brain functions/architecture

Consciousness?
• The WBA approach is agnostic about it.
– a weak AI position
• But perhaps functionally important?

WBAI: the NPO
to support research activities for
realizing AI with human-like
cognitive capabilities by studying
the entire architecture of the brain
👉 The WBA Approach
The Mission:

Basic Ideas
Vision
to create a world in which AI exists in harmony
with humanity
Mission
to promote the open development of WBA
Values
Study: Deepen and spread our expertise
Imagine: Broaden our views through public
dialogue
Build: Create AGI through open collaboration

The Foundation
• Since Aug. 21, 2015
• Financial supports
from enterprises and individuals
〜¥7mil for 2016 & 2017FYs
Toshio Okubo, Kentaro Goto, Ren Sakaki

Two kinds of Businesses
1. Educational Business
– Helping people research around WBAA
– Seminars & Hackathons
– Collaborating with academic communities
2. R&D Business
– Creating R&D infrastructure
– Not to compete with other research entities
– Open development

Educational Business
• WBA Seminars for general public (in Japanese)
– 19 seminars since Oct. 2013 (before the foundation)
– Admission Free
– # of Audience〜200/seminar
– Brain Science, AI/Machine Learning & Cognitive
Sciences
• WBA Hackathons ⇒
– 2015-09 (7 teams)
– 2016-10 (11 teams)
– 2017-09 (Calling for Participation! More on later)

R&D Business: Creating Infrastructure
• Generic software platforms
– BriCA: Brain-inspired Computing Architecture
• Learning Environments
– LIS: Life in Silico
Unity + Chainer +
Open AI Gym + BriCA
• WBA Viewer
– BICAmon: Brain-inspired Cognitive
Architecture monitor
Funded & produced by Dwango AI Lab.

AI Development in Open Community
• SIG-WBA: June 2016〜
• Mainly in Japanese on Slack
⇒ hopefully to be internationalized
• Activities so far:
– Machine Learning
– PredNet (originally from D. Cox’s group)
– LIS (learning environment & agents)
– Tactile-motion cortical architecture

Volunteering
The activities of WBAI are supported by
volunteers (the WBA Supporters)!
– WBA Seminars
– Hackathons

Academic Communities & WBAI
• WBAI members of Academia
• Advisors:
DOYA, Kenji, KITANO, Hiroaki, TOMITA, Masaru, MORIKAWA,
Hiroyuki, NAKASHIMA, Hideyuki
• MEXT (Ministry of Education, Culture, Sports, Science and Technology of Japan):
– Grant-in-Aid for Scientific Research on Innovative Areas
“Comparison and Fusion of Artificial Intelligence and Brain
Science”
– Grant: Post K “The Whole Brain Simulation and Brain-like AI”
• Gatsby-Kakenhi Joint Workshop on AI and Neuroscience (2017-05)
http://www.brain-ai.jp/events/detail/616/ (@UCL)
• Symbol Emergence in Robotics (記号創発ロボティクス/LangRobo)
• Future of Life Institute

WBAI & Stakeholders

Today’s Talk
for supporting research in the WBA approach

The Open WBA Platform
Agent
Integrated Executive Platform
導入
ML
modules
Virtual
Environment
Simulator
Sensors
Actuators
Visualizer
Architecture Description Language
Impl.
WBA: Cognitive
Architecture

Integrated Executive Platform: BriCA
Brain-inspired Computing Architecture
A Modular Software Platform for WBA
Like ROS, but communicates only vectors
to combine ML modules
• BriCA v1
– python/currently in use
• BriCA v2
– c++ for synchronization/scalability

Visual Environment Simulator – LIS: Life in Silico
You can
change the
Agent &
Environment.
OpenAI Gym
& BriCA
inside

Visualizer: BiCAMon
‘Brain-inspired Cognitive Architecture monitor’
Tool for monitoring cognitive architecture’s activity while
mapping it onto brain architecture
Currently using Allen’s
mouse connectome

Today’s Talk
• Connectomic architecture
• Neocortical algorithmic framework

Connectomic Architecture
Connectome: biologically clarified
wiring diagram in the brain
The Whole Brain Connectomic Architecture (WBCA)
Reference architecture for WBA
Referring to real connectomic architecture
e.g., mouse (Allen), human, …

Why Connectome?
Connectome Constraint：Limiting the
combination of ML modules corresponding to
brain organs
1) Preventing divergence in development
2) Guaranteed GI
⇒ A fast track to AGI

Neocortical Master Algorithmic Framework
• Neocortex
– has a uniform structure.
– realizes diverse functionalities.
⇒ AGI!
• Attempts to model Neocortex:
– HTM (Hierarchical Temporal Memory) [Numenta]
– BESOM [Ichisugi@AIRC.AIST]
– agi.io
– PredNet
– Baston & Friston
– Funamizu & Doya
– …

L1
L2/3
L4
L6
L5
State
(bottom up)
Input Output
State
(top down)
Control
(Attention,
context etc.)
Hidden state
output
control
State
Hidden
state [Action
output]
Control
(Attention,
context etc.)
Neocortex
Higher L2/3,
Hippocampus,
Cerebellum
Lower L2/3
(Basal ganglia-
controlled)
Thalamus
Higher L6
Lower L2/3
Basal
ganglia,[Pyrami
dal tracts]
Lower L6,
Lower L1
Signal Semantics Signal Semantics
Information
selection
(attention)
Activity
control
Hidden sate
(bottom up)
(Lower L5 origin)
Thalamus Thalamus
Higher
L2/3 or L4,
Hippocampus
Output 1
Output 2
Output 3
Input 1
Input 2
Input 3
Input 4
Input 5
Neocortical Master Algorithmic Framework @WBAI
Next Step: Implementation

Today’s Talk
4. Related researches & roadmap
– Intuitive Physics
– Language Use
– Roadmap

Intuitive Physics
• Embodied cognition
– Cognition is embodied in the physical world
including language use (cognitive linguistics)
– Lakoff, etc.
• Piaget’s Stages
– Sensorimotor (~2yrs.)
– Preoperational (2~7yrs.)
– Concrete operational (7~11yrs.)
– Formal operational (12~yrs.)
• Cognitive robotics
• Simulation e.g., claw crane…

Language Use
• Language use is a necessary element for
human-like AGI.
• In brain science, much has been found
since Broca & Wernicke!
• Recent advances in ML
– E.g.
• seq2seq
• Grounded language learning in a simulated 3D world @DeepMind
• Embodied cognition
– ‘Symbol Grounding’
– Language acquisition in developmental robotics
– Language game

Roadmap?
Year WBA Hackathon
Themes
Research Meanwhile @DeepMind
2013 DQN
2014 Neural Turing Machine
2015 Combined ML
2016 Cognitive Architecture One-shot Learning, DNC
2017 Hippocampus Too many to write here!
2018 Rodent-Level Frontal
Cortex
2019 Piaget’s Stage I
(sensorimotor)?
202X Language Acquisition
Piaget’s Stage II
(preoperational)?
202X Piaget’s Stage III
(concrete operational)?
Intuitive
Physics
Lang.
Use
Cortical
Master
Algorithm Probably they
have solved all
the basic
problems of AGI
Integrating AGI
functions into
more human-like
agents

Today’s Talk

2017-07 The Whole Brain Architecture Initiative 302017-07 The Whole Brain Architecture Initiative
The Third Whole Brain
Architecture Hackathon
— Wake up, Hippocampus!
Incorporating Hippocampal Models
toward AGI Prototypes —
 Date: September 16th, 17th, and 18th, 2017
 Venue: Tokyo, Japan
 End of Registration: August 8th
WBA Hackathon 2017

The Hippocampus
Major functions of Hippocampus:
• Representing Episodes ⇒ Long-term Memory
• Navigation/Self-Location
At the top of cortices for perception

Hackathon 2017 Tasks
Tasks to test memory & navigation
functions (of Hippocampus)
– Linear Maze
– Cross Maze
S
R
G

Architecture around the Hippocampus
（the module including the Hippocampus）
Basal Ganglia
(Reward System)
=Neocortex
* Dr. Umataro Tenma is the creator of AstroBoy
& an expert of the hippocampus.

Evaluation Criteria
Developed systems will be reviewed by
juries in terms of the following criteria:
–Neuroscientific reality
–Engineering utility
–Originality
Systems utilizing the software provided by WBAI, such as
BriCA, WBCA, BiCAmon will get extra points.
The winner will be awarded with cash prize.

Call for Participation!
If you’re interested, why don’t you
participate in the WBA hackathon?
https://wba-initiative.org/en/2391/
by Aug. 8th, 2017

EOP
Thank you very much for your ATTENTION!

On and around the Whole Brain Architecture Approach

Recommended

Recommended

More Related Content

Similar to On and around the Whole Brain Architecture Approach

Similar to On and around the Whole Brain Architecture Approach (20)

More from The Whole Brain Architecture Initiative

More from The Whole Brain Architecture Initiative (20)

Recently uploaded

Recently uploaded (20)

On and around the Whole Brain Architecture Approach