Panel Discussion:  Management of Risks Brought about by AI Networking In a desirable future, the happiness of all humans will be balanced against the survival of humankind under the support of super intelligence. In that future, society will be an ecosystem formed by augmented human beings and various public AIs, in what I dub an ecosystem of shared intelligent agents (EcSIA). Although no human can completely understand EcSIA—it is too complex and vast—humans can control its basic directions. In implementing such control, the grace and wealth that EcSIA affords needs to be properly distributed to everyone.

1. INTERNATIONAL FORUM TOWARD AI NETWORK SOCIETY
Panel Discussion:
Management of Risks
Brought about by AI Networking
Hiroshi YAMAKAWA
Dwango Co., Ltd.
The Whole Brain Architecture IniMaMve,
a specified non-profit organizaMon
March 14, 2017

2. EcSIA: Desirable future coexisMng with AI
In a desirable future, the happiness of all humans
will be balanced against the survival of humankind
under the support of super intelligence. In that future,
society will be an ecosystem formed by augmented
human beings and various public AIs, in what I dub an
ecosystem of shared intelligent agents (EcSIA).
Although no human can completely understand
EcSIA—it is too complex and vast—humans can control
its basic direcMons. In implemenMng such control, the
grace and wealth that EcSIA affords needs to be
properly distributed to everyone.
（Hiroshi Yamakawa, July 2015)
2

3. Emergence of creative intelligence
3
Levelofintelligence
Year
Change of protagonists
Before singularity
Design by humans is
the rate limiting step
Human
Design
AI
Design After singularity
Recursive Self-
Improvement
Creative
intelligence
Design
Technol
ogy
Recursive Self-Improvement: AI systems designed to recursively self-
improve or self-replicate in a manner that could lead to rapidly increasing
quality or quantity must be subject to strict safety and control measures.
(ASILOMAR AI PRINCIPLES : 22)
Technol
ogy

4. Give only major goal to AI is dangerous
• Subgoal generaMon of AIs are beneficial for users.
– Users are freed from detail.
– Implemented as "Reinforcement
learning" in contemporary AI
• Human： Survival → Money (King Midas)
• Computer GO：Target good boards for victory
• Super Intelligence: Climate control → PopulaMon reducMon
• Value Alignment: Highly autonomous AI systems
should be designed so that their goals and behaviors
can be assured to align with human values
throughout their operaMon. (ASILOMAR AI PRINCIPLES : 10)
– C.f. JSAI Ethics Guidelines ArMcle 9 (hcp://ai-elsi.org/archives/471 )
4

5. Properties obtained from brain
architecture
Significance of brain-inspired AI to reduce risk
Our vision is to create a world
in which AI exists in concord with humanity.
Expanding open co-creation on whole brain architectures.
High affinity with
human intelligence
Make human-friendly AGI a public good for all of mankind
Framework
for integration
Fit for open
co-creation
Tips for over-
coming obstacles
Speedy
development
①Transparency
③Controllability
⑧Accountability
AAP10) Value Alignment
AAP11) Human Values
AAP8) Judicial Transparency
AAP7) Failure Transparency
General properties of brain-inspired AI
AAP23) Common Good
AAP14) Shared Benefit
AAP15) Shared Prosperity
AAP4) Research Culture
AAP5) Race Avoidance
5
※ AAP =
Asiloma AI
Principle

6. DirecMon of the Whole Brain Architecture IniMaMve
Vision：Create a world in which AI exists in
concord with humanity.
Mission：to promote the open development
of Whole Brain Architecture
In order to make human-friendly artificial general
intelligence a public good for all of mankind, we
are constantly going to expand open co-creation
on whole brain architectures.
6
(Tentative translation of http://wba-initiative.org/2171/ )