強化学習
(例)格闘ゲームTaoFeng におけるキャラクター学習
Ralf Herbrich,Thore Graepel, Joaquin Quiñonero Candela Applied Games Group,Microsoft Research Cambridge
"Forza, Halo, Xbox Live The Magic of Research in Microsoft Products"
http://research.microsoft.com/en-us/projects/drivatar/ukstudentday.pptx
Microsoft Research Playing Machines: Machine Learning Applications in Computer Games
http://research.microsoft.com/en-us/projects/mlgames2008/
Video Games and Artificial Intelligence
http://research.microsoft.com/en-us/projects/ijcaiigames/
CORE Layer は、PhysicalLaryer 、Mission Layer のうちで、
どの認識を生成するかを決定するコマンドを投げる。
CERA-CRANIUM認識モデル
Arrabales, R. Ledezma, A. and Sanchis, A. "Towards the Generation of Visual Qualia
in Artificial Cognitive Architectures". (2010)
http://www.conscious-robots.com/raul/papers/Arrabales_BICS2010.pdf
Classical : Centraldomain
All processes of intelligent modules
are executed in sequence.
Subsumption : parallel & layered
All processes of intelligent modules
are executed in parallel.
Rodney Brooks, A robust layered control system for a mobile robot
Robotics and Automation, IEEE Journal of (Volume:2 , Issue: 1 ) 1986
S
(Body)
O
(Object)
Action: A
O’
Sense: p
S’
Action:A’
Sense: p’
O’’S’’
Action: A’’
Sense: p’’
O’’S’’
Action: A’’
Sense: p’’
R R
R R
R R
f’
f
f’’
Sequence of
Self
Sequence of
Object
Sequence of
Action
“Self” is a sequence of selfs. “Object” is a sequence of objects.
S
(Body)
w
(World)
Action: A
w’
Sense: p
S’
Action:A’
Sense: p’
w’’S’’
Action: A’’
Sense: p’’
w’’S’’
Action: A’’
Sense: p’’
R R
R R
R R
f’
f
f’’
身体と世界(環境)との関係性が抽象化されている。
Sequence of
Self
Sequence of
World
Sequence of
Action
266.
S
(Body)
w
(World)
Action: A
w’
Sense: p
S’
Action:A’
Sense: p’
w’’S’’
Action: A’’
Sense: p’’
w’’S’’
Action: A’’
Sense: p’’
R R
R R
R R
f’
f
f’’
Sequence of
Self
Sequence of
World
Sequence of
Action
“Self” is a sequence of selfs. “World” is a sequence of worlds.
267.
S
(Body)
w
(World)
Action: A
w’
Sense: p
S’
Action:A’
Sense: p’
w’’S’’
Action: A’’
Sense: p’’
w’’S’’
Action: A’’
Sense: p’’
R R
R R
R R
f’
f
f’’
Sequence of
Self
Sequence of
World
Sequence of
Action
“Self” is a sequence of selfs. “World” is a sequence of worlds.
知能は身体、世界、その間の関係(アクション)を多層的に捉えている。
多層的な表現の集合がオブジェクトであり、世界であり、アクション。
268.
S
(Body)
w
(World)
Action: A
w’
Sense: p
S’
Action:A’
Sense: p’
w’’S’’
Action: A’’
Sense: p’’
w’’S’’
Action: A’’
Sense: p’’
R R
R R
R R
f’
f
f’’
Sequence of
Self
Sequence of
World
Sequence of
Action
“Self” is a sequence of selfs. “World” is a sequence of worlds.
知能は身体、世界、その間の関係(アクション)を多層的に捉えている。
多層的な表現の集合がオブジェクトであり、世界であり、アクション。
世界表現身体表現
(自己表現)
行動表現
S
(Body)
O
(Object)
Action: A
O’
Sense: p
S’
Action:A’
Sense: p’
O’’S’’
Action: A’’
Sense: p’’
R
R
R
R
Sequence of
Self
“Self” is a sequence of selfs. “Object” is a sequence of objects.
Vector to move
Vector to ent
Dude, Where's My Warthog: From Pathfinding to General Spatial Competence,
D. Isla, Invited talk, Artificial Intelligence and Interactive Digital Entertainment (AIIDE) 2005
http://naimadgames.com/publications.html
274.
S
(Body)
w
(World)
Action: f
w’
Sense: p
S’
Action:f’
Sense: p’
w’’S’’
Action: f’’
Sense: p’’
R
R
R
R
“Self” is a sequence of selfs. “World” is a sequence of worlds.
Killzone 2 Multiplayer Bots
Remco Straatman, Tim Verweij, Alex Champandard | Paris Game/AI Conference 2009, Paris, June 2009
http://www.guerrilla-games.com/publications.html
275.
S
(Body)
w
(World)
Action: f
w’
Sense: p
S’
Action:f’
Sense: p’
w’’S’’
Action: f’’
Sense: p’’
R
R
R
R
“Self” is a sequence of selfs. “World” is a sequence of worlds.
Handling Complexity in the Halo 2 AI, D. Isla, GDC 2005
Dude, Where's My Warthog: From Pathfinding to General Spatial Competence,
D. Isla, Invited talk, Artificial Intelligence and Interactive Digital Entertainment (AIIDE) 2005
http://naimadgames.com/publications.html
いろいろな世界表現
ナビメッシュ-ウェイポイント
階層表現
LOS マップ
戦術マップクラスタリング
敵配位マップ テリトリー表現
TacticalPoint System
Halo2Killzone
Killzone2Halo Assassin’s Creed
Left 4 Dead
Alex J. Champandard, Remco Straatman, Tim Verweij, "On the AI Strategy for KILLZONE 2's Bots”
http://aigamedev.com/open/coverage/killzone2/
Damian Isla,"Building a Better Battle: HALO 3 AI Objectives",
http://halo.bungie.net/inside/publications.aspx
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment
Conference , http://www.valvesoftware.com/company/publications.html