The slides of Artificial Intelligence and Entertainment Science (AIES) Workshop 2021 Keynote lecture
https://aies.info/program/
Empathic Entertainment in Digital Game
A digital game give a unique experience to a user. AI system in Digital game consists of three kinds of AI such as Meta-AI, Character AI, and Spatial AI. Game experience is formed by them. Meta-AI keeps watching a status of game and controlling characters, objects, terrain, weather and so on dynamically to make many dramatic and empathic situations in a game for users. Character AI is a brain of an autonomous game character to make a decision by itself, but sometimes it acts to achieve a goal issued from Meta-AI. Spatial AI analyses a terrain and abstracts its features to communicate them to Meta-AI and Character-AI. They can make their intelligent decisions by using specific terrain and environment features. The AI system is called MCS-AI dynamic cooperative model (Meta-AI, Character AI, and Spatial AI dynamic cooperative model). In the lecture, I will explain the system by showing some cases of published digital games.
16. メタAI(=AI Director)によるユーザーのリラックス度に応じた敵出現度
ユーザーの緊張度
実際の敵出現数
計算によって
求められた
理想的な敵出現数
Build Up …プレイヤーの緊張度が目標値を超えるまで
敵を出現させ続ける。
Sustain Peak … 緊張度のピークを3-5秒維持するために、
敵の数を維持する。
Peak Fade … 敵の数を最小限へ減少していく。
Relax … プレイヤーたちが安全な領域へ行くまで、30-45秒間、
敵の出現を最小限に維持する。
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
より具体的なアルゴリズム
18. メタAIが作用を行う領域
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
メタAIが作用(敵の生成・
消滅)を行う領域を、
AAS(= Active Area Set) と
言う。
19. メタAIが作用を行う領域
(AAS=Active Area Set)
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
20. メタAIが作用を行う領域
(AAS=Active Area Set)
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
21. 安全な領域までの道のり(Flow Distance)
メタAIはプレイヤー群の経路を
トレースし予測する。
- どこへ来るか
- どこが背面になるか
- どこに向かうか
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
23. 敵出現領域
背後 前方
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment Conference at Stanford.
http://www.valvesoftware.com/publications.html
前方と背後のプレイヤー群から見えてない部屋に、
モンスターを発生させる。
30. 強化学習
(例)格闘ゲームTaoFeng におけるキャラクター学習
Ralf Herbrich, Thore Graepel, Joaquin Quiñonero Candela Applied Games Group,Microsoft Research Cambridge
"Forza, Halo, Xbox Live The Magic of Research in Microsoft Products"
http://research.microsoft.com/en-us/projects/drivatar/ukstudentday.pptx
ⓒ2015 SQUARE ENIX CO., LTD. All Rights Reserved.
31. 強化学習
(例)格闘ゲームTaoFeng におけるキャラクター学習
Ralf Herbrich, Thore Graepel, Joaquin Quiñonero Candela Applied Games Group,Microsoft Research Cambridge
"Forza, Halo, Xbox Live The Magic of Research in Microsoft Products"
http://research.microsoft.com/en-us/projects/drivatar/ukstudentday.pptx
Microsoft Research Playing Machines: Machine Learning Applications in Computer Games
http://research.microsoft.com/en-us/projects/mlgames2008/
Video Games and Artificial Intelligence
http://research.microsoft.com/en-us/projects/ijcaiigames/
202. Classical : Central domain
All processes of intelligent modules
are executed in sequence.
Subsumption : parallel & layered
All processes of intelligent modules
are executed in parallel.
Rodney Brooks, A robust layered control system for a mobile robot
Robotics and Automation, IEEE Journal of (Volume:2 , Issue: 1 ) 1986
221. いろいろな世界表現
ナビメッシュ-ウェイポイント
階層表現
LOS マップ
戦術マップクラスタリング
敵配位マップ テリトリー表現
Tactical Point System
Halo2Killzone
Killzone2Halo Assassin’s Creed
Left 4 Dead
Alex J. Champandard, Remco Straatman, Tim Verweij, "On the AI Strategy for KILLZONE 2's Bots”
http://aigamedev.com/open/coverage/killzone2/
Damian Isla,"Building a Better Battle: HALO 3 AI Objectives",
http://halo.bungie.net/inside/publications.aspx
Michael Booth, "The AI Systems of Left 4 Dead," Artificial Intelligence and Interactive Digital Entertainment
Conference , http://www.valvesoftware.com/company/publications.html
233. Deep Q-Learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves,
Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller (DeepMind Technologies)
Playing Atari with Deep Reinforcement Learning
http://www.cs.toronto.edu/~vmnih/docs/dqn.pdf
画面を入力
操作はあらかじめ教える
スコアによる強化学習
240. 学習過程解析
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves,
Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller (DeepMind Technologies)
Playing Atari with Deep Reinforcement Learning
http://www.cs.toronto.edu/~vmnih/docs/dqn.pdf
241. • Pπ ロールアウトポリシー(ロールアウトで討つ手を決める。
Pπ(a|s) sという状態でaを討つ確率)
• Pσ Supervised Learning Network プロの討つ手からその
手を討つ確率を決める。Pσ(a|s)sという状態でaを討つ確
率。
• Pρ 強化学習ネットワーク。Pρ(学習済み)に初期化。
• Vθ(s’) 局面の状態 S’ を見たときに、勝敗の確率を予測
する関数。つまり、勝つか、負けるかを返します。
David Silver & Demis Hassabis et al.
Mastering the game of Go with deep neural networks and tree search
Nature 529, 484–489 (28 January 2016) doi:10.1038/nature16961 http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html
242. David Silver & Demis Hassabis et al.
Mastering the game of Go with deep neural networks and tree search
Nature 529, 484–489 (28 January 2016) doi:10.1038/nature16961 http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html
252. アーロンのアルゴリズム
• 知識ベースの人工知能
= 閉曲線で描くことを学ぶ。
1981 Aaron’s homepage
http://aaronshome.com/aaron/index.html
Harold Cohen, "How to Draw Three People in a Botanical Garden"
http://aaronshome.com/aaron/publications/index.html
ルールの
補正
253. アーロンのアルゴリズム
• 知識ベースの人工知能
(左) 学んだ知識から描く
(右) 架空のものを学んだものから描く
19851983 Aaron’s homepage
http://aaronshome.com/aaron/index.html
Harold Cohen, "How to Draw Three People in a Botanical Garden"
http://aaronshome.com/aaron/publications/index.html
アレンジ
能力
254. アーロンのアルゴリズム
• 知識ベースの人工知能
(左) 学んだ知識から描く
(右) 架空のものを学んだものから描く
19851983 Aaron’s homepage
http://aaronshome.com/aaron/index.html
Harold Cohen, "How to Draw Three People in a Botanical Garden"
http://aaronshome.com/aaron/publications/index.html
255. アーロンのアルゴリズム
• 知識ベースの人工知能
前後関係を取れるようにする。
1986 Aaron’s homepage
http://aaronshome.com/aaron/index.html
Harold Cohen, "How to Draw Three People in a Botanical Garden"
http://aaronshome.com/aaron/publications/index.html