Singapore River City

Slide 1: Fuzzy Cognitive Goal Net for Interactive Storytelling Chunyan Miao Lane, Zhiqi Shen Yundong Cai Ah Hwee Tan

Slide 2: Motivation & objective There have been increasing interests in  exploring interactive story telling/games in virtual worlds to build interactive, game-like learning and educational environment from both research communities and industry. However there is a gap between the high end  graphics and the learning (game/story) content. This research attempts to build a bridge to  connect the graphic entities in virtual world and game contents through agent augmented virtual world. 10/29/06 2

Slide 3: Motivation & objective Interactive story telling/games in virtual world  enables situated learning “as if” in real world . However, there is a lack of efforts in studying:  situation/context awareness  user modeling  personalization This research attempts to propose a model based  approach for facilitating situated learning and for transforming the challenge of learning into playing. 10/29/06 3

Slide 4: Basic Idea Each entity (graphic objects, virtual  characters, avatars etc) in the virtual world could be modeled as an agent. The whole virtual world becomes as active as  a multi-agent community (virtual life space) which are able to support various types of interactive story telling/game contents in virtual world. 10/29/06 4

Slide 5: Basic Idea Agents are goal oriented, autonomous, pro-  active, social, adaptive to environment Agents may have human like behaviors,  emotions, happy, fear etc. The agentization of entities in virtual worlds  brings new dimensions of human-like experiences, situational/contextual, social and even emotional etc. in virtual space/life. 10/29/06 5

Slide 6: Agent Augmented Interactive Storytelling Agent: Characters  Goal-Oriented  Reactive  Proactive  Social …  Agent Augmented Storytelling system: Features  Personalization  Social  Immersive  Situated  Context aware …  10/29/06 6

Slide 7: A Model based Approach: Fuzzy Cognitive Goal Net Goal Net is an goal oriented modeling tool  that decompose a problem into a goal net. Fuzzy cognitive map is a cognitive model that  models a problem into a cognitive map. Fuzzy cognitive goal net seamlessly integrate  Goal Net with Fuzzy Cognitive Maps. FCGN is used for modeling both story  contents and agents. 10/29/06 7

Slide 8: Goal Net: Basic Elements {t1, t2 …tn} Transition k Goal j Goal i {ev1, ev2 …evm} A goal is a desired state that an agent intends to reach.  A transition leads to a new goal by performing some tasks  {t1, t2 …tn} in a specific environment {ev1, ev2 …evm}. Transitions represent various goal relationships between  goals. Action/task selections are based on the environment  situation/contexts 10/29/06 8

Slide 9: Goal Net: Hierarchical Structure Root Goal Atomic State Transition Composite State 10/29/06 9

Slide 10: Goal Net Modeling story scenes  Illness Investigation Visit Hospital Visit Understand Officer Start Scenario Result Report End Visit Town Collect Sample Water Test Sample 10/29/06 10

Slide 11: Cognitive Map (CM) Cognitive Map models human being’s cognition as a set of concepts and relationships between concepts. relationship + fi fj Concept i, Concept j, e.g. unattended car e.g. theft intention 10/29/06 11

Slide 12: Cognitive Map Modeling: an Example unattended cars + + theft theft intention - + security guards chance of being caught patrol 10/29/06 12

Slide 13: Fuzzy Cognitive Maps Enemy Close +a +1 +1 -a Fear Wish to escape -1 Enemy Far +y 10/29/06 13

Slide 14: 10/29/06 14

Slide 15: Design and Implementation Agents with MADE (Multi-Agent Development Environment) Design Goal Nets using Goal Net Designer Create agent using agent creator Load Goal Net to agents using the knowledge Loader 10/29/06 15

Slide 16: Interactive Storytelling Engine Interactive Storytelling Engine Scenario Database Drama Manager Container Agent1 Create Behavior Goal Net Multi-agent Development Environment(MADE) Fuzzy Agent2 Cognitive Goal Net FCMs Agent3 . b . a c . Visualization Engine 10/29/06 16

Slide 17: Singapore River City 10/29/06 17

Slide 18: View and Action Space Virtual Space Display Space Communication Space 10/29/06 18

Slide 19: Agent Augmented Virtual World • Participants gather information and apply knowledge by exploring the virtual world and interacting with environments. Phase 2: Phase 1: Mystery House Information Investigation Collection Final Assessment 10/29/06 19

Slide 20: Doctor and nurse talk about the symptoms of the illness. 10/29/06 20

Slide 21: Officer in Health Ministry introduces differences among diseases. 10/29/06 21

Slide 22: In the village, villagers lead us to see the environments… 10/29/06 22

Slide 23: The test helper teaches students to prevent illness in mystery house. 10/29/06 23

Slide 24: Covers the pot to eliminate mosquito breeding place gain 1 point. 10/29/06 24

Slide 25: Put down the Mosquito Net, gain some points. 10/29/06 25

Slide 26: Conclusions Fuzzy cognitive goal net (FCGN) enables easy  creation of story scenario. The G-MADE game engine transform the  analyzing designing and implementing interactive story/game to a collection of interacting agents (MAS). The story plot created by FCGN facilitates  situational/context aware, personalization etc. 10/29/06 26

Slide 27: Demo Time 10/29/06 27

Slide 28: Agent Augmented Virtual World • Participants gather information and apply knowledge by exploring the virtual world and interacting with environments. Phase 2: Phase 1: Mystery House Information Investigation Collection Final Assessment 10/29/06 28

Slide 29: THANK YOU! 10/29/06 29

Slide 30: Phase 1 Explore Virtual World 10/29/06 30

Slide 31: Phase 2 Visit Mystery House 10/29/06 31

Slide 32: Phase 3 Phase 3 – Final Online Test Final Test 10/29/06 32