Fuzzy Cognitive Goal Net for Interactive Storytelling Chunyan Miao Lane, Zhiqi Shen Yundong Cai Ah Hwee Tan

Motivation & objective There have been increasing interests in exploring interactive story telling/games in virtual worlds to build interactive, game-like learning and educational environment from both research communities and industry. However there is a gap between the high end graphics and the learning ( game/story) content. This research attempts to build a bridge to connect the graphic entities in virtual world and game contents through agent augmented virtual world.

There have been increasing interests in exploring interactive story telling/games in virtual worlds to build interactive, game-like learning and educational environment from both research communities and industry.

However there is a gap between the high end graphics and the learning ( game/story) content.

This research attempts to build a bridge to connect the graphic entities in virtual world and game contents through agent augmented virtual world.

Motivation & objective Interactive story telling/games in virtual world enables situated learning “as if” in real world . However, there is a lack of efforts in studying: situation/context awareness user modeling personalization This research attempts to propose a model based approach for facilitating situated learning and for transforming the challenge of learning into playing.

Interactive story telling/games in virtual world enables situated learning “as if” in real world . However, there is a lack of efforts in studying:

situation/context awareness

user modeling

personalization

This research attempts to propose a model based approach for facilitating situated learning and for transforming the challenge of learning into playing.

Basic Idea Each entity (graphic objects, virtual characters, avatars etc) in the virtual world could be modeled as an agent. The whole virtual world becomes as active as a multi-agent community (virtual life space) which are able to support various types of interactive story telling/game contents in virtual world.

Each entity (graphic objects, virtual characters, avatars etc) in the virtual world could be modeled as an agent.

The whole virtual world becomes as active as a multi-agent community (virtual life space) which are able to support various types of interactive story telling/game contents in virtual world.

Basic Idea Agents are goal oriented, autonomous, pro-active, social, adaptive to environment Agents may have human like behaviors, emotions, happy, fear etc. The agentization of entities in virtual worlds brings new dimensions of human-like experiences, situational/contextual, social and even emotional etc. in virtual space/life.

Agents are goal oriented, autonomous, pro-active, social, adaptive to environment

Agents may have human like behaviors, emotions, happy, fear etc.

The agentization of entities in virtual worlds brings new dimensions of human-like experiences, situational/contextual, social and even emotional etc. in virtual space/life.

Agent Augmented Interactive Storytelling Agent: Characters Goal-Oriented Reactive Proactive Social … Agent Augmented Storytelling system: Features Personalization Social Immersive Situated Context aware …

Agent: Characters

Goal-Oriented

Reactive

Proactive

Social …

Agent Augmented Storytelling system: Features

Personalization

Social

Immersive

Situated

Context aware …

A Model based Approach: Fuzzy Cognitive Goal Net Goal Net is an goal oriented modeling tool that decompose a problem into a goal net. Fuzzy cognitive map is a cognitive model that models a problem into a cognitive map. Fuzzy cognitive goal net seamlessly integrate Goal Net with Fuzzy Cognitive Maps. FCGN is used for modeling both story contents and agents.

Goal Net is an goal oriented modeling tool that decompose a problem into a goal net.

Fuzzy cognitive map is a cognitive model that models a problem into a cognitive map.

Fuzzy cognitive goal net seamlessly integrate Goal Net with Fuzzy Cognitive Maps.

FCGN is used for modeling both story contents and agents.

Goal Net: Basic Elements A goal is a desired state that an agent intends to reach. A transition leads to a new goal by performing some tasks { t 1 , t 2 … t n } in a specific environment { ev 1 , ev 2 … ev m } . Transitions represent various goal relationships between goals. Action/task selections are based on the environment situation/contexts { t 1 , t 2 … t n } { ev 1 , ev 2 … ev m } Goal i Goal j Transition k

A goal is a desired state that an agent intends to reach.

A transition leads to a new goal by performing some tasks { t 1 , t 2 … t n } in a specific environment { ev 1 , ev 2 … ev m } .

Transitions represent various goal relationships between goals.

Action/task selections are based on the environment situation/contexts

Goal Net: Hierarchical Structure

Goal Net Modeling story scenes

Modeling story scenes

Cognitive Map (CM) Concept i, e.g. unattended car relationship + f i f j Cognitive Map models human being’s cognition as a set of concepts and relationships between concepts. Concept j, e.g. theft intention

Cognitive Map models human being’s cognition as a set of concepts and relationships between concepts.

Cognitive Map Modeling: an Example unattended cars theft intention chance of being caught + - + + theft security guards patrol

Fuzzy Cognitive Maps

Design and Implementation Agents with MADE (Multi-Agent Development Environment) Design Goal Nets using Goal Net Designer Create agent using agent creator Load Goal Net to agents using the knowledge Loader

Design Goal Nets using Goal Net Designer

Create agent using agent creator

Load Goal Net to agents using the knowledge Loader

Interactive Storytelling Engine

Singapore River City

View and Action Space Display Space Communication Space Virtual Space

Final Assessment Phase 2: Mystery House Investigation Phase 1: Information Collection Participants gather information and apply knowledge by exploring the virtual world and interacting with environments. Agent Augmented Virtual World

Participants gather information and apply knowledge by exploring the virtual world and interacting with environments.

Doctor and nurse talk about the symptoms of the illness.

Officer in Health Ministry introduces differences among diseases.

In the village, villagers lead us to see the environments…

The test helper teaches students to prevent illness in mystery house.

Covers the pot to eliminate mosquito breeding place gain 1 point.

Put down the Mosquito Net, gain some points.

Conclusions Fuzzy cognitive goal net (FCGN) enables easy creation of story scenario. The G-MADE game engine transform the analyzing designing and implementing interactive story/game to a collection of interacting agents (MAS). The story plot created by FCGN facilitates situational/context aware, personalization etc.

Fuzzy cognitive goal net (FCGN) enables easy creation of story scenario.

The G-MADE game engine transform the analyzing designing and implementing interactive story/game to a collection of interacting agents (MAS).

The story plot created by FCGN facilitates situational/context aware, personalization etc.

Demo Time

Final Assessment Phase 2: Mystery House Investigation Phase 1: Information Collection Participants gather information and apply knowledge by exploring the virtual world and interacting with environments. Agent Augmented Virtual World

Participants gather information and apply knowledge by exploring the virtual world and interacting with environments.

THANK YOU!

Phase 1 Explore Virtual World

Phase 2 Visit Mystery House

Phase 3 – Final Online Test Phase 3 Final Test