Motivations for Augmented Reality Gaming Trond Nilsen, Steven Linton, Julian Looser HIT Lab NZ / Department of Computer Science & Software Engineering University of Canterbury, Christchurch, New Zealand [trond.nilsen,steven.linton,julian.looser]@hitlabnz.org

Contents Introduction Existing AR Games Motivation Gaming model Case studies Current and Future Work Questions?

Introduction

Existing AR Games

Motivation

Gaming model

Case studies

Current and Future Work

Questions?

Who are we? Graduate students at HIT Lab NZ and the University of Canterbury Research in AR Gaming, interface design, and HCI Play far too many games

Graduate students at HIT Lab NZ and the University of Canterbury

Research in AR Gaming, interface design, and HCI

Play far too many games

Augmented Reality (1) Overlay virtual imagery on the real world Benefits: Work with real and virtual content simultaneously Tangible user interfaces Enhance collaboration by integrating the task space with the communication space

Overlay virtual imagery on the real world

Benefits:

Work with real and virtual content simultaneously

Tangible user interfaces

Enhance collaboration by integrating the task space with the communication space

Augmented Reality (2) Milgram’s Reality – Virtuality Continuum Transitional interfaces that allow users to shift along the continuum Example: Transitioning into an environment

Milgram’s Reality – Virtuality Continuum

Transitional interfaces that allow users to shift along the continuum

Example: Transitioning into an environment

Augmented Reality (3) Many applications, Engineering Archaeology Medicine

Many applications,

Engineering

Archaeology

Medicine

Augmented Reality (4) Video see-through AR Equipment: Computer Head-mounted display Small camera Markers Software ARToolkit OpenGL, C++ 1 2 3

Video see-through AR

Equipment:

Computer

Head-mounted display

Small camera

Markers

Software

ARToolkit

OpenGL, C++

Mixed Fantasy Extends Milgram’s continuum Part of a larger taxonomy by Chris Stapleton Describes level of game contribution from real, virtual and imaginative worlds Real: What the real world tells the participant Virtual: What the creator shows the participant Imaginative: What the participant contributes

Extends Milgram’s continuum

Part of a larger taxonomy by Chris Stapleton

Describes level of game contribution from real, virtual and imaginative worlds

Real: What the real world tells the participant

Virtual: What the creator shows the participant

Imaginative: What the participant contributes

Existing AR Games (1) ARQuake Geist Camball

ARQuake

Geist

Camball

Existing AR Games(2) AR 2 Hockey Shared Space Human Pacman

AR 2 Hockey

Shared Space

Human Pacman

Motivations What makes AR a good platform for gaming? ‘ Cool, new technology’ is not enough No clear reasons are articulated by AR game designers AR game design is currently a random hunt for ‘cool’ games While exploration is valuable, clear understanding of the benefits AR can offer is necessary Hypothesis: AR provides a medium for games that allows game designers to merge the best of real world games with the best of computer games

What makes AR a good platform for gaming?

‘ Cool, new technology’ is not enough

No clear reasons are articulated by AR game designers

AR game design is currently a random hunt for ‘cool’ games

While exploration is valuable, clear understanding of the benefits AR can offer is necessary

Hypothesis:

AR provides a medium for games that allows game designers to merge the best of real world games with the best of computer games

Game Model - Overview Examine the relative strengths and weaknesses of real world and computer games Compare and contrast them in their ability to engage players Physically Mentally Socially Emotionally

Examine the relative strengths and weaknesses of real world and computer games

Compare and contrast them in their ability to engage players

Physically

Mentally

Socially

Emotionally

Game Model – Physical Engages player’s physical body and skills Examples Sports Skill oriented computer games Real World Can use player’s whole body Real world can provide game environment Physical artefacts can have game significance Computer Physical interaction limited by input devices

Engages player’s physical body and skills

Examples

Sports

Skill oriented computer games

Real World

Can use player’s whole body

Real world can provide game environment

Physical artefacts can have game significance

Computer

Physical interaction limited by input devices

Game Model – Mental Engages the player’s ability to solve problems and reason Examples Puzzles Strategy Resource management / God games Real World Players unwilling to resolve complex rules Supports spatial reasoning, particularly 3D Computer Supports complex game models and rules AI opponents and agents Large scale simulation

Engages the player’s ability to solve problems and reason

Examples

Puzzles

Strategy

Resource management / God games

Real World

Players unwilling to resolve complex rules

Supports spatial reasoning, particularly 3D

Computer

Supports complex game models and rules

AI opponents and agents

Large scale simulation

Game Model – Social Engages players ability to socialize with other players Examples Role playing games Poker Real World Supports natural face to face communication Computer Mediation limits communication, but can provide other facilities Allows remote and massively multiplayer games May support privacy and anonymity

Engages players ability to socialize with other players

Examples

Role playing games

Poker

Real World

Supports natural face to face communication

Computer

Mediation limits communication, but can provide other facilities

Allows remote and massively multiplayer games

May support privacy and anonymity

Game Model – Emotional Provokes an emotional and imaginative response in player. Most difficult aspect to classify. Examples Narrative games in which players develop sympathies with characters. ‘ Atmospheric games’ (horror, etc). Real World Can stimulate players across full range of senses Limited by practical ability to control environment Computer Potential for diverse virtual environments and scenarios Limited to audio and visual stimulation

Provokes an emotional and imaginative response in player. Most difficult aspect to classify.

Examples

Narrative games in which players develop sympathies with characters.

‘ Atmospheric games’ (horror, etc).

Real World

Can stimulate players across full range of senses

Limited by practical ability to control environment

Computer

Potential for diverse virtual environments and scenarios

Limited to audio and visual stimulation

Considerations Most games engage players in more than one of these ways Such multifaceted games are particularly suited to AR enhancement Remember limitations of current AR technology, bearing in mind its rate of change AR isn’t a magic bullet, nor does it make up for poor game design But don’t forget AR specific games!!

Most games engage players in more than one of these ways

Such multifaceted games are particularly suited to AR enhancement

Remember limitations of current AR technology, bearing in mind its rate of change

AR isn’t a magic bullet, nor does it make up for poor game design

But don’t forget AR specific games!!

Case Study – War games (1) Turn based strategy games using armies of miniatures Game conflict resolved through rules and dice Ambiguous situations resolved by player consensus Strong modelling component Military applications

Turn based strategy games using armies of miniatures

Game conflict resolved through rules and dice

Ambiguous situations resolved by player consensus

Strong modelling component

Military applications

Case Study – War Games (2) Real world War Games Game relies on rules interpretation, precise measurement and unit locations Rules must be simple Interferes with player’s desire to replicate specific historical scenarios Can lead to unrealistic in game results Computer War Games Ambiguities are handled by computer Rules and simulation can be very realistic May include AI contribution Eliminates most of social interaction Eliminates ‘artistic’ component of game

Real world War Games

Game relies on rules interpretation, precise measurement and unit locations

Rules must be simple

Interferes with player’s desire to replicate specific historical scenarios

Can lead to unrealistic in game results

Computer War Games

Ambiguities are handled by computer

Rules and simulation can be very realistic

May include AI contribution

Eliminates most of social interaction

Eliminates ‘artistic’ component of game

Case Study – War Games (3) Conceivably, an AR war game could Support social interaction through face to face communication Reduce or eliminate ambiguity through computerized resolution of rules Allow complex and realistic simulation Introduce AI opponents and agents Maintain the physicality of the game by using existing miniatures as elements of a tangible interface Current work - Tankwar

Conceivably, an AR war game could

Support social interaction through face to face communication

Reduce or eliminate ambiguity through computerized resolution of rules

Allow complex and realistic simulation

Introduce AI opponents and agents

Maintain the physicality of the game by using existing miniatures as elements of a tangible interface

Current work - Tankwar

Case Study – Role Playing Games (1) Game of shared narrative; one referee, several players Players take on roles of characters and declare actions and responses to events in the world and other characters Referee sets forth the plot, controls the game world and arbitrates game mechanics Well known example: Dungeons & Dragons; a ‘party’ of adventurers in a world of heroic medieval fantasy - usually involves much monster slaying and treasure collecting RPGs cover almost all conceivable fictional settings Normally sedentary, though more active varieties exist (Live RPGs)

Game of shared narrative; one referee, several players

Players take on roles of characters and declare actions and responses to events in the world and other characters

Referee sets forth the plot, controls the game world and arbitrates game mechanics

Well known example: Dungeons & Dragons; a ‘party’ of adventurers in a world of heroic medieval fantasy - usually involves much monster slaying and treasure collecting

RPGs cover almost all conceivable fictional settings

Normally sedentary, though more active varieties exist (Live RPGs)

Case Study – Role Playing Games (2) Table top RPGs Face to face social interaction Public or obviously concealed communication Referee becomes bottleneck, and misunderstandings can lead to ill feeling Often use miniatures and maps for spatial visualization Inconsistent understanding can arise Control of game environment can affect atmosphere (candles, etc) Live RPGs Players act their character’s part Greater privacy Limited scope for game mechanics (usually dice free, and real time) Limited ability to introduce fantastic constructs Costuming and game environment can affect atmosphere greatly Computer RPGs Usually focus on tactical combat, plot and character puzzles, and simple games of skill Often solitary or networked with little social interaction Graphics and audio allow for convincing visualization Complex game simulation and AI

Table top RPGs

Face to face social interaction

Public or obviously concealed communication

Referee becomes bottleneck, and misunderstandings can lead to ill feeling

Often use miniatures and maps for spatial visualization

Inconsistent understanding can arise

Control of game environment can affect atmosphere (candles, etc)

Live RPGs

Players act their character’s part

Greater privacy

Limited scope for game mechanics (usually dice free, and real time)

Limited ability to introduce fantastic constructs

Costuming and game environment can affect atmosphere greatly

Computer RPGs

Usually focus on tactical combat, plot and character puzzles, and simple games of skill

Often solitary or networked with little social interaction

Graphics and audio allow for convincing visualization

Complex game simulation and AI

Case Study – Role Playing Games (3) Conceivably, an AR RPG could Offer advantages as in War Games Provide consistent game visualization within communication space Offer automated NPC and world management Reduce workload of GM and players in terms of game mechanics, and allow focus on game content. Provide medium for private communication Conceivably, an AR LRPG could Introduce real time game mechanics, allowing conflict resolution beyond simple diplomacy Provide a medium for the introduction of impractical fantastic game content (giant monsters, magical effects, etc) Chief limitation – Bulky and awkward hardware Is AR alone the best solution here? Some problems can be solved very well in AR Hybrid user interfaces – introduce PDAs or similar data devices

Conceivably, an AR RPG could

Offer advantages as in War Games

Provide consistent game visualization within communication space

Offer automated NPC and world management

Reduce workload of GM and players in terms of game mechanics, and allow focus on game content.

Provide medium for private communication

Conceivably, an AR LRPG could

Introduce real time game mechanics, allowing conflict resolution beyond simple diplomacy

Provide a medium for the introduction of impractical fantastic game content (giant monsters, magical effects, etc)

Chief limitation – Bulky and awkward hardware

Is AR alone the best solution here?

Some problems can be solved very well in AR

Hybrid user interfaces – introduce PDAs or similar data devices

Current Work Hybrid AR Worms Tankwar

Hybrid AR Worms

Tankwar

Future Work User studies Expand on Tankwar Explore possibilities in RPGs Remote games – controlled orienteering

User studies

Expand on Tankwar

Explore possibilities in RPGs

Remote games – controlled orienteering

Summary Four part consideration of existing games Physical Mental Social Emotional Case Studies War Games Role Playing Games Tankwar AR Worms Questions??

Four part consideration of existing games

Physical

Mental

Social

Emotional

Case Studies

War Games

Role Playing Games

Tankwar

AR Worms

Questions??