A Brief Introduction to Augmented Reality IE 543 3 Nov 2008 Trond Nilsen

What is it? Overlaying virtual imagery on the real world Merging the real and the virtual Simultaneous interaction

Overlaying virtual imagery on the real world

Merging the real and the virtual

Simultaneous interaction

A Brief History (1) 1960s – Sutherland & Sproull’s first HMD

1960s – Sutherland & Sproull’s first HMD

A Brief History (2) 1970s / 1980s – USAF helmet displays, Super cockpit (Furness)

1970s / 1980s – USAF helmet displays, Super cockpit (Furness)

A Brief History (3) Early 1990s – Boeing wire harness assembly application. Early to mid 1990s – UNC ultrasound visualization project

Early 1990s – Boeing wire harness assembly application.

Early to mid 1990s – UNC ultrasound visualization project

AR – Brief History (4) Early 2000s : Outdoor AR ARToolkit / Magic Book Applications!

Early 2000s :

Outdoor AR

ARToolkit / Magic Book

Applications!

AR - Applications Many applications, Engineering Archaeology Medicine Architecture Visualization Military

Many applications,

Engineering

Archaeology

Medicine

Architecture

Visualization

Military

Video – AR Pancho

How? Two main problems Tracking the real world Displaying the virtual objects Variety of technology solutions for each problem

Two main problems

Tracking the real world

Displaying the virtual objects

Variety of technology solutions for each problem

Tracking Magnetic Fast and accurate Expensive, normally requires setup Inertial Cheap and somewhat inaccurate Must be frequently recalibrated Computer Vision Range of techniques Reasonably accurate Cheap

Magnetic

Fast and accurate

Expensive, normally requires setup

Inertial

Cheap and somewhat inaccurate

Must be frequently recalibrated

Computer Vision

Range of techniques

Reasonably accurate

Cheap

Tracking Mechanical Potentially very accurate Attached to device Works well in conjunction with haptic feedback Ultrasound Potentially accurate, May suffer from interference GPS Suitable for outdoor AR Hybrid solutions

Mechanical

Potentially very accurate

Attached to device

Works well in conjunction with haptic feedback

Ultrasound

Potentially accurate,

May suffer from interference

GPS

Suitable for outdoor AR

Hybrid solutions

How? Displays!

Is it realistic? Delay Rendering quality Lighting Error Non-tangible Mediated video

Delay

Rendering quality

Lighting

Error

Non-tangible

Mediated video

Video – AR Relight

ARToolKit

Reality / Virtuality Continuum

AR – Transitional Interfaces Interfaces that move you along the continuum Supports egocentric and exocentric views Exocentric - View from above Egocentric - View from within Appropriate for different tasks

Interfaces that move you along the continuum

Supports egocentric and exocentric views

Exocentric - View from above

Egocentric - View from within

Appropriate for different tasks

AR - Collaboration Wide variety of cues used when communicating Speech Paralinguistic Paraverbals Prosodics Intonation Audio Gaze Gesture Face Expression Body Position Visual Object Manipulation Writing/Drawing Spatial Relationship Object Presence Contact Environmental

Wide variety of cues used when communicating

AR - Collaboration Face-to-face collaboration People surround a table It is easy to see each other Computer collaboration People sit side by side It is hard to see each other

Face-to-face collaboration

People surround a table

It is easy to see each other

Computer collaboration

People sit side by side

It is hard to see each other

AR - Collaboration Attributes: Virtuality Augmentation Cooperation Independence Individuality Seamless Interaction Natural Communication Role division Privacy

Attributes:

Virtuality

Augmentation

Cooperation

Independence

Individuality

Seamless Interaction

Natural Communication

Role division

Privacy

AR – Hybrid User Interfaces

AR – Magic Lenses Developed at Xerox PARC in 1993 View a region of the workspace differently to the rest Not limited to magnification

Developed at Xerox PARC in 1993

View a region of the workspace differently to the rest

Not limited to magnification

AR – Magic Lens Focus + Context – two data sets Direct comparison of differing data sets in situ Selection

Focus + Context – two data sets

Direct comparison of differing data sets in situ

Selection

AR Gaming

Gaming - ARQuake Developed by Wayne Piekarski & Bruce Thomas at University of South Australia Modified version of Quake for Tinmith Outdoor AR system

Developed by Wayne Piekarski & Bruce Thomas at University of South Australia

Modified version of Quake for Tinmith Outdoor AR system

Gaming – AR Tankwar

Video – AR Tankwar