Augmented Reality: Beyond the Hype

AUGMENTED REALITY BEYOND THE HYPE Dr Paul Coulton and Klen Čopič PuciharBanksy

Mixed Reality Real Augmented Augmented VirtualEnvironment Reality Virtuality RealityMIXED REALITY CONTINUUM Paul Milgram

WHAT ISAUGMENTED REALITY?The term AR is being used in all sorts of ways but thegenerally accepted deﬁnition is that it:Combines the real and virtual Is interactive in real time Is registered in 3D

WHAT ISNT AUGMENTED REALITY? Location‐based services Barcode detection (QR codes) Augmenting still images Special effects in movies Photo‐based object recognitionAlessandro Mulloni ... Yu-Gi-Oh! Zexal

GENERAL CHALLENGES OF AR Strict real time operation (30Hz) High spatial precision (1cm, 1 degree) Robustness for operation by human userAlessandro Mulloni

CHALLENGESOF MOBILE ARSame level of performance as desktop AR No unrealistic assumptions about hardwareVariable operating contexts Layar

Image Denno CoilFLAVOURS OF MOBILE AR WEARABLE AR Wearable system Head‐mounted display AR always in view (immersive) Demo Sixth Sense

FLAVOURS OF MOBILE AR HANDHELD AR Mobile phone as platformPhone acts as a “magic lens” Non‐immersive view Tom’s Hardware

WHY USE PHONES?Low cost, Ubiquity, Robust, Self Contained

WHY NOT USE PHONES?Low memory, Limited power, Small Screen, Limited Inputs available, Fragmentation

PERCEPTUAL PROBLEMS You see through the camera not the phone!

Get video frame from camera DEVELOPING AR Estimate position and orientation of the cameraAPPLICATIONS Render the augmented scene (video and virtual) What is involved in the process? Render GUI Process the user input Update application status

Phones withHandheld Phones acceleromet AR with GPS ers Phones withDisplays two Camera cameras Phones PDA Phone Phones On device with 3D with Wearable HW compass AR AR Phone Thin Phones with PDA client AR gyroscopes Thin client AR1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 EVOLUTION OF MOBILE AR

ESTIMATINGTHE DEVICE POSE Sensor trackingVision‐based tracking

SENSOR BASED Used by many commercial “AR browsers” GPS, Compass,Accelerometer, (Gyroscope) Demo Wikitude

GPSOriginally 24 satellites but 31 as of 2008Bill Clinton cleared GPS for commercial use in 1996

GPS Spatial ScatteringSystem and Environmental Effects

ACCELEROMETERS

MAGNETOMETERS

David McCandlessInformation is Beautiful DATA SOURCES Quality, Availability, Crowd Sourcing

VISION BASED MARKER TRACKING Standard Vision techniques Marker provides 4 cornersfrom this we can get the pose

VISION BASED MARKER TRACKING1.Convert image to black and white 2. Search for edges3. Follow edges 4. Find rectangle corners !* K* C* :* Daniel Wagner

VISION BASED MARKER TRACKING5.Estimate homography using 4corners 6. Extract pattern by sampling7. Check Pattern Daniel Wagner

MARKER TRACKING PIPELINE Daniel Wagner

VISION BASED MARKER TRACKING Nintendo 3DS AR

VISION BASED NATURAL FEATURE TRACKINGTracking features from natural environment More difﬁcult than marker Less established techniques Slower than marker based PTAM

VISION BASED NATURAL FEATURE TRACKING Edges - boundariesCorners - local 2D structure Blobs - regions rather than pointsRidges - elongated structures

VISION BASED NATURAL FEATURE TRACKING OfﬂineUse still images to build data base of features

Camera ImageVISION BASED Keypoint Detection NATURAL FEATURE Outlier Removal TRACKING Pose Estimation OnlineCreating maps are markers RECOGNITION online Real-Time Pipeline Pose

VISION BASED NATURAL FEATURE TRACKING Online

• SENSORS • VISION • Noise Output • High Accuracy • Low Accuracy • Local Pose • Global Pose • Memory Intensive • Works when • Works only when nothing to track Objects to Track HYBRID TECHNIQUES

DESIGN MOCKUPSAR is easy to understand, but hard to explain in words. Ease of creation. Holding strong memorable message.

CONCLUSIONS• Augmented Reality is currently the hot topic from a continuum of possible systems.• Mobile phones provide the most obvious platform for the widespread adoption of AR.• Majority of current commercial offering are sensor based which gives crude contextual sensitivity but this may be ﬁne for your application. These solutions generally are dependant on quality of the data source.• Marker based solutions give greater accuracy although we arent likely to cover the world with markers work well for advertising.• Marker-less systems offer the ‘dream’ of AR but currently present considerable technical challenges.• If your considering AR ask what beneﬁts it gives the user apart from being ‘cool’.

OTHER INTERESTING AR STUFF

http://flatworldbusiness.wordpress.com	1156
http://www.scoop.it	505
http://development.blog.shinobi.jp	165
http://paper.li	136
http://lurnq.com	25
http://ricardoevalenzuelaruiz.blogspot.com	17
http://us-w1.rockmelt.com	9
http://a0.twimg.com	6
http://twitter.com	5
http://translate.googleusercontent.com	4
http://tweetedtimes.com	4
http://lanyrd.com	4
http://www.linkedin.com	2
http://webcache.googleusercontent.com	1
http://drizzlin.com	1
http://ww.flatworldbusiness.wordpress.com	1
http://www.slideshare.net	1
https://twimg0-a.akamaihd.net	1
http://techno-sphere.blogspot.com	1

Augmented Reality: Beyond the Hype

by Paul Coulton on Sep 13, 2011

Accessibility

Categories

Upload Details

Usage Rights

19 Embeds 2,044

Statistics

Augmented Reality: Beyond the Hype Presentation Transcript