Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America

Where AR We Heading? Steven Feiner Computer Graphics & User Interfaces Lab Department of Computer Science Columbia University New York, NY 10027 Supported in part by NSF, ONR, USMC, and gifts from Microsoft, Google, Vuzix Augmented Reality Conference / eComm America 2010 San Francisco Airport Marriott, April 19–21, 2010

Over 40 Years of AR Research,…
Ivan Sutherland, Head-tracked VR/AR (Late 60s –early 70s)
Stereo, head-tracked, optical see-through, head-worn display
Graphics overlaid on real world
I. Sutherland, A Head-Mounted Three-Dimensional Display , Proc. AFIPS Fall Joint Comp. Conf. , 757 –764, 1968

Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Campus Tour, 1997

Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Historical Hypermedia Documentary, 1999

Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Restaurant Guide, 2001

Flash Forward to 2008, 9, 10,…
Commodity mobile devices
Small
Powerful
Inexpensive
Networked
Sensors
Ubiquitous
Content
Proliferating
Wikitude et al., 2008 – Columbia Mobile Augmented Reality System, 1996 – 2001 2001

Consider Mobile AR,… Where are We Now?

Issues: Inaccurate Tracking
A-GPS position inaccuracy
Compass orientation inaccuracy

Phone CPU/GPU/display better in 2010, but,…
Backpack position and orientation tracking better in 1999
RTK GNSS
Hybrid IMU

Better sensors
Different sensors ( vision ,…)  Sensor fusion
E.g., using a better orientation tracker
Y. Tokusho, M. Sukan, et al., 2009

Issues: Incorrect Field of View
Display FOV too small
Camera FOV too large
Not 1:1
Not parallax free
http://flickr.com/photos/click-see/25803640/

Cult of the hand-out
“ Excuse me while I whip out my phone, turn it on, hold it at arm’s length, wait until it’s started tracking…”
Issues: Handheld Lifestyle Y. Tokusho et al., 2009 S. G üven et al., 2006 http://labs.lastminute.com/nru/ Nokia

Issues: Handheld Lifestyle
The promise of eyewear
Hands-free
Always on
Must be
Small
Light
Bright / high contrast
Comfortable
Visually appealing
Affordable
Lumus Konica Minolta Sony Prototype optical see- through eyewear

Eyewear-Based Task Assistance graphics.cs.columbia.edu/projects/armar
S. Henderson & S. Feiner, 2009

Eyewear-Based Mobile Games goblinxna.codeplex.com
O. Oda & S. Feiner, 2009

Issues: UI Design for AR
Design presentations dynamically
Respect the real world!
E.g., automated layout accounting for occlusion
B. Bell et al., 2001

What ’s Next?

Ubiquitous
When we stop asking “What’s the Killer App?”

Heterogeneous N. Dedual & S. Feiner, 2010
Surface
Publicly visible
Multitouch
+
See-through HWD
Private
Stereo
Benefit from advantages of complementary displays and devices

Collaborative
E.g., Collaborative Tracking/Modeling

Collaborative Tracking/Modeling
Users
Want to know their location and “interesting information”
System
Wants to model the world (including users and their “interesting information”)

Collaborative Tracking/Modeling
User: Provides
Current
Sensor data: Imagery, audio, (A-)GPS, compass, inertial measurements, radio signal strength, GNSS carrier phase,…
Historic
Known position/orientation
Sensor data: …
Relevant “Interesting information”
System
Uses sensor data and history from user and others to match against database
Returns
User ’s (precise) current position/orientation
Relevant “Interesting information”
Updates database

Users
“ Just plain folk”
http://jonathan.tenkely.org/wordpress/wp-content/gallery/gallery/VectorPeople.png

System
“ The usual suspects”
Individual providers for private sites might make agreements with larger organizations

Results
Up-to-the-second Street {View, Side,…}
Current shop window contents
Current pedestrian traffic
Not just those who opt in, but others through face/gait/… recognition
“ Publicly observable behavior”
pedestrians

Results
Up-to-the-second world model
Made possible by uploaded sensor data
Fine-grained history
Provides past record
Makes predictions possible
The ultimate social network
And, you will be part of it

Privacy Issues?
http://foursquare.com
Where are you now?
http://plancast.com
Where are you going?
http://blippy.com
What are you buying?
http://everythingithink.com
What are you thinking?

Acknowledgments
Blaine Bell
Hrvoje Benko
G á bor Blask ó
Franz Coriand
Nick Dedual
Steve Henderson
Sinem G üven
Tobias H öllerer
Eddie Ishak
Levi Lister
Blair MacIntyre
Ohan Oda
John Pavlik
Mengu Sukan
Yoshitaka Tokusho
Tony Webster
Sean White
Lauren Wilcox
Ryuji Yamamoto
Supported in part by NSF, ONR, USMC, and gifts from Microsoft, Google, Vuzix
Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation
See you at ISMAR 2010 , Oct 13-16 Seoul, Korea, www.ismar10.org

http://blog.ecomm.ec	103
http://www.slideshare.net	13
http://feeds.feedburner.com	3
url_unknown	3

Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America

by eCommConf on May 28, 2010

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 122

Statistics

Seven Feiner’s Presentation at Emerging Communications Conference & Awards 2010 America — Presentation Transcript