Your SlideShare is downloading. ×
0
 
Where AR We Heading? Steven Feiner Computer Graphics & User Interfaces Lab Department of Computer Science Columbia Univers...
Over 40 Years of AR Research,… <ul><li>Ivan Sutherland, Head-tracked VR/AR (Late 60s –early 70s) </li></ul><ul><ul><li>Ste...
Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Campus Tour, 1997
Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Historical Hypermedia Documentary, 1999
Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Restaurant Guide, 2001
Flash Forward to 2008, 9, 10,… <ul><li>Commodity mobile devices </li></ul><ul><ul><li>Small </li></ul></ul><ul><ul><li>Pow...
Consider Mobile AR,… Where are We Now?
Issues: Inaccurate Tracking <ul><li>A-GPS position inaccuracy </li></ul><ul><li>Compass orientation inaccuracy </li></ul>
Issues: Inaccurate Tracking <ul><li>Phone CPU/GPU/display better in 2010, but,… </li></ul><ul><li>Backpack position and or...
Issues: Inaccurate Tracking <ul><li>Better sensors </li></ul><ul><li>Different sensors ( vision ,…)   Sensor fusion </li>...
Issues: Incorrect Field of View <ul><li>Display FOV too small </li></ul><ul><li>Camera FOV too large </li></ul><ul><ul><li...
<ul><li>Cult of the hand-out </li></ul><ul><ul><li>“ Excuse me while I whip out my phone, turn it on, hold it at arm’s len...
Issues: Handheld Lifestyle <ul><li>The promise of eyewear </li></ul><ul><ul><li>Hands-free </li></ul></ul><ul><ul><li>Alwa...
Eyewear-Based Task Assistance graphics.cs.columbia.edu/projects/armar <ul><li>S. Henderson & S. Feiner, 2009 </li></ul>
Eyewear-Based Mobile Games goblinxna.codeplex.com <ul><li>O. Oda & S. Feiner, 2009 </li></ul>
Issues: UI Design for AR <ul><li>Design presentations dynamically </li></ul><ul><ul><li>Respect the real world! </li></ul>...
What ’s Next?
Ubiquitous <ul><li>When we stop asking “What’s the Killer App?” </li></ul>
Heterogeneous   N. Dedual & S. Feiner, 2010 <ul><li>Surface </li></ul><ul><ul><li>Publicly visible </li></ul></ul><ul><ul>...
Collaborative <ul><li>E.g., Collaborative Tracking/Modeling </li></ul>
Collaborative Tracking/Modeling <ul><li>Users </li></ul><ul><ul><li>Want to know their location and  “interesting informat...
Collaborative Tracking/Modeling <ul><li>User: Provides </li></ul><ul><ul><li>Current </li></ul></ul><ul><ul><ul><li>Sensor...
Users <ul><li>“ Just plain folk” </li></ul>http://jonathan.tenkely.org/wordpress/wp-content/gallery/gallery/VectorPeople.png
System <ul><li>“ The usual suspects” </li></ul><ul><li>Individual providers for private sites might make agreements with l...
Results <ul><li>Up-to-the-second Street {View, Side,…}  </li></ul><ul><ul><li>Current shop window contents </li></ul></ul>...
Results <ul><li>Up-to-the-second world model </li></ul><ul><ul><li>Made possible by uploaded sensor data  </li></ul></ul><...
Privacy Issues? <ul><li>http://foursquare.com </li></ul><ul><ul><li>Where are you now? </li></ul></ul><ul><li>http://planc...
Acknowledgments <ul><li>Blaine Bell </li></ul><ul><li>Hrvoje Benko </li></ul><ul><li>G á bor Blask ó </li></ul><ul><li>Fra...
 
Upcoming SlideShare
Loading in...5
×

Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America

1,348

Published on

Please see corresponding blog http://blog.eComm.ec

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,348
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
20
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Add arrow slide for ARMAR?
  • What ’s not to like?
  • Need orthoscopic display!!!!
  • Video plays automatically
  • Video plays automatically
  • Transcript of "Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America"

    1. 2. Where AR We Heading? Steven Feiner Computer Graphics & User Interfaces Lab Department of Computer Science Columbia University New York, NY 10027 Supported in part by NSF, ONR, USMC, and gifts from Microsoft, Google, Vuzix Augmented Reality Conference / eComm America 2010 San Francisco Airport Marriott, April 19–21, 2010
    2. 3. Over 40 Years of AR Research,… <ul><li>Ivan Sutherland, Head-tracked VR/AR (Late 60s –early 70s) </li></ul><ul><ul><li>Stereo, head-tracked, optical see-through, head-worn display </li></ul></ul><ul><ul><li>Graphics overlaid on real world </li></ul></ul>I. Sutherland, A Head-Mounted Three-Dimensional Display , Proc. AFIPS Fall Joint Comp. Conf. , 757 –764, 1968
    3. 4. Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Campus Tour, 1997
    4. 5. Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Historical Hypermedia Documentary, 1999
    5. 6. Over 13 Years of Mobile AR Research,… Columbia “Touring Machine” 1996 – AR Restaurant Guide, 2001
    6. 7. Flash Forward to 2008, 9, 10,… <ul><li>Commodity mobile devices </li></ul><ul><ul><li>Small </li></ul></ul><ul><ul><li>Powerful </li></ul></ul><ul><ul><li>Inexpensive </li></ul></ul><ul><ul><li>Networked </li></ul></ul><ul><li>Sensors </li></ul><ul><ul><li>Ubiquitous </li></ul></ul><ul><li>Content </li></ul><ul><ul><li>Proliferating </li></ul></ul>Wikitude et al., 2008 – Columbia Mobile Augmented Reality System, 1996 – 2001 2001
    7. 8. Consider Mobile AR,… Where are We Now?
    8. 9. Issues: Inaccurate Tracking <ul><li>A-GPS position inaccuracy </li></ul><ul><li>Compass orientation inaccuracy </li></ul>
    9. 10. Issues: Inaccurate Tracking <ul><li>Phone CPU/GPU/display better in 2010, but,… </li></ul><ul><li>Backpack position and orientation tracking better in 1999 </li></ul><ul><ul><li>RTK GNSS </li></ul></ul><ul><ul><li>Hybrid IMU </li></ul></ul>
    10. 11. Issues: Inaccurate Tracking <ul><li>Better sensors </li></ul><ul><li>Different sensors ( vision ,…)  Sensor fusion </li></ul><ul><ul><li>E.g., using a better orientation tracker </li></ul></ul><ul><li>Y. Tokusho, M. Sukan, et al., 2009 </li></ul>
    11. 12. Issues: Incorrect Field of View <ul><li>Display FOV too small </li></ul><ul><li>Camera FOV too large </li></ul><ul><ul><li>Not 1:1 </li></ul></ul><ul><ul><li>Not parallax free </li></ul></ul>http://flickr.com/photos/click-see/25803640/
    12. 13. <ul><li>Cult of the hand-out </li></ul><ul><ul><li>“ Excuse me while I whip out my phone, turn it on, hold it at arm’s length, wait until it’s started tracking…” </li></ul></ul>Issues: Handheld Lifestyle Y. Tokusho et al., 2009 S. G üven et al., 2006 http://labs.lastminute.com/nru/ Nokia
    13. 14. Issues: Handheld Lifestyle <ul><li>The promise of eyewear </li></ul><ul><ul><li>Hands-free </li></ul></ul><ul><ul><li>Always on </li></ul></ul><ul><ul><li>Must be </li></ul></ul><ul><ul><ul><li>Small </li></ul></ul></ul><ul><ul><ul><li>Light </li></ul></ul></ul><ul><ul><ul><li>Bright / high contrast </li></ul></ul></ul><ul><ul><ul><li>Comfortable </li></ul></ul></ul><ul><ul><ul><li>Visually appealing </li></ul></ul></ul><ul><ul><ul><li>Affordable </li></ul></ul></ul>Lumus Konica Minolta Sony Prototype optical see- through eyewear
    14. 15. Eyewear-Based Task Assistance graphics.cs.columbia.edu/projects/armar <ul><li>S. Henderson & S. Feiner, 2009 </li></ul>
    15. 16. Eyewear-Based Mobile Games goblinxna.codeplex.com <ul><li>O. Oda & S. Feiner, 2009 </li></ul>
    16. 17. Issues: UI Design for AR <ul><li>Design presentations dynamically </li></ul><ul><ul><li>Respect the real world! </li></ul></ul><ul><ul><li>E.g., automated layout accounting for occlusion </li></ul></ul>B. Bell et al., 2001
    17. 18. What ’s Next?
    18. 19. Ubiquitous <ul><li>When we stop asking “What’s the Killer App?” </li></ul>
    19. 20. Heterogeneous N. Dedual & S. Feiner, 2010 <ul><li>Surface </li></ul><ul><ul><li>Publicly visible </li></ul></ul><ul><ul><li>Multitouch </li></ul></ul><ul><li>+ </li></ul><ul><li>See-through HWD </li></ul><ul><ul><li>Private </li></ul></ul><ul><ul><li>Stereo </li></ul></ul><ul><li>Benefit from advantages of complementary displays and devices </li></ul>
    20. 21. Collaborative <ul><li>E.g., Collaborative Tracking/Modeling </li></ul>
    21. 22. Collaborative Tracking/Modeling <ul><li>Users </li></ul><ul><ul><li>Want to know their location and “interesting information” </li></ul></ul><ul><li>System </li></ul><ul><ul><li>Wants to model the world (including users and their “interesting information”) </li></ul></ul>
    22. 23. Collaborative Tracking/Modeling <ul><li>User: Provides </li></ul><ul><ul><li>Current </li></ul></ul><ul><ul><ul><li>Sensor data: Imagery, audio, (A-)GPS, compass, inertial measurements, radio signal strength, GNSS carrier phase,… </li></ul></ul></ul><ul><ul><li>Historic </li></ul></ul><ul><ul><ul><li>Known position/orientation </li></ul></ul></ul><ul><ul><ul><li>Sensor data: … </li></ul></ul></ul><ul><ul><li>Relevant “Interesting information” </li></ul></ul><ul><li>System </li></ul><ul><ul><li>Uses sensor data and history from user and others to match against database </li></ul></ul><ul><ul><li>Returns </li></ul></ul><ul><ul><ul><li>User ’s (precise) current position/orientation </li></ul></ul></ul><ul><ul><ul><li>Relevant “Interesting information” </li></ul></ul></ul><ul><ul><li>Updates database </li></ul></ul>
    23. 24. Users <ul><li>“ Just plain folk” </li></ul>http://jonathan.tenkely.org/wordpress/wp-content/gallery/gallery/VectorPeople.png
    24. 25. System <ul><li>“ The usual suspects” </li></ul><ul><li>Individual providers for private sites might make agreements with larger organizations </li></ul>
    25. 26. Results <ul><li>Up-to-the-second Street {View, Side,…} </li></ul><ul><ul><li>Current shop window contents </li></ul></ul><ul><ul><li>Current pedestrian traffic </li></ul></ul><ul><ul><li>Not just those who opt in, but others through face/gait/… recognition </li></ul></ul><ul><ul><ul><li>“ Publicly observable behavior” </li></ul></ul></ul>pedestrians
    26. 27. Results <ul><li>Up-to-the-second world model </li></ul><ul><ul><li>Made possible by uploaded sensor data </li></ul></ul><ul><li>Fine-grained history </li></ul><ul><ul><li>Provides past record </li></ul></ul><ul><ul><li>Makes predictions possible </li></ul></ul><ul><li>The ultimate social network </li></ul><ul><ul><li>And, you will be part of it </li></ul></ul>
    27. 28. Privacy Issues? <ul><li>http://foursquare.com </li></ul><ul><ul><li>Where are you now? </li></ul></ul><ul><li>http://plancast.com </li></ul><ul><ul><li>Where are you going? </li></ul></ul><ul><li>http://blippy.com </li></ul><ul><ul><li>What are you buying? </li></ul></ul><ul><li>http://everythingithink.com </li></ul><ul><ul><li>What are you thinking? </li></ul></ul>
    28. 29. Acknowledgments <ul><li>Blaine Bell </li></ul><ul><li>Hrvoje Benko </li></ul><ul><li>G á bor Blask ó </li></ul><ul><li>Franz Coriand </li></ul><ul><li>Nick Dedual </li></ul><ul><li>Steve Henderson </li></ul><ul><li>Sinem G üven </li></ul><ul><li>Tobias H öllerer </li></ul><ul><li>Eddie Ishak </li></ul><ul><li>Levi Lister </li></ul><ul><li>Blair MacIntyre </li></ul><ul><li>Ohan Oda </li></ul><ul><li>John Pavlik </li></ul><ul><li>Mengu Sukan </li></ul><ul><li>Yoshitaka Tokusho </li></ul><ul><li>Tony Webster </li></ul><ul><li>Sean White </li></ul><ul><li>Lauren Wilcox </li></ul><ul><li>Ryuji Yamamoto </li></ul><ul><li>Supported in part by NSF, ONR, USMC, and gifts from Microsoft, Google, Vuzix </li></ul><ul><li>Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation </li></ul>See you at ISMAR 2010 , Oct 13-16 Seoul, Korea, www.ismar10.org
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×