Mobile Augmented Reality: Nokia

Image Space A user-created mirror world • reflecting th physical world fl ti the h i l ld • intuitive spatial browsing experience p Representation • Sparse representation of the world Nokia Image Space and Augmented Reality at Mobile World Congress 2009 based on geo-registered images, audio and video • 3D reconstruction or models of Introduced in Nokia buildings, etc., based on freely- Beta Labs in P6/09 taken images 26 August, 2009 Kari Pulli | NRC © 2008 5

Intuitive Navigation Meaningful navigation through the physical world by following image story-paths – y g g yp user generated interactions You wonder which part of the city to explore next. Turn your device to see spatially interlinked images taken by others to experience alternative routes through the city. © 2008 Nokia 6 V1-Filename.ppt /

System Overview GPS Server 0:30-1:40 G. Takacs, V. Chandrasekhar, N. Gelfand, Y. Xiong, W-C Chen, T. Bismpigiannis, R. Grzeszczuk, K. Pulli, B. Girod Outdoor Augmented Reality on Mobile Phone using Loxel-Based Visual Feature Organization 26 August, 2009 Kari Pulli | NRC © 2008 8 ACM International Conference on Multimedia Information Retrieval (MIR'08)

Landmark-based navigation 9

Good landmarks Image count is an indicator of landmark popularity Require good visibility f R i d i ibilit from current l t location ti Prefer landmarks that are straight ahead 10

Augment images Use known locations to estimate camera direction Draw an arrow i th i D in the image Generate relative text directions Keep walking straight, toward West Gate H. Hile, R. Grzeszczuk A. Liu, R. Vedantham, J. Kosecka, G. Borriello Landmark-based Pedestrian navigation with Enhanced Spatial Reasoning 11 Pervasive 2009.

Goal: Bring AR to outdoor environment Location-based context information  Need: Large-scale scene recognition  Must use scale-invariant features with strong descriptors for matching Target mobile devices  Need: Efficient real-time tracking on the mobile platform  Cannot detect and match scale-invariant features for every frame! Duy-Nguyen Ta, Natasha Gelfand, Wei-Chao Chen, Kari Pulli 12 SURFTrac: Efficient Tracking and Continuous Object Recognition using Local Feature Descriptors IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'09)

Matching and Tracking with an Image Database 13

Point of sale example: point at products in store and g get details, p promos, videos, more Shopping in a Instant Results: store...  Detailed product info Point phone  Video demo at a product (camera)  Virtual tour  Special offers (coupon or rebate)  Accessories  Send message to friend about product p 16 16 © 2008 Nokia

Interaction metaphors Previous projects use the “Hand-held Magic Lens” metaphor · camera on th “f side” of the d i grabs i the “far id ” f th device b image · device adds annotations · display on the “near side of the device near side” What about data goggles? · that’s what Augmented / Mixed Reality used to be all about · is that feasible? 26 August, 2009 Kari Pulli | NRC © 2008 17

Summary Blended realities – Why? · access i f information visually, on l ti i ll location ti Main metaphor · magic lens: annotate view of real world Devices · hand-held camera phone NOW · data glasses FUTURE 26 August, 2009 Kari Pulli | NRC © 2008 22

http://asserttrue.blogspot.com	351
http://virtualworldsig.com	74
http://www.slideshare.net	30
http://www.levidepoches.fr	11
http://c8blog.canvas8.com	10
http://jujo00obo2o234ungd3t8qjfcjrs3o6k-a-sites-opensocial.googleusercontent.com	6
http://levidepoches.blogs.com	6
http://augmentedreport.com	4
http://asserttrue.blogspot.co.uk	4
http://www.levidepoches.blogs.com	3
http://canvas8blog.com	3
http://sap-virtual.blogspot.com	2
http://asserttrue.blogspot.com.au	2
http://asserttrue.blogspot.mx	1
http://asserttrue.blogspot.it	1
http://asserttrue.blogspot.in	1
http://asserttrue.blogspot.ca	1
http://asserttrue.blogspot.com.es	1
http://www.augmentedreport.com	1
http://7umo.info	1
http://translate.googleusercontent.com	1
http://blog.canvas8.com	1
http://feeds2.feedburner.com	1
resource://brief-content	1
http://posterous.com	1
http://asserttrue.blogspot.fr	1

Mobile Augmented Reality: Nokia

by StudioSFO on Aug 31, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

26 Embeds 519

Statistics

Mobile Augmented Reality: Nokia — Presentation Transcript