Challenge, Drama & Social
Engagement: Designing Mobile
Augmented Reality Experiences
Gene Becker
twitter @genebecker
gene@...
a remarkable confluence of technologies



                                            Cloud services
                    ...
what is augmented reality?


      Augmented reality is…

      • a technology
      • a field of research
      • a visio...
augmented reality is a technology



     Augmented reality is the display of computer
     graphics and media, overlaid a...
AR research: first HMD - Ivan Sutherland (1966)




                   The “Sword of Damocles”
AR research: wearable computing - Steve Mann




http://wearcam.org/steve.html
AR research: first mobile AR system




Feiner et al, Touring Machine (1997), Columbia University
http://graphics.cs.colum...
visual search on the physical world concept design by mac funamizu




                                     source: http:/...
querying the natural world concept design by mac funamizu




                                     source: http://petitinv...
computational print media concept design by mac funamizu




                                     source: http://petitinve...
seeing through space and time concept design by mac funamizu




                                    source: http://petiti...
the end of personal privacy? concept by TAT

    Augmented reality is the collapse of social nuance
    and the end of per...
social augmented reality concept sketches by matthew buckland




                                                        ...
social augmented reality concept sketches by matthew buckland




                                                        ...
social augmented reality concept sketches by matthew buckland




                                                        ...
and just wait ‘til the glasses get here concept design by mac funamizu




                                      source: h...
commercial mobile AR example: Layar


         [video]




                         Layar demo video: http://www.youtube.c...
commercial webcam AR example: Metaio


        [video]




                         Metaio demo video: http://www.youtube....
augmented reality is a new medium



    Augmented reality is a new medium of creative
    expression that expands human e...
what makes a compelling experience?
                           Physical / Mental      Self-Expression
                    ...
the reality of AR experiences today



                   What works:
                   * Physical engagement
           ...
mobile AR issues & limitations
    Technical limitations
    • Sensor accuracy (GPS, compass etc)
    • Indoor positioning...
visionary example: AR gaming HP concept video




                                HP vision video Roku’s Reward: http://ww...
what makes a compelling AR experience?
                               Physical / Mental       Self-Expression
            ...
mobile AR experience design practices


     1. Understand limitations and design around them

     2. Design for challeng...
mobile AR experience design practices


     1. Understand current limitations and design around them

     • Use augments...
mobile AR experience design practices

   2. Design for challenge, expression and flow

   • Make the experience the focus...
mobile AR experience design practices

     3. Design for physical sensation & emotional drama

     • Scout the location,...
mobile AR experience design practices




   4. Design for social bonding, sharing, competition

   • Game mechanics drive...
mobile AR experience design practices

     5. Bring an interdisciplinary media production mindset

     Creating mobile A...
mobile AR authoring demo

        • a large scale driving experience overlaid on the Bay Area
        • primarily audio AR...
AR history: sub




              Questions?
              Gene Becker
              tw: @genebecker
              web: ww...
Upcoming SlideShare
Loading in...5
×

Experience Design for Mobile Augmented Reality

5,681

Published on

Published in: Technology
0 Comments
20 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
5,681
On Slideshare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
283
Comments
0
Likes
20
Embeds 0
No embeds

No notes for slide

Experience Design for Mobile Augmented Reality

  1. 1. Challenge, Drama & Social Engagement: Designing Mobile Augmented Reality Experiences Gene Becker twitter @genebecker gene@lightninglaboratories.com
  2. 2. a remarkable confluence of technologies Cloud services Robotics Augmented reality Mobile MMO platforms Wireless Social media Displays 2000 - 2020 Digital media Imaging Gesture Storage Tagging Sensing Power 3D printing Nano Bio
  3. 3. what is augmented reality? Augmented reality is… • a technology • a field of research • a vision of future computing • an emerging commercial industry • a new medium for creative expression
  4. 4. augmented reality is a technology Augmented reality is the display of computer graphics and media, overlaid and registered on real-world environments, interactively in real time. AR platforms exist at the intersection of several technical disciplines, including computer graphics, machine vision, sensing and sensor fusion, geographic information systems, mobile systems, ubiquitous computing and the web.
  5. 5. AR research: first HMD - Ivan Sutherland (1966) The “Sword of Damocles”
  6. 6. AR research: wearable computing - Steve Mann http://wearcam.org/steve.html
  7. 7. AR research: first mobile AR system Feiner et al, Touring Machine (1997), Columbia University http://graphics.cs.columbia.edu/projects/mars/mars.html
  8. 8. visual search on the physical world concept design by mac funamizu source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
  9. 9. querying the natural world concept design by mac funamizu source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
  10. 10. computational print media concept design by mac funamizu source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
  11. 11. seeing through space and time concept design by mac funamizu source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
  12. 12. the end of personal privacy? concept by TAT Augmented reality is the collapse of social nuance and the end of personal privacy.
  13. 13. social augmented reality concept sketches by matthew buckland Source: http://www.matthewbuckland.com/?p=1041
  14. 14. social augmented reality concept sketches by matthew buckland Source: http://www.matthewbuckland.com/?p=1041
  15. 15. social augmented reality concept sketches by matthew buckland Source: http://www.matthewbuckland.com/?p=1041
  16. 16. and just wait ‘til the glasses get here concept design by mac funamizu source: http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/
  17. 17. commercial mobile AR example: Layar [video] Layar demo video: http://www.youtube.com/watch?v=b64_16K2e08
  18. 18. commercial webcam AR example: Metaio [video] Metaio demo video: http://www.youtube.com/watch?v=HFyqRiA33ik
  19. 19. augmented reality is a new medium Augmented reality is a new medium of creative expression that expands human experience AR combines the web, images, sound, movies, games, search engines, databases, advertising, social media…and explodes them across the physical world of people, places and things, revealing the invisible stories that are everywhere around us. But we have a lot of work to do.
  20. 20. what makes a compelling experience? Physical / Mental Self-Expression Challenge & Creativity see also: Flow and the psychology of optimal experience (Csikszentmihalyi) Challenge/ Expression Dimensions of Compelling Experience Drama/ Physical Stimulation Social Competing (sights, sounds, touch…) Sensation with others Mental / Emotional Bonding, Sharing & Stimulation, Imagination Cooperation ref: Hull, Reid “Experience Design for Pervasive Computing”
  21. 21. the reality of AR experiences today What works: * Physical engagement * Visually captivating * Emotional “wow” factor Challenge/ * Invisible stories, revealed Expression Dimensions What doesn‟t: of Compelling * Awkward use models Experience * No flow opportunities * No social dimension Drama/ Social Sensation * Point experiences only
  22. 22. mobile AR issues & limitations Technical limitations • Sensor accuracy (GPS, compass etc) • Indoor positioning • Line of sight • Device constraints (display, form factor, weight, battery, processor, network) • Lack of interoperable standards e.g. for location (lat/long/alt, CRS, orientation) • Relative positioning • Object recognition & tracking • Graphics issues (lighting, transparency, occlusion) Use model issues • Unnatural physical position • Ambiguous social signals • Cognitive model Authoring limitations • Platform specific • Low level tools, complex workflow • Focus on point interactions; no support for stories or interesting interactivity
  23. 23. visionary example: AR gaming HP concept video HP vision video Roku’s Reward: http://www.youtube.com/watch?v=vCCyfkGKL_w
  24. 24. what makes a compelling AR experience? Physical / Mental Self-Expression Challenge & Creativity running devising strategies wayfinding locating powerups using physical Challenge/ affordances racing against time collecting Expression items avoiding danger (in game and real) scoring points Dimensions physical/virtual of savoring the win Compelling confusion Experience racing against real & in game other players sounds Drama/ Physical Stimulation Social Competing (sights, sounds, touch…) Sensation with others kiss Mental / Emotional story line fantasy Bonding, Sharing & Stimulation, Imagination characters Cooperation ‘magic moments’ camaraderie sharing the surprise ref: Hull, Reid “Experience Design for Pervasive Computing”
  25. 25. mobile AR experience design practices 1. Understand limitations and design around them 2. Design for challenge, expression and flow 3. Design for physical sensation & emotional drama 4. Design for social bonding, sharing, competition 5. Bring an interdisciplinary media production mindset
  26. 26. mobile AR experience design practices 1. Understand current limitations and design around them • Use augments with appropriate requirements for precision & realism • Emphasize audio for immersion, continuity, story • Use ‘magic lens’ position sparingly • Fail gracefully & transparently
  27. 27. mobile AR experience design practices 2. Design for challenge, expression and flow • Make the experience the focus, not the technology • Set clear goals, expectations and rules • Design goals to balance between ability level and challenge (neither too easy nor too difficult). • Encourage focus and concentration, limit distractions and gratuitous interactions • Provide direct and immediate feedback so the user can adjust their actions. • Give users a sense of personal control over the situation or activity. • Make activities intrinsically rewarding, so there is an effortlessness of action.
  28. 28. mobile AR experience design practices 3. Design for physical sensation & emotional drama • Scout the location, know the environment & context deeply – sights, sounds, smells, textures, weather, rhythms, moods • Design for „magic moments‟ – mental immersion, physical/virtual coincidence, synaesthetic confusion • Emphasize sound design for immersion, continuity, story • Develop a cross-media story universe
  29. 29. mobile AR experience design practices 4. Design for social bonding, sharing, competition • Game mechanics drive competitive engagement – explicit multiplayer competition, implicit scoring & leveling systems • Social media integration to share broadly / vicariously • Tight and loose multi-person activities encourage bonding and shared experience
  30. 30. mobile AR experience design practices 5. Bring an interdisciplinary media production mindset Creating mobile AR experiences draws on skills from a broad range of creative disciplines including… • Scriptwriting • Direction • Casting • Art direction • Sound design • Special effects • Interaction design • Location scouting • Production management • Software development • Systems management • Testing & QA • Gamerunning • Tech support
  31. 31. mobile AR authoring demo • a large scale driving experience overlaid on the Bay Area • primarily audio AR • scriptable behaviors on geographic regions • context-aware behaviors • authored on PC, experienced on mobile
  32. 32. AR history: sub Questions? Gene Becker tw: @genebecker web: www.lightninglaboratories.com mail: gene@lightninglaboratories.com Lightning Laboratories provides Research and Consulting in augmented reality, ubiquitous computing, social media and the Internet of Things
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×