Your SlideShare is downloading. ×
0
CONTEXTUAL
AUGMENTED REALITY
Brian Selzer
VP Business and Product Development
DAQRI.com
Sensor-Based Storytelling
CONTEXT
IS
KING
Our mobile devices
are designed to know
us at a deep level
Mobile is transforming… Sensor-based
wearable's are coming to everyBODY.
Things once silent
now have a voice
Connected to the world
Low powered, low cost transmitters
provide services based on
environmental awareness
The time to
lament the loss of
privacy is over.
It’s now about
transparency.
Privacy is an exchange which
needs to be negotiated between
people and businesses
THROUGH THE
LOOKING GLASS
Augmented Reality (AR)
as a canned experience
is very limiting, and has
no repeat value.
Augmented Reality (AR)
which requires holding
phone up in front of face
is limiting (arm fatigue).
AR will help to visualize
the Internet of Everything
UI TO THE WORLD
AR has the potential to be the User-Interface to
the world itself… conveying data about
everything around ...
Which is more effective at getting
drivers to slow down?
Instant
feedback
Speeding ticket in the
mail two weeks later
OR
Real-time feedback loops
(visualized via AR) will change
how we live, work and play
• Firefighters
• Soldiers
• Pilots
• Surgeons
• Manufacturers
• Etc.
AR-enhanced HMD’s
will become a need
for professionals
Video game-like
HUD design for
real world
applications.
THE FUTURE OF
STORYTELLING
What story will the kitchen
of the future tell?
The predictive
story needs to
be intelligent
and precise.
Did Minority Report
get it right?
The AI assistant of
the future may be
digitally designed to
show us, as well as
tell us.
Pervasive Gaming
Pervasive Gaming -
Always on; all around us;
ready when we are…
Some final thoughts…
• We are on a path to integrating ourselves with the
internet of everything.
• AR will serve as a UI/...
Ambient Intelligence
Embedded, context aware, highly
personal, reactive, adaptive,
anticipatory, constantly evolving…
Email: Brian.Selzer@Daqri.com
Twitter: BrianSe7en
Web: Daqri.com / BrianSelzer.com
Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation
Upcoming SlideShare
Loading in...5
×

Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation

5,136

Published on

Slides from my talk at AWE2014.

Youtube video is available here - http://youtu.be/OxKC1AyZ26U

I took 15 minutes to cover a few fun topics.. contextually aware apps, embedded sensors, wearables, the internet of things, quantified self movement, feedback loops, privacy vs transparency, AR UI/UX, HMD's, smart homes, pervasive gaming, and ambient intelligence.

0 Comments
11 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
5,136
On Slideshare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
65
Comments
0
Likes
11
Embeds 0
No embeds

No notes for slide
  • SLIDE – Privacy is an exchange which needs to be negotiated between people and businesses.

    It’s now about getting control over your privacy stream, and understanding who is collecting and how they are using.

    Set your Privacy to ON or OFF… based on the context you are in.

    Pattern Privacy is the next layer. Consumers will want to know how they are being analyzed.

    Today, companies today bind us into long, unenforceable, one-sided contracts. This is the next battle ground.

    Companies which try to predict the intentions of consumers will face the most scrutiny. (This is where many companies are focused now).

  • SLIDE – Todays Augmented Reality is typically a canned experience, and is very limiting, with no repeat value.

    Canned AR is the equivalent of a digital Pop Up Book. A one-trick-pony. This remains the typical experience.

    To date, to much of the focus has been on “wow-factor” of the mixed reality experience itself.

    There is some context here though - Visual Recognition of the Image. VISION is key to the AR medium (identification, correlations, knowledge transfer…)

    Still this image recognition is just part of the foundation of AR, and it is time to evolve.

  • SLIDE – AR which requires holding your pone up in front of your face is limiting (arm fatigue)

    Early AR browser Apps (Layar, Wikitude etc.) started by focusing here on location and mapping. The smartphone form-factor is not ideal though for this type of navigational viewing.

    LOCATION is one of the most important and useful parts of contextually aware applications

    Eyewear will eventually solve this problem. Google Glass is an early entrant into the smartglasses market.

  • SLIDE –AR will help to visualize the internet of everything.

    We are talking about “Knowledge Transfer” – visualizing data relevant to the physical world in real time.
  • SLIDE – AR has the potential to be the User-Interface to the world itself… conveying data about everything around us, and even that within us.

    VISION and LOCATION are key to contextual AR, but we are just scratching the surface

    We are just learning how to apply and deliver this sensor-based data properly

    To get more answers, let’s take a simple pop-quiz…
  • SLIDE – Which is more effective at getting drivers to slow down? (instant feedback, or ticket in mail two weeks later?)
  • ( The feedback loop. Your action has an effect, and the feedback from that effect influences your next action.)

    Real time feedback to optimal for many actions we take on a daily basis.
  • SLIDE – Real-time feedback loops (visualized via AR) will change how we live, work and play

    Example: Ghost Runner Concept by OnTheGo Platforms (Ryan Fink and team)

    The ghost runner represents previous run on same course. If you ran faster that day, you would see a ghostly image of yourself running in front of you. This UX was first seen in video racing games like “Mario Cart” … and serve as a motivating factor to race against yourself for a better time.

    So, which is more effective for optimizing ourselves? Looking at stats afterwards, or adjusting in real time based on contextual data?

    The Quantified Self movement will only really take off when we can get this type of instant feedback loop, and Augmented Reality is the ideal visual UX for this.

    The SmartWatch will play a big role in the transition to wearable eyeware. Why? It gets us closer to this instant feedback we seek. Contextually relevant content.

  • Head Mounted Displays (HMD’s)… will be key to any professions where contextual data provided in real time is critical.

    How critical will feedback loops be in these professions? Do they need knowledge transfer in real time?


  • For thoughtful HMD designs one can simply look to Video Games.

    The video game industry, and entertainment industry (iron man movie) have done a great job creating our HMD UX’s of the future.

    As AR-enabled eyewear becomes more commonly used, these type of displays will play a key role in how information and contextual content is translated and delivered.

    Even the early Google glass concept video missed the mark on UX, putting too much information in the center of the screen, etc.

  • SLIDE – What story will the kitchen of the future tell?

    Will it teach us how to cook in real time? (based on ingredients it knows I have in the refrigerator and spice racks).

    The smart home is coming. Appliances all connected.

    Refrigerator telling you when the milk has gone bad, or when you are out of soda. Ovens telling you when they need to be cleaned.




  • SLIDE – The predictive story needs to be intelligent and precise. Did Minority Report get it right?

    Minority Report showed us the future of contextually relevant advertising being thrown in our face when we enter a mall (understanding our presence).

    But Minority Report only got it half right. . Tom Cruise was running for his life through that mall in that scene, and had no time to shop. The sensors in our future will understand this (detecting things like heart rate, speed of movement, stress level, perspiration, etc..). Contextual advertisements in this type of situation are more likely to be pushing our favorite deodorant, or discoutnts to our favorite getaway vacation spot.

    This type of predictive “proximity mobile marketing” has already begun. Brands you have “liked” on Facebook push you ads. Items you have bought before offer you a special coupons to buy again.

    The predictive story needs to be intelligent and concise though, or we will turn it off! The story that is unfolded in front of us, to get us to buy something, needs to touch on our impulses and desires in an intuitive and non intrusive way. (tricky).






  • SLIDE – The AI assistant of the future may be digitally designed to show us, as well as tell us.

    Apple’s Siri, Microsof’s Cortana (reference to Halo AI character), Google Now

    No longer will our digital assistants be just a voice, or information on a flat screen…

    Digital characters that walk among us in the real world.. And serve as Coaches, Teachers, Docents…

    AR will allow us to interact with these digital beings as if they were real in many ways. They will walk and talk…teach us, demonstrate for us, and more.

  • SLIDE – Pervasive gaming – always on, all around us, ready when we are… (image of Clandestine Anomaly)

    A new type of gaming is coming, thanks to technologies like LBS, AR and sensor-based technologies.

    The opportunity is to turn the world into the game itself, and be contextually relevant to your personal story. The game is everywhere, and played at anytime; relevant to your environment.. Who your are with, where you are, what you are doing, etc.

    Ogmento launched Paranormal Activity as the first LBS/AR game Now we see efforts like Ingress which are getting closer to showing the potential.

    4 I’s of Storytelling when it comes to Pervasive Gaming…

    Immersion – Go deeper into the story-world, by learning more about it or by heightening the sensory experience of it?

    Interactivity – Change or influence elements of the story (where you are (Location data), who are you with (Social data)).

    Integration - Is a cohesive story being told across platforms? Can it interface with the real world in any way?

    Impact - Does the story inspire me to take action in my own life, such as making a purchase or supporting a good cause?

    (photo courtesy of ZenFri – Clandestine Anomaly. Corey King)
  • SLIDE – the potential is to understand all that is connected in real time.

    Technology recedes into the background and is everywhere.

    Ambient Intelligence - Embedded (invisible tech), context aware, highly personalized, reactive, adaptive, anticipatory, constantly evolving…
  • Transcript of "Contextual Augmented Reality (Sensor-Based Storytelling) - AWE2014 Presentation"

    1. 1. CONTEXTUAL AUGMENTED REALITY Brian Selzer VP Business and Product Development DAQRI.com Sensor-Based Storytelling
    2. 2. CONTEXT IS KING
    3. 3. Our mobile devices are designed to know us at a deep level
    4. 4. Mobile is transforming… Sensor-based wearable's are coming to everyBODY.
    5. 5. Things once silent now have a voice
    6. 6. Connected to the world
    7. 7. Low powered, low cost transmitters provide services based on environmental awareness
    8. 8. The time to lament the loss of privacy is over. It’s now about transparency.
    9. 9. Privacy is an exchange which needs to be negotiated between people and businesses
    10. 10. THROUGH THE LOOKING GLASS
    11. 11. Augmented Reality (AR) as a canned experience is very limiting, and has no repeat value.
    12. 12. Augmented Reality (AR) which requires holding phone up in front of face is limiting (arm fatigue).
    13. 13. AR will help to visualize the Internet of Everything
    14. 14. UI TO THE WORLD AR has the potential to be the User-Interface to the world itself… conveying data about everything around us, and even that within us.
    15. 15. Which is more effective at getting drivers to slow down? Instant feedback Speeding ticket in the mail two weeks later OR
    16. 16. Real-time feedback loops (visualized via AR) will change how we live, work and play
    17. 17. • Firefighters • Soldiers • Pilots • Surgeons • Manufacturers • Etc. AR-enhanced HMD’s will become a need for professionals
    18. 18. Video game-like HUD design for real world applications.
    19. 19. THE FUTURE OF STORYTELLING
    20. 20. What story will the kitchen of the future tell?
    21. 21. The predictive story needs to be intelligent and precise. Did Minority Report get it right?
    22. 22. The AI assistant of the future may be digitally designed to show us, as well as tell us.
    23. 23. Pervasive Gaming Pervasive Gaming - Always on; all around us; ready when we are…
    24. 24. Some final thoughts… • We are on a path to integrating ourselves with the internet of everything. • AR will serve as a UI/UX to this world • Context in real time will change the way we interact with the world around us. • Contextual Awareness is setting the stage for a world of true Ambient Intelligence.
    25. 25. Ambient Intelligence Embedded, context aware, highly personal, reactive, adaptive, anticipatory, constantly evolving…
    26. 26. Email: Brian.Selzer@Daqri.com Twitter: BrianSe7en Web: Daqri.com / BrianSelzer.com
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×