Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Augmenting, Mixing & Extending
Reality on ...
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standard...
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standard...
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standard...
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standard...
A brief history…
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
2017
The web gets
Computer Vision!
What predictions did we get right?
Mixed Reality will be possible in the web
What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010
What predictions did we get right?
Mixed Reality Web Standards test harness
What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011
What predictions did we get right?
OS-level spatial tracking would be released
What predictions did we get right?
OS-level spatial tracking would be released
W3C WebVR Workshop, 2016
But getting the timing right
is really hard…
But Tim is only right
if you give up too soon!
Here are the different ways
people can interact with Mixed Reality
Mixed Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution
Mixed Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution
Mixed Reality Interaction Mode – Private
- Extremeties or head in fov
- 1-2 direct participants
- Wider distribution & loc...
Mixed Reality Interaction Mode – Intimate
- Only extremeties in fov
- 1 direct participant
- Pervasive but currently limit...
Where are we up to now?
What is Mixed Reality?
Image Credit
Paul Milgram - 1994
What is Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon...
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
Image Credit
How do you “View” VR & AR?
Have a suitable HMD
v
1
2Have a valid account
with the HMD vendor's
app store
3
Complete the HM...
How do you “Create” VR & AR?
MOBILE ONLY APPs WEB APPSHMD ONLY APPS
Hire or be a developer
v
1
2
Download & get to know (&...
What’s evolving as we speak?
Depth sensing
Depth Sensing is starting to become commonplace
Image Credit
OS-level pose tracking
Image Credit
WebVR/WebAR
Image Credit
WebVR/WebXR
Image Credit
Deep/Machine Learning
Image Credit
More cameras!
Image Credit
What’s needed in the future?
(The missing pieces)
Camera intrinsics web API
Image Credit
A more accurate underlying geometry for Computer Vision
Optimised pixel access
Zero copy texture transfer & faster workers
Image Credit
Lets look at how this is all
playing out in the market
Why has VR exploded recently?
VR has things to sell
Image Credit
Why has VR exploded recently?
The power of the s-curve
Image Credit
Where are we now?
In reality, VR is a tiny tiny market right now
Where are we now?
In reality, VR is a tiny tiny market right now
More iPhone 8s than HMDs by the end of the year!
What’s happening in the global mobile market?
Image Credit
The good news for iOS is the majority are now iOS11
Image Credit
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BI...
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BI...
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BI...
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BI...
Immersive Computing will become Pervasive
Image Credit
What is likely in the future?
What are the real market trends?
This will take more than 3-5 years
Image Credit
Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?
What will drive market changes between now & then?
Convenient multi-use mobile form factors are the key today
Image Credit
Questions? / Discussion
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
Upcoming SlideShare
Loading in …5
×

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

347 views

Published on

This presentation was part of the ISMAR17 Workshop on "Standards for Mixed & Augmented Reality" in Nantes, France (https://arstandardsworkshop17.wordpress.com/program/). It provides an overview of the latest developments in web based Mixed Reality including the newly released Natural Feature Tracking from awe.media (see the intro video here https://youtu.be/5_HWgrcWWts). It takes a look at developments & APIs that are currently forming. It takes a look at what is still needed and how these API gaps may be dealt with. And it explores what is currently playing out in the market and how this is likely to evolve in the near-to-midterm future.

Published in: Technology
  • Be the first to comment

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

  1. 1. Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor Augmenting, Mixing & Extending Reality on the web
  2. 2. Who am I? Rob Manson, CEO & co-founder https://awe.media
  3. 3. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards
  4. 4. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert
  5. 5. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C
  6. 6. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group
  7. 7. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group ISO
  8. 8. A brief history…
  9. 9. How did we get here?
  10. 10. How did we get here?
  11. 11. How did we get here?
  12. 12. How did we get here?
  13. 13. How did we get here?
  14. 14. How did we get here?
  15. 15. How did we get here?
  16. 16. How did we get here?
  17. 17. How did we get here? 2017 The web gets Computer Vision!
  18. 18. What predictions did we get right? Mixed Reality will be possible in the web
  19. 19. What predictions did we get right? Mixed Reality will be possible in the web ARStandards Workshop Seoul, 2010
  20. 20. What predictions did we get right? Mixed Reality Web Standards test harness
  21. 21. What predictions did we get right? Mixed Reality Web Standards test harness isweb3here.com, 2011
  22. 22. What predictions did we get right? OS-level spatial tracking would be released
  23. 23. What predictions did we get right? OS-level spatial tracking would be released W3C WebVR Workshop, 2016
  24. 24. But getting the timing right is really hard…
  25. 25. But Tim is only right if you give up too soon!
  26. 26. Here are the different ways people can interact with Mixed Reality
  27. 27. Mixed Reality Interaction Mode – Public - Whole body in fov - More spectators - Limited distribution
  28. 28. Mixed Reality Interaction Mode – Personal - Upper/whole body in fov - Fewer spectators - Wider distribution
  29. 29. Mixed Reality Interaction Mode – Private - Extremeties or head in fov - 1-2 direct participants - Wider distribution & locations
  30. 30. Mixed Reality Interaction Mode – Intimate - Only extremeties in fov - 1 direct participant - Pervasive but currently limited distribution
  31. 31. Where are we up to now?
  32. 32. What is Mixed Reality? Image Credit Paul Milgram - 1994
  33. 33. What is Augmented Reality? Augmented Reality allows the user to see the real world, with virtual objects superimposed upon or composited with the real world. Ron Azuma - 1997 Augmented Reality… 1. Combines the real and virtual 2. Is interactive in real time 3. Is registered in 3D
  34. 34. What is Extended Reality? Image Credit
  35. 35. What is Extended Reality? Image Credit
  36. 36. What is Extended Reality? Image Credit
  37. 37. Image Credit
  38. 38. How do you “View” VR & AR? Have a suitable HMD v 1 2Have a valid account with the HMD vendor's app store 3 Complete the HMD vendor's first use 4 v Search for & find the app in their app store 5 Download/install the app through their app store 6Often requires system or app updates also v 7 Select/play the downloaded app ! MOBILE ONLY APP Have a valid account with the Mobile OS vendor's app store v 1 2 Find the app in their app store3 Download/install the app through their app store 4 v Often requires system or app updates also 5 Download/install the app through their app store 6 Select/play the downloaded app v 7 ! View promo for app on their website WEB APP 1 Click on a web link to open it in your browser on any device HMD ONLY APP
  39. 39. How do you “Create” VR & AR? MOBILE ONLY APPs WEB APPSHMD ONLY APPS Hire or be a developer v 1 2 Download & get to know (& deal with the various issues/quirks) the developer SDK for the target platform 3 Develop your app/s 4 v Test it on the target HMD vendor platform/s 5 Convert media and 3D assets to the app/s format 6 Sign & submit your app/s to the app store/s & wait for approval/s v 7 Publish & distribute links to one or more app stores ! Download & get to know (& deal with the various issues/quirks) the developer SDK for the target mobile OS v 1 2 Develop your app/s 3 Test it on the target HMD vendor platform/s 4 v Convert media and 3D assets to the app/s format 5 Sign & submit your app/s to the app store/s & wait for approval/s 6 Publish & distribute links to one or more app stores v 7 Hire or be a developer 8 Create promotional web content to drive people to the app/s ! 8 Create promotional web content to drive people to the app/s Get an account with awe.media *blatant plug J v 1 2 Upload any types of common media you need (photos, videos, 3D & more) 3 Manipulate these objects and add rich interactions to create your VR & AR experiences 4 Open your browser on any type of device v 5 Share a single link that points directly to your web- based VR/AR experience
  40. 40. What’s evolving as we speak?
  41. 41. Depth sensing Depth Sensing is starting to become commonplace Image Credit
  42. 42. OS-level pose tracking Image Credit
  43. 43. WebVR/WebAR Image Credit
  44. 44. WebVR/WebXR Image Credit
  45. 45. Deep/Machine Learning Image Credit
  46. 46. More cameras! Image Credit
  47. 47. What’s needed in the future? (The missing pieces)
  48. 48. Camera intrinsics web API Image Credit A more accurate underlying geometry for Computer Vision
  49. 49. Optimised pixel access Zero copy texture transfer & faster workers Image Credit
  50. 50. Lets look at how this is all playing out in the market
  51. 51. Why has VR exploded recently? VR has things to sell Image Credit
  52. 52. Why has VR exploded recently? The power of the s-curve Image Credit
  53. 53. Where are we now? In reality, VR is a tiny tiny market right now
  54. 54. Where are we now? In reality, VR is a tiny tiny market right now More iPhone 8s than HMDs by the end of the year!
  55. 55. What’s happening in the global mobile market? Image Credit
  56. 56. The good news for iOS is the majority are now iOS11 Image Credit
  57. 57. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  58. 58. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  59. 59. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  60. 60. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  61. 61. Immersive Computing will become Pervasive Image Credit What is likely in the future?
  62. 62. What are the real market trends? This will take more than 3-5 years Image Credit
  63. 63. Mainstream adoption won’t “start” until at least 2020 Image Credit How long until we get our magic glasses?
  64. 64. What will drive market changes between now & then? Convenient multi-use mobile form factors are the key today Image Credit
  65. 65. Questions? / Discussion Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

×