Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Immersive Computing
What is it?
&
How will we get there?
Image Credit
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
2017
The web gets
Computer Vision!
What predictions did we get right?
Mixed Reality will be possible in the web
What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010
What predictions did we get right?
Mixed Reality Web Standards test harness
What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011
What predictions did we get right?
OS level spatial tracking would be released
What predictions did we get right?
OS level spatial tracking would be released
W3C WebVR Workshop, 2016
But getting the timing right
is really hard…
But Tim is only right
if you give up too soon!
Space is collapsing
all around us…
What does “Immersive” mean?
Image Credit
What does “Immersive” mean?
Image Credit
What does “Immersive” mean?
Image Credit
How is our distance from Technology evolving?
Image Credit
The spaces between you & your devices are shrinking
How is our distance from Technology evolving?
The spatial point of origin has changed
Image Credit
How is our distance from Technology evolving?
Image Credit
The distance between objects & the network is shrinking too
How is our distance from Technology evolving?
xxx
Image Credit
How is our distance from Technology evolving?
Image Credit
Eventually almost all objects will be networked
How is our distance from Technology evolving?
Image Credit
So your spatial relationship to both objects & the network has changed
How is our distance from Technology evolving?
Image Credit
With wearables & nearables leading our current wave of change
How is our distance from Technology evolving?
Image Credit
Next we will change our definition of organisation
How is our distance from Technology evolving?
Image Credit
All of this is shrinking the distance between thought & action
How is our distance from Technology evolving?
Image Credit
The distance between object,
network and action is shrinking
to create a truly “user centred”
world of Immersive Computing
How is our distance from Technology evolving?
xxx
Image Credit
This is the evolution of
our new Reality
Definition of Mixed Reality
Image Credit
Paul Milgram - 1994
Definition of Augmented Reality
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon
or composited with the real world.
Ron Azuma - 1997
Augmented Reality…
1. Combines the real and virtual
2. Is interactive in real time
3. Is registered in 3D
Tracked image
Here are the different ways
people can interact with Mixed Reality
Mixed Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution
Mixed Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution
Mixed Reality Interaction Mode – Private
- Extremeties or head in fov
- 1-2 direct participants
- Wider distribution & locations
Mixed Reality Interaction Mode – Intimate
- Only extremeties in fov
- 1 direct participant
- Pervasive but currently limited distribution
How do you “View” VR & AR?
Have a suitable HMD
v
1
2Have a valid account
with the HMD vendor's
app store
3
Complete the HMD
vendor's first use
4
v
Search for & find the app
in their app store
5 Download/install
the app through
their app store
6Often requires system
or app updates also
v
7 Select/play the
downloaded app
!
MOBILE ONLY APP
Have a valid account
with the Mobile OS
vendor's app store
v
1
2
Find the app in
their app store3
Download/install the
app through their
app store
4
v
Often requires
system or app
updates also
5
Download/install
the app through
their app store
6
Select/play the
downloaded app
v
7 !
View promo for app on
their website
WEB APP
1 Click on a web link to
open it in your
browser on any
device
HMD ONLY APP
How do you “Create” VR & AR?
MOBILE ONLY APPs WEB APPSHMD ONLY APPS
Hire or be a developer
v
1
2
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target platform
3 Develop your app/s
4
v
Test it on the target HMD
vendor platform/s
5
Convert media and
3D assets to the
app/s format
6
Sign & submit your
app/s to the app store/s
& wait for approval/s
v
7
Publish & distribute
links to one or more
app stores
!
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target mobile OS
v
1
2
Develop your app/s
3
Test it on the target HMD
vendor platform/s 4
v
Convert media and
3D assets to the
app/s format
5
Sign & submit your app/s
to the app store/s & wait
for approval/s
6
Publish & distribute
links to one or more
app stores
v
7
Hire or be a developer
8
Create promotional web
content to drive people
to the app/s ! 8
Create promotional web
content to drive people
to the app/s
Get an account with
awe.media
*blatant plug J
v
1
2
Upload any types of
common media you
need (photos, videos,
3D & more)
3
Manipulate these objects
and add rich interactions
to create your VR & AR
experiences
4
Open your browser on
any type of device
v
5 Share a single link that
points directly to your web-
based VR/AR experience
Lets look at how this is
playing out in the market
Why has VR exploded recently?
VR has things to sell
Image Credit
Why has VR exploded recently?
The power of the s-curve
Image Credit
Where are we now?
In reality, VR is a tiny tiny market right now
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
Image Credit
What is changing right now?
Depth Sensing is starting to become commonplace
Image Credit
Immersive Computing will become Pervasive
Image Credit
What is likely in the future?
What are the real market trends?
This will take more than 3-5 years
Image Credit
Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?
What will drive market changes between now & then?
Convenient multi-use mobile form factors are the key today
Image Credit
What’s happening in the global mobile market?
Image Credit
Be prepared…
What won’t change?
Image Credit
The underlying geometry of Computer Vision & Reality
How can you prepare for this evolution?
Get comfortable with spatial reasoning
Image Credit
How can you prepare for this evolution?
Come along to #Reality17 on November 8th in Sydney
http://webdirections.org/reality
Image Credit
Setup a free account and
get started creating VR & AR
right now at …
https://try.awe.media
How can you prepare for this evolution?
Image Credit
Questions?
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

Immersive Computing @ #YOWConnected 2017

  • 1.
    Rob Manson, CEO& co-founder - https://awe.media - follow me on twitter @nambor Immersive Computing What is it? & How will we get there? Image Credit
  • 2.
    Who am I? RobManson, CEO & co-founder https://awe.media
  • 3.
    Who am I? RobManson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards
  • 4.
    Who am I? RobManson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert
  • 5.
    Who am I? RobManson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C
  • 6.
    Who am I? RobManson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group
  • 7.
    Who am I? RobManson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group ISO
  • 8.
    How did weget here?
  • 9.
    How did weget here?
  • 10.
    How did weget here?
  • 11.
    How did weget here?
  • 12.
    How did weget here?
  • 13.
    How did weget here?
  • 14.
    How did weget here?
  • 15.
    How did weget here?
  • 16.
    How did weget here? 2017 The web gets Computer Vision!
  • 17.
    What predictions didwe get right? Mixed Reality will be possible in the web
  • 18.
    What predictions didwe get right? Mixed Reality will be possible in the web ARStandards Workshop Seoul, 2010
  • 19.
    What predictions didwe get right? Mixed Reality Web Standards test harness
  • 20.
    What predictions didwe get right? Mixed Reality Web Standards test harness isweb3here.com, 2011
  • 21.
    What predictions didwe get right? OS level spatial tracking would be released
  • 22.
    What predictions didwe get right? OS level spatial tracking would be released W3C WebVR Workshop, 2016
  • 23.
    But getting thetiming right is really hard…
  • 25.
    But Tim isonly right if you give up too soon!
  • 26.
  • 27.
    What does “Immersive”mean? Image Credit
  • 28.
    What does “Immersive”mean? Image Credit
  • 29.
    What does “Immersive”mean? Image Credit
  • 30.
    How is ourdistance from Technology evolving? Image Credit The spaces between you & your devices are shrinking
  • 31.
    How is ourdistance from Technology evolving? The spatial point of origin has changed Image Credit
  • 32.
    How is ourdistance from Technology evolving? Image Credit The distance between objects & the network is shrinking too
  • 33.
    How is ourdistance from Technology evolving? xxx Image Credit
  • 34.
    How is ourdistance from Technology evolving? Image Credit Eventually almost all objects will be networked
  • 35.
    How is ourdistance from Technology evolving? Image Credit So your spatial relationship to both objects & the network has changed
  • 36.
    How is ourdistance from Technology evolving? Image Credit With wearables & nearables leading our current wave of change
  • 37.
    How is ourdistance from Technology evolving? Image Credit Next we will change our definition of organisation
  • 38.
    How is ourdistance from Technology evolving? Image Credit All of this is shrinking the distance between thought & action
  • 39.
    How is ourdistance from Technology evolving? Image Credit The distance between object, network and action is shrinking to create a truly “user centred” world of Immersive Computing
  • 40.
    How is ourdistance from Technology evolving? xxx Image Credit
  • 41.
    This is theevolution of our new Reality
  • 42.
    Definition of MixedReality Image Credit Paul Milgram - 1994
  • 43.
    Definition of AugmentedReality Augmented Reality allows the user to see the real world, with virtual objects superimposed upon or composited with the real world. Ron Azuma - 1997 Augmented Reality… 1. Combines the real and virtual 2. Is interactive in real time 3. Is registered in 3D
  • 45.
  • 46.
    Here are thedifferent ways people can interact with Mixed Reality
  • 47.
    Mixed Reality InteractionMode – Public - Whole body in fov - More spectators - Limited distribution
  • 48.
    Mixed Reality InteractionMode – Personal - Upper/whole body in fov - Fewer spectators - Wider distribution
  • 49.
    Mixed Reality InteractionMode – Private - Extremeties or head in fov - 1-2 direct participants - Wider distribution & locations
  • 50.
    Mixed Reality InteractionMode – Intimate - Only extremeties in fov - 1 direct participant - Pervasive but currently limited distribution
  • 51.
    How do you“View” VR & AR? Have a suitable HMD v 1 2Have a valid account with the HMD vendor's app store 3 Complete the HMD vendor's first use 4 v Search for & find the app in their app store 5 Download/install the app through their app store 6Often requires system or app updates also v 7 Select/play the downloaded app ! MOBILE ONLY APP Have a valid account with the Mobile OS vendor's app store v 1 2 Find the app in their app store3 Download/install the app through their app store 4 v Often requires system or app updates also 5 Download/install the app through their app store 6 Select/play the downloaded app v 7 ! View promo for app on their website WEB APP 1 Click on a web link to open it in your browser on any device HMD ONLY APP
  • 52.
    How do you“Create” VR & AR? MOBILE ONLY APPs WEB APPSHMD ONLY APPS Hire or be a developer v 1 2 Download & get to know (& deal with the various issues/quirks) the developer SDK for the target platform 3 Develop your app/s 4 v Test it on the target HMD vendor platform/s 5 Convert media and 3D assets to the app/s format 6 Sign & submit your app/s to the app store/s & wait for approval/s v 7 Publish & distribute links to one or more app stores ! Download & get to know (& deal with the various issues/quirks) the developer SDK for the target mobile OS v 1 2 Develop your app/s 3 Test it on the target HMD vendor platform/s 4 v Convert media and 3D assets to the app/s format 5 Sign & submit your app/s to the app store/s & wait for approval/s 6 Publish & distribute links to one or more app stores v 7 Hire or be a developer 8 Create promotional web content to drive people to the app/s ! 8 Create promotional web content to drive people to the app/s Get an account with awe.media *blatant plug J v 1 2 Upload any types of common media you need (photos, videos, 3D & more) 3 Manipulate these objects and add rich interactions to create your VR & AR experiences 4 Open your browser on any type of device v 5 Share a single link that points directly to your web- based VR/AR experience
  • 53.
    Lets look athow this is playing out in the market
  • 54.
    Why has VRexploded recently? VR has things to sell Image Credit
  • 55.
    Why has VRexploded recently? The power of the s-curve Image Credit
  • 56.
    Where are wenow? In reality, VR is a tiny tiny market right now
  • 57.
    Where are wenow? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 58.
    Where are wenow? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 59.
    Where are wenow? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 60.
    Where are wenow? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 61.
    What is ExtendedReality? Image Credit
  • 62.
    What is ExtendedReality? Image Credit
  • 63.
    What is ExtendedReality? Image Credit
  • 64.
  • 65.
    What is changingright now? Depth Sensing is starting to become commonplace Image Credit
  • 66.
    Immersive Computing willbecome Pervasive Image Credit What is likely in the future?
  • 67.
    What are thereal market trends? This will take more than 3-5 years Image Credit
  • 68.
    Mainstream adoption won’t“start” until at least 2020 Image Credit How long until we get our magic glasses?
  • 69.
    What will drivemarket changes between now & then? Convenient multi-use mobile form factors are the key today Image Credit
  • 70.
    What’s happening inthe global mobile market? Image Credit
  • 71.
  • 72.
    What won’t change? ImageCredit The underlying geometry of Computer Vision & Reality
  • 73.
    How can youprepare for this evolution? Get comfortable with spatial reasoning Image Credit
  • 74.
    How can youprepare for this evolution? Come along to #Reality17 on November 8th in Sydney http://webdirections.org/reality Image Credit
  • 75.
    Setup a freeaccount and get started creating VR & AR right now at … https://try.awe.media How can you prepare for this evolution? Image Credit
  • 76.
    Questions? Rob Manson, CEO& co-founder - https://awe.media - follow me on twitter @nambor