This is our presentation from the Immersive Sydney #WebXRWeek event. This provides an overview of web based Mixed Reality and then dives into the specifics of the new #WebXR API. It includes market statistics and information on key release dates. It also includes links to #WebXR demos and other background information.

1. Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Immersive Sydney - #WebXRWeek

2. What is Immersive?

3. What is Immersive?

4. What is Immersive?

6. Who am I?
Rob Manson, CEO & co-founder
https://awe.media

7. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards

8. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert

9. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C

10. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group

11. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO

12. A brief history of awe…

13. How did we get here?

14. How did we get here?

15. How did we get here?

16. How did we get here?

17. How did we get here?

18. How did we get here?

19. How did we get here?

20. How did we get here?

21. How did we get here?
2017
The web gets
Computer Vision!

22. What predictions did we get right?
Mixed Reality will be possible in the web

23. What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010

24. What predictions did we get right?
Mixed Reality Web Standards test harness

25. What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011

26. What predictions did we get right?
OS-level pose tracking would be released

27. What predictions did we get right?
OS-level pose tracking would be released
W3C WebVR Workshop, 2016

28. But getting the timing right
is really hard…

30. But Tim is only right
if you give up too soon!

31. Now it’s June 2018 and
#WebXR is here!

32. So what is XR (Extended Reality)?

33. Virtual Reality?
The terms virtual worlds, virtual cockpits, and virtual workstations
were used to describe specific projects.
In 1989, Jaron Lanier, CEO of VPL, coined the term virtual reality
to bring all of the virtual projects under a single rubric.
The term therefore typically refers to three-dimensional realities implemented
with stereo viewing goggles and reality gloves.
Myron Krueger - 1991
Image Credit Image CreditImage Credit

34. Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon or composited with the real world.
1. Combines the real and virtual, 2. Is interactive in real time, 3. Is registered in 3D
Ron Azuma - 1997
Image Credit

35. Mixed Reality?
Image Credit
Paul Milgram - 1994

36. Mixed Reality & Holograms?
Image Credit

37. Extended Reality?
Image Credit

38. Image Credit

39. Here’s the different ways
you can interact with
Extended Reality

40. Extended Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution

41. Extended Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution

42. Extended Reality Interaction Mode – Private
- Extremities or head in fov
- 1-2 direct participants
- Wider distribution & locations

43. Extended Reality Interaction Mode – Private
- Extremities or head in fov
- 1-2 direct participants
- Wider distribution & locations
This is where
#WebXR plays

44. Extended Reality Interaction Mode – Intimate x 3
Tethered VR

45. Mobile VR
Extended Reality Interaction Mode – Intimate x 3
Tethered VR

46. Mobile VR Mobile AR/MR/XR
Extended Reality Interaction Mode – Intimate x 3
Tethered VR

47. Extended Reality Interaction Mode – Intimate
- Only extremities in fov
- 1 direct participant
- Pervasive but currently limited distribution
#WebXR
works here
now too

48. What are the different
types of tracking

49. 3 Degrees of Freedom head tracking (simple 3DoF VR)
This uses IMU/Gyro to track the angle you are looking at
Image Credit

50. 6 Degrees of Freedom head tracking (6DoF VR)
This adds positional tracking so you can also walk around
Image Credit

51. 6 Degrees of Freedom geolocation tracking (Geo AR)
This uses Gyro & GPS so you can move around the world
Image Credit

52. Fiducial marker tracking (Marker AR)
This uses simple computer vision
Image Credit

53. Natural image tracking (NFT AR)
This uses more sophisticated computer vision
Image Credit
This works on over
3 Billion browsers
right now!
awe has the only web based
natural image tracking
solution available today
Digital object Natural image

54. Visual Inertial Odometry (VIO - ARKit/ARCore)
This combines computer vision & IMU sensor data
Image Credit

55. What does #WebXR deliver?

56. #WebXR gives you 6DoF tracking
This is delivered by ARCore/ARKit
Image Credit

57. #WebXR gives simple plane detection
You can fire rays to detect where they intersect a plane
Image Credit

58. #WebXR gives controller input
You can use hand controllers to reach into your scene
Image Credit

59. #WebXR gives you access to the camera intrinsics
You can access the projectionMatrix of the camera
Image Credit

60. #WebXR gives you access to the video frames
You can access the pixels from each frame
Image Credit

61. #WebXR gives you support for multiple eyes
You can create stereo VR
Image Credit

62. #WebXR gives you support for multiple eyes
You can create stereo VR & see-thru experiences
Image Credit
Stereo cameras

63. What doesn’t #WebXR deliver?
(yet)

64. #WebXR does NOT give you the point cloud
You can not currently access the features detected
Image Credit

65. #WebXR does NOT give you the real planes
You can not currently work out where planes end
Image Credit

66. #WebXR does NOT give you wide adoption (yet)
You can not rely on lots of capable browsers in the wild
Image Credit

67. But #WebXR
has some advantages
previous AR didn’t

68. Lets look at how
Extended Reality has been
playing out in the market

69. VR awareness exploded recently!
Because VR has physical “things” to sell
Image Credit

70. New VR devices captured people’s imagination
The power of the s-curve
Image Credit

71. But HMD sales haven’t matched the hype
Image Credit

72. Where are we now?
In reality, VR is a tiny tiny market right now (& so is AR)
Image Credit

73. ARKit & ARCore brought the s-curve to AR
And distribution is growing quickly because it’s baked in
Image Credit

74. But look at what’s happening in the global mobile market?
Image Credit

75. This is where #WebXR comes in!

76. Image Credit
The proposed WebVR API has evolved into the WebXR API

77. Image Credit
Mozilla have an XR specific browser

78. Image Credit
An iOS app now

79. Image Credit
Chrome have embraced the WebXR API

80. Image Credit
Android now

81. Image Credit
Mainstream support arrives in September

82. Image Credit
Supported devices?

83. Image Credit
But how long will it take for Safari on iOS to find it’s way?
They took 6 years with WebRTC!

84. Immersive Computing will become Pervasive
Image Credit
What else is likely in the future?

85. What are the real market trends?
This will take more than 3-5 years
Image Credit

86. Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?

87. But the next wave is already starting…
Video Credit
Standalone devices that deliver stereo see-thru with world tracking

88. And next wave devices are already here!
Image Credit
The Lenovo Mirage Solo works with #WebXR & is shipping now

89. Our focus is to make it easy for you to
create & share AR/VR/XR Experiences
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

90. Using the browser on your
iPhone, Android, Computer & HMD!
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

91. Image Credit
BTW: If you’re heading to ISMAR this year…

92. Right now you can try our
#WebXR demos created using awe
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

93. And we’re releasing our new
#WebXR editor in July
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

94. Questions / Demos / Discussion
Google WebXR Codelab
https://codelabs.developers.google.com/codelabs/ar-with-webxr/
WebAR Demos
https://magic.awe.io
Create your own for free at https://try.awe.media
WebXR Demos
awe solar system (come and checkout on our devices)
awe anatomy explorer (come and checkout on our devices)
awe room explorer (come and checkout on our devices)
https://googlecodelabs.github.io/ar-with-webxr/final/
https://web-education-ar-demo.appspot.com/
https://immersive-web.github.io/webxr-samples/
https://apainter.webxrexperiments.com/