Mozilla Asia Developer Roadshow 2019 - Philip Lamb - Developing for Mixed Reality on the Open Web Platform

mozilla / Asia Developer Roadshow
November 2019
Developing for Mixed Reality
on the Open Web Platform
Philip Lamb
Mozilla Mixed Reality Research group

As a developer, why should I care
about mixed reality?
Why are businesses investing and
what are their expectations?

We still have an interface problem

Header
Information
domain
Control
domain
Augmented reality as situated control

OK, so if I want to develop for MR, 
now what?

It’s a great year to be in MR!

Predicted MR spend by market segment 2020
Segment Revenue (US$M)
Games $758
Location-Based
Entertainment
$621
Video &
Entertainment
Media
$30
Interactive Media $37
Social Media $12
Education $24
Healthcare &
Medicine
$9
Wellness $6
Consumer
Productivity
$4
TOTAL $1501
VR
Games $2,080
Location-Based
Entertainment
$56
Video &
Entertainment
Media
$39
Social Media $63
Education $53
Healthcare &
Medicine
$20
Wellness $75
Consumer
Productivity
$48
TOTAL $2530
Mobile AR
Games $8
Location-Based
Entertainment
$60
Video &
Entertainment
Media
$1
Social Media $1
Education -
Healthcare &
Medicine
-
Wellness $1
Consumer
Productivity
$2
TOTAL $75
AR/MR headsets
Pick a market…

Pick a platform? picked.cc/vr

Pick a development environment??
Pick a delivery mechanism???

Block text
mozilla / event
Platform lock-in
● Obsolescence
● License withdrawals
● Content restrictions
● Business model inflexibility
● Hard to acquire casual users
● App-store approval risk
● Revenue share squeeze
● User-hostile forced re-buying
Platform fragmentation
● Multiple app-stores
● Bespoke per-platform code
● Balkanisation of social
features
● Maintenance overhead
● Per-platform publishing
overheads
● Support fragmentation

Should I just use Unity?
● 70% of VR & 90% of AR apps
● but ...
● You have existing web-content
● You have existing web teams

Copyleft & commercially usable license
Sourcecode
• understandable
• veriﬁable/secure
• modiﬁable
Projects x1000s, Users x100 000
Open-source, open standards

Mozilla makes browsers,
apps, code and tools that
put people before profit.
Our mission: Keep the
internet open and
accessible to all.

HTML & JS
frameworks
ECSy entity
component system
for the web
Content promotion
and compensation
Firefox Reality
browser
• standalone VR
• PC-connected VR
• standalone AR
Firefox WebXR
WebXR Viewer for
iOS
Hubs by Mozilla
social VR
Hubs Discourse
Spoke MR scene
editor
Spoke Architecture
Kit
User
agents
Content
& tools
Social Standards
& advocacy
Mixed reality for the open web
Mozilla’s MR programme
WebXR
W3C Accessibility
Mozilla Open-
Source Support

Firefox Reality for Standalone VR headsets
2D browser based on the same
modern web engine as Mozilla’s new
Android browser
Multi-window, tabs, history, private
browsing
3D immersive support for WebVR,
360 images, 360 videos, and WebXR
(coming soon)
Firefox accounts including
book,mark, history sync and send-
tab from Firefox on other devices

2D browser based on the same
modern web engine as Mozilla’s new
Android browser
Multi-window, tabs, history, private
browsing
3D immersive support for WebVR,
360 images, 360 videos, and WebXR
(coming soon)
Firefox accounts including
book,mark, history sync and send-
tab from Firefox on other devices
Firefox Reality for Standalone VR headsets

Firefox Reality 
immersive WebVR &
WebXR
• Its the web; no extra software to
install
• Portable across devices and
platforms
• Popular applications:
• Real estate tours
• Training
• Cultural outreach
• Adult entertainment
• Virtual tourism
• Gaming

Browser interface
languages:
Chinese (China)
Chinese (Taiwan)
Danish
Dutch
English
Finnish
French
German
Italian
Japanese
Korean
Norwegian (Bokmaal)
Norwegian (Nynorsk)
Polish
Russian
Spanish
Swedish
Firefox Reality 
multilingual support
Voice-based search
available in all our
supported languages
Localized keyboards 
provide native script
support for many
writing systems
More languages
coming soon..
TH

Firefox Reality content showcase
Opens on the homepage
ECSy
An Entity Component System for the
web
Content partnerships
Content and tools

Framework support for WebVR
and WebXR
ECSy An Entity Component System
for the web
blog.mozvr.com/introducing-ecsy/
Content and tools

hubs.mozilla.com
Avatar and voice presence from
any device (desktop, mobile,
HMDs) through the browser
Private rooms with the capability
to bring in media from around the
web
Include popular conferencing
capabilities like desktop screen
sharing, text chat, and video feeds
Shared spatial environments
that can be customized for
different use cases through the
online Spoke editor

Block text
mozilla / eventmozilla / Asia Developer Roadshow

Release dates
• Polyfill-based 
Now
• Firefox Reality v7 
Dec 2019
• Chromium 
Dec 2019
A new API for the immersive web
• Builds on the success of WebVR
• Addresses WebVR issues around
device discovery, and user consent
and privacy
• Unifies VR device and gamepad APIs
• New: AR module
• New focus on accessibility

WebXR architecture
Browser IDL to native
A-frame
OpenVR OculusVR WaveVR
Windo
wsMR
OpenGL
DirectX
ANGLE
Device sensors
3.JS
WebGLWebXR
GPU

mozilla / Asia Developer Roadshowmozilla / Asia Developer Roadshow

Header
Block text
Mozilla Open Source Support Awards
Mozilla was born out of and remains part of the open source
and free software movement. Through the Mozilla Open
Source Support (MOSS) awards program, we recognize,
celebrate, and support open source projects that contribute to
Mozilla’s work and to the health of the Internet. MOSS
broadens access, increases security, and empowers users by
providing catalytic funding to open source technologists.
MOSS Awards are available in three tracks:
Track I: Foundational Technology: The Foundational Technology track
supports open source projects that Mozilla relies on, either as an
embedded part of our products or as part of our everyday work.

by:
Diego F. Goberna @feiss
Fernando Serrano @fernandojsg
Coming soon from Mozilla MR
https://blog.mozvr.com

Conclusion
There has never been a better time
to be developing mixed reality
experiences and content
Building on the open web
platform provides the greatest
reach and lower long-term risk
Great MR is a partnership between
content, tools, delivery platform,
and Mozilla is working in all these
areas

Questions? Need more info?
mixedreality.mozilla.com
plamb@mozilla.com

Mozilla Asia Developer Roadshow 2019 - Philip Lamb - Developing for Mixed Reality on the Open Web Platform

Recommended

Recommended

More Related Content

Similar to Mozilla Asia Developer Roadshow 2019 - Philip Lamb - Developing for Mixed Reality on the Open Web Platform

Similar to Mozilla Asia Developer Roadshow 2019 - Philip Lamb - Developing for Mixed Reality on the Open Web Platform (20)

Recently uploaded

Recently uploaded (20)

Mozilla Asia Developer Roadshow 2019 - Philip Lamb - Developing for Mixed Reality on the Open Web Platform