STATE OF THE
AR CLOUD REPORT
Jan-Erik Vinje Christine Perey
© 2019 Open AR Cloud Association
PRESENTED ON BEHALF OF THE WORKING GROUPS BY
© 2019 Open AR Cloud Association 2
Building a
better reality
together
Driving the development of
open and interoperable spatial
computing technology, data
and standards to connect the
physical and digital worlds for
the benefit of all.
© 2019 Open AR Cloud Association 3
© 2019 Open AR Cloud Association 4
UX BKMs for
accessibility,
safety, ease of
use
Open & Inclusive
ecosystem
participation
Open,
interoperable
ecosystems
Accelerate tech
innovation via
open-data, R&D
and source code
Standardized
outputs for
machine
readable and
searchable
reality
Respecting local
governance and
personal privacy
choices
New Business
models, data
decentralization
and control to
empower local
communities
Vision
Spatial Indexing
and GeoPose
Compliance, Regulations,
and Legal
Reality Modeling/Mapping
(Spatial Data Creation)
User Experience, Accessibility,
and Safety
Content Delivery, Browsing
and Ownership
Open Source, Open Data
and Open R&D
Privacy & Security Organization and Community
Edge-Computing, IoT,
and 5G for AR-Cloud
Distributed Ledger Technology (DLT)
and decentralized apps for AR-Cloud
Working Groups
© 2019 Open AR Cloud Association 5
About This Report
© 2019 Open AR Cloud Association 6
1s
t
THE
PRODUCTION
OF THE NEWLY
FOUNDED OARC
39 SUBJECT
MATTER
EXPERTS
FROM AROUND THE WORLD
10WORKING
GROUPS
140
OVER
PAGES
35+
GLOBAL PARTNERS
© 2019 Open AR Cloud Association 7
Key Open AR
Cloud
Drivers
Technology
Society
Business
© 2019 Open AR Cloud Association 8
Low Barriers
to 3D
Continuous Data
Connections (IoT)
Artificial
Intelligence
Edge
Computing
5G+
© 2019 Open AR Cloud Association 9
Productivity Lifestyle Convenience
& Economy
Art & CultureContinuous
Learning &
Discovery
© 2019 Open AR Cloud Association 10
Consumer
Upgrade
Invest to
Compete
?
© 2019 Open AR Cloud Association 11
© 2019 Open AR Cloud Association 12
Kavya Pearlman
Cyberguardian
https://xrsi.org/
Open AR Cloud
Framework
© 2019 Open AR Cloud Association 13
This is the Linked Open Data Cloud graphic as of March 2019 https://lod-cloud.net/ Published data according to the Linked Data principles
© 2019 Open AR Cloud Association 14
Data
is at the Core
© 2019 Open AR Cloud Association 15
Physical World
State of the
Art of AR
Cloud
© 2019 Open AR Cloud Association 16
Reality Modeling/Mapping (Spatial Data Creation)
1.Spatial indexing and Geopose
1.Privacy and Security
1.Edge Computing and IoT for AR Cloud
1.Compliance, Regulations and Legal
1.User Experience, Accessibility and Safety
1.Open Data and Open R&D
1.Distributed Ledger Technology/Blockchain
© 2019 Open AR Cloud Association 17
StateoftheArtforARCloud
REAL-TIME
REALITY LAYER
STATIC
REALITY LAYER
PHYSICAL WORLD
Reality
Modeling/Mapping
(Spatial Data Creation)
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 18
Spatial Indexing
ATOMS: Real world
BITS: Digital representations of
the real world
Static persistant reality -may be shared globally
Transient dynamic state - restricted to only be shared
locally at the edge to protect privacy, except emergency)
Real-time reality layer
Static reality layer
REALITY CAPTURE LAYERS
Physical reality
A layer can contain experiences, static
content, live datastreams, services,
applications/solutions etc. There needs to
be a shared way of registering all such
things to one or more layers.
THEMATIC LAYERS Examples
IoT
Art
Entertainment
Commerce
Construction/Infrastructure
Mobility
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 19
Geopose
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 20
Privacy and
Security
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 21
Edge Computing
and IoT for AR
Cloud
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 22
Static persistant reality -may
be shared globally
Transient dynamic state - restricted
to only be shared locally at the edge
to protect privacy, except
emergency)
Realtime reality layer
Static reality layer
LOCALLY SHARED EDGE
Both reality layers are most useful at their origins
and should be available at the edge.
CLOUD
Only the most static parts of reality should be
persisted in the cloud. Things like terrain, buildings,
roads, trees. Other things should be kept local in
almost all cases to protect privacy, safety and
freedom of individuals and the dignity of local
communites.
REALITY CAPTURE LAYERS
Edge vs Cloud for the Reality Layers
Normal Case
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 23
Compliance,
Regulations and
Legal
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 24
User Experience,
Accessibility and
Safety
This Photo by Unknown Author is licensed under CC BY-SA-NC This Photo by Unknown Author is licensed under CC BY-SA-NC
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 25
Open Data and
Open R&D
StateoftheArtforARCloud
© 2019 Open AR Cloud Association 26
Distributed Ledger
Technology/Blockchain
Global Partners
© 2019 Open AR Cloud Association 27
https://www.openarcloud.org/partners
© 2019 Open AR Cloud Association 28

The Dawn of a new Computing Paradigm. State of the AR Cloud Report

  • 1.
    STATE OF THE ARCLOUD REPORT Jan-Erik Vinje Christine Perey © 2019 Open AR Cloud Association PRESENTED ON BEHALF OF THE WORKING GROUPS BY
  • 2.
    © 2019 OpenAR Cloud Association 2
  • 3.
    Building a better reality together Drivingthe development of open and interoperable spatial computing technology, data and standards to connect the physical and digital worlds for the benefit of all. © 2019 Open AR Cloud Association 3
  • 4.
    © 2019 OpenAR Cloud Association 4 UX BKMs for accessibility, safety, ease of use Open & Inclusive ecosystem participation Open, interoperable ecosystems Accelerate tech innovation via open-data, R&D and source code Standardized outputs for machine readable and searchable reality Respecting local governance and personal privacy choices New Business models, data decentralization and control to empower local communities Vision
  • 5.
    Spatial Indexing and GeoPose Compliance,Regulations, and Legal Reality Modeling/Mapping (Spatial Data Creation) User Experience, Accessibility, and Safety Content Delivery, Browsing and Ownership Open Source, Open Data and Open R&D Privacy & Security Organization and Community Edge-Computing, IoT, and 5G for AR-Cloud Distributed Ledger Technology (DLT) and decentralized apps for AR-Cloud Working Groups © 2019 Open AR Cloud Association 5
  • 6.
    About This Report ©2019 Open AR Cloud Association 6 1s t THE PRODUCTION OF THE NEWLY FOUNDED OARC 39 SUBJECT MATTER EXPERTS FROM AROUND THE WORLD 10WORKING GROUPS 140 OVER PAGES 35+ GLOBAL PARTNERS
  • 7.
    © 2019 OpenAR Cloud Association 7 Key Open AR Cloud Drivers Technology Society Business
  • 8.
    © 2019 OpenAR Cloud Association 8 Low Barriers to 3D Continuous Data Connections (IoT) Artificial Intelligence Edge Computing 5G+
  • 9.
    © 2019 OpenAR Cloud Association 9 Productivity Lifestyle Convenience & Economy Art & CultureContinuous Learning & Discovery
  • 10.
    © 2019 OpenAR Cloud Association 10 Consumer Upgrade Invest to Compete
  • 11.
    ? © 2019 OpenAR Cloud Association 11
  • 12.
    © 2019 OpenAR Cloud Association 12 Kavya Pearlman Cyberguardian https://xrsi.org/
  • 13.
    Open AR Cloud Framework ©2019 Open AR Cloud Association 13 This is the Linked Open Data Cloud graphic as of March 2019 https://lod-cloud.net/ Published data according to the Linked Data principles
  • 14.
    © 2019 OpenAR Cloud Association 14 Data is at the Core
  • 15.
    © 2019 OpenAR Cloud Association 15 Physical World
  • 16.
    State of the Artof AR Cloud © 2019 Open AR Cloud Association 16 Reality Modeling/Mapping (Spatial Data Creation) 1.Spatial indexing and Geopose 1.Privacy and Security 1.Edge Computing and IoT for AR Cloud 1.Compliance, Regulations and Legal 1.User Experience, Accessibility and Safety 1.Open Data and Open R&D 1.Distributed Ledger Technology/Blockchain
  • 17.
    © 2019 OpenAR Cloud Association 17 StateoftheArtforARCloud REAL-TIME REALITY LAYER STATIC REALITY LAYER PHYSICAL WORLD Reality Modeling/Mapping (Spatial Data Creation)
  • 18.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 18 Spatial Indexing ATOMS: Real world BITS: Digital representations of the real world Static persistant reality -may be shared globally Transient dynamic state - restricted to only be shared locally at the edge to protect privacy, except emergency) Real-time reality layer Static reality layer REALITY CAPTURE LAYERS Physical reality A layer can contain experiences, static content, live datastreams, services, applications/solutions etc. There needs to be a shared way of registering all such things to one or more layers. THEMATIC LAYERS Examples IoT Art Entertainment Commerce Construction/Infrastructure Mobility
  • 19.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 19 Geopose
  • 20.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 20 Privacy and Security
  • 21.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 21 Edge Computing and IoT for AR Cloud
  • 22.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 22 Static persistant reality -may be shared globally Transient dynamic state - restricted to only be shared locally at the edge to protect privacy, except emergency) Realtime reality layer Static reality layer LOCALLY SHARED EDGE Both reality layers are most useful at their origins and should be available at the edge. CLOUD Only the most static parts of reality should be persisted in the cloud. Things like terrain, buildings, roads, trees. Other things should be kept local in almost all cases to protect privacy, safety and freedom of individuals and the dignity of local communites. REALITY CAPTURE LAYERS Edge vs Cloud for the Reality Layers Normal Case
  • 23.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 23 Compliance, Regulations and Legal
  • 24.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 24 User Experience, Accessibility and Safety This Photo by Unknown Author is licensed under CC BY-SA-NC This Photo by Unknown Author is licensed under CC BY-SA-NC
  • 25.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 25 Open Data and Open R&D
  • 26.
    StateoftheArtforARCloud © 2019 OpenAR Cloud Association 26 Distributed Ledger Technology/Blockchain
  • 27.
    Global Partners © 2019Open AR Cloud Association 27 https://www.openarcloud.org/partners
  • 28.
    © 2019 OpenAR Cloud Association 28

Editor's Notes

  • #7 FROM SOTARC MERGED MASTER About This Report This document is a little piece of history. It’s the first production of  the newly founded global non-profit Open AR Cloud association (OARC). It has been written collaboratively by leading subject matter experts from around the globe who are participating in OARC’s many working groups. It is also the first report that provides an initial consensus overview of the state of many components that make up  the nascent AR Cloud industry that will be at the very center of the next big platform shift in computing, bringing the internet off screens and out into the real world. The report lays no claim to being comprehensive and cover everything, but is intended to provide an unprecedented overview of what is happening, and cover a wide range of topics regarding the birth of real world spatial computing. It will cover the core components that will enable this new digital reality.  It will detail the state of the industry, the companies involved, the wide range of technologies and solutions in development, and the myriad of challenges to be addressed, with special emphasis on the interoperability, scalability, usability, safety, privacy, ownership, security, compliance and legal issues ahead. It also attempts to analyze those challenges with regard to building an AR Cloud ecosystem (also referred to as the real world Spatial Web). It is also intended to educate and inspire individuals, technology executives and policy makers to carefully consider the challenges ahead and address them based on specific values and principles that will best benefit all of mankind.
  • #9 This Photo by Unknown Author is licensed under CC BY This Photo by Unknown Author is licensed under CC BY This Photo by Unknown Author is licensed under CC BY-SA This Photo by Unknown Author is licensed under CC BY Lowering barriers to 3D (creation, consumption, interactions) Continuous connected and data producing/consuming systems (IoT) Artificial Intelligence Edge computing (including but not limited to 5G)
  • #10 This Photo by Unknown Author is licensed under CC BY-SA-NC This Photo by Unknown Author is licensed under CC BY-SA This Photo by Unknown Author is licensed under CC BY This Photo by Unknown Author is licensed under CC BY-NC This Photo by Unknown Author is licensed under CC BY-SA Productivity - Real world in which we live and work is rich with content that can be useful to reduce time and errors but it isn’t anchored or visible Lifestyle (Games/entertainment) Convenience and economy (e.g., autonomous vehicles) Continuous learning (discovering more about the world(s) around user) Art and culture
  • #11 This Photo by Unknown Author is licensed under CC BY This Photo by Unknown Author is licensed under CC BY-SA Driving users to upgrade Driving companies to continuously invest in technology for competitive advantage
  • #13 Please welcome up on stage, Kavya Pearlman
  • #14 From one of the drafts in folder Talk about linked data. Public, shared and private data. In the case of AR Cloud, the data is about the physical world + digital assets attached/pertaining to physical world targets
  • #16 Presentation layer
  • #18 Reality Modeling/Mapping (Spatial Data Creation) Many technical approaches to capture reality camera based other sensors many algorithmic approaches to understand data Current services are limited geographical platforms (IOS, Android etc.) use case specific urban outdoors indoor traffic Many players, formats and representations
  • #19 Spatial indexing and geo pose Spatial index is a schema for registries Reality layer : machine readable & searchable map 3d real-time metadata Thematic layers: infinite    semantics multilayer content /services possible Geopose Glue that binds the digital to the physical world that scales Shared frame of reference other fields have working solutions: automotive, robotics drones
  • #20 Spatial indexing and geo pose Spatial index is a schema for registries Reality layer : machine readable & searchable map 3d real-time metadata Thematic layers: infinite    semantics multilayer content /services possible Geopose Glue that binds the digital to the physical world that scales Shared frame of reference other fields have working solutions: automotive, robotics drones
  • #21 Privacy and Security Public awareness is rising but the extent of risk is high Reality capture introduces unprecedented levels of intrusion private spaces behaviour speech social context public spaces commercial facilities Privacy concerns must be balanced with public safety homeland security emergency response
  • #22 Edge Computing and IoT for AR Cloud could enable real-time shared reality capture layer opportunity to create reality firewall at the edge many high value use cases in spatial computing low latency high bandwidth device offloading data intensive services (sensor data streams etc)
  • #25 Machine readable world offers wider accessibility higher usability lower risk New capabilities require new language for interaction design Extends familiar physical interactions to the digital world But not constrained by the laws of the physical world Experience designers must prioritize real world risks while augmenting the senses Simplify how users will manage their settings for privacy & and personal preferences
  • #26 Open Data and Open R&D proven value in related fields the open web geospatial Open Street Map provides a template open government LiDAR data sets machine learning 3d engines Shifting landscape and immature ecosystem currently AR Cloud players fear losing competitive advantage expect more collaboration in the the future new projects could accelerate innovation & standardization
  • #27 Distributed Ledger Technology/Blockchain High potential but many unresolved issues Could provide trustless exchange/transactions of property & data distribution of computation automation security privacy/anonymity identity distributed ledgers for accountability transparency