From Promise to Delivery: Identifying Best Use Cases for Spatial Computing

“From the Promise
of Spatial Computing
to Actual Delivery
of Real Solutions”
Michael Hoﬀman
Founding Partner

Michael Hoffman is a former Microsoft HoloLens Principal
Development Lead and led efforts on these partnerships

Copyright © 2019 Object Theory LLC
Object Theory is a trusted advisor
helping enterprise clients
strategically identify, design and build
XR platform solutions and
deliver tangible business value
utilizing today’s XR devices

The Promise of
Spatial Computing

Source: InGage Blog
Source: Magic Leap
Source: Augment Your Journey Blog
Spatial computing vision and hype
Source: 20th Century Fox

We are
here
“Hype Cycle”, by Gartner

Why Spatial Computing?

Why spatial computing?
Leverage our binocular vision

Experience what does not yet exist

Sense scale and spatial relationships

See invisible data in place

Extend human spatial senses

Shared perspective with collaborators

Immerse in compelling stories

Monitor and control smart systems

Monitor and control smart systems
Practice spatial skills with feedback

What’s still needed
to fulfill the promise?

We are
here

Hardware ErgonomicsEnvironment
SoftwareOpen StandardsValue
Innovation Categories

Innovation – Environment (Goal: Works everywhere)
Bright holograms even in direct sunlight
Stays cool even in hot climates
Adequate audio volume and noise cancellation
Reliable spatial mapping and tracking:
• Large open spaces
• Outdoors
• Bright lights or sunshine
• Mirrored surfaces
• Windows
• Dark environments
• Repeating patterns
• Large featureless surfaces
• Dark surfaces
Global anchors discoverable for any location

Innovation – Hardware (Goal: meets needs of all identified spatial use cases)
Wearables
• Wide field of view approaching our native FOV
• Detect gestures even when looking the other way
• Increased CPU/GPU compute
• All day battery life and fast recharge
• Speaker specific voice recognition
• Durable in harsh industrial settings
• Per pixel shutter for better realism
• Exceptional color fidelity (like calibrated monitors)
• Zero radio SKUs (military, security)
• Can meet safety requirements (eg. OSHA, IESA)
• Can meet spark safety requirements (oil & gas)
• Reliable on-device bar code scanning
• Wireless recharging
I/O
• Precision 3D input tools
• Text/Data entry
• Environment scanning / measuring
• Haptics
Infrastructure
• Provisionable edge compute
• Ubiquitous 5G
d

Innovation - Ergonomics (Goal: eyeglasses form factor, natural & efficient input)
All day comfort
• weight
• fit
• hygiene
• balanced center of gravity
• temperature
• vision friendly
Lighter frame (approaching regular eyeglasses)
Efficient data entry
Natural, efficient and accurate gestures
Automatic Interpupillary Distance (IPD)
Depth of field cues
Natural language processing
Intuitive and consistent user interfaces
Coherent human interface guidelines (HIG)
“Tell me how to
diagnose this motor.”
HAPTICS

Innovation - Value (Goal: compelling ROI for all spatial use cases)
Lower device cost
Lower software cost
New revenue streams
Adequately solve real business problems
Mass deployment for economies of scale
Many high-value oﬀ-the-shelf applications
Social, commerce, & ad ecosystems
Large installed base
Backwards compatibility
Wear anywhere (stylish, comfortable)
Replaces our other devices

Innovation - Open Standards (Goal: ubiquitous interoperability)
3D model interchange like JPEG/MPEG – GLTF
Stable 3D web standards for future 3D metaverse
Oﬀ-device stereoscopic rendering protocols
5G – fast delivery with guaranteed low latency
Object recognition with position and orientation
Edge compute provisioning
Geospatial anchoring
3D “video” (holocapture) formats and codecs
Real-time 3D telepresence streaming

Innovation - Software Tools/Services (Goal: Efficient, comprehensive solution dev)
Efficient end-to-end s/w development tool chain
3D WYSIWYG app frameworks and design tools
Rapid 3D app prototyping tools
3D content production tools
True 3D standards-based “browsers”
Open standards based metaverse PaaS
High fidelity 3D scanners
Ultra-high fidelity point cloud to mesh
Large area high fidelity photogrammetry
Universal object recognition training & detection
Efficient text/data entry
Highly accurate natural language processing
Comprehensive enterprise MDM
Efficient precision input

Identifying Best Use Cases
for Today’s Capabilities

Triggers
MVPs, Pilots, Platforms & Production
2015 2016 2017 2018 2019
M
icrosoftH
oloLens
announce
Pokém
on
G
o
M
icrosoftH
oloLens
release
M
agic
Leap
O
ne
release
M
agic
Leap
teaservideo
M
icrosoftH
oloLens
2
announce
Concept Videos, PoCs & Event Demos
Activity

Collaboration Annotated Environment Hard Skills Training Task Guidance Space Planning Conceptual Education
Medical Imaging Situation Planning Remote Assistance Premium Selling Soft Skills Training Product Design
Focus Groups Invisible Data Expert Coaching Infinite Screen Entertainment Creative Expression
18 identified use case categories for spatial computing

Top 8 use cases that deliver value within today’s constraints
CollaborationSituation Planning
Skills Training Task Guidance Premium SellingAnnotated Environment
Medical ImagingRemote Assistance

Requirements framework for identifying opportunities
Category
Requirements Checklist for Desired Use Case
(can you identify at least one on each row?)
Space Indoors Controlled outdoor Fiducial targets acceptable
Data Entry Minimal Voice dictation Barcode scanning External device
Content scale Small objects Dollhouse scale
Carefully manage context and
scale transitions
Acclimation to device
Content
fidelity
Low color fidelity and low detail
of complex object acceptable
Low color fidelity and high detail of
low complexity object acceptable
Remote rendering Not content focused
Content
Carefully curated and optimized
with durable value
Hand optimized with high short-term
value
Remote rendering Not content focused
Environmental
Context
Office / Classroom Light industrial
Heavy industrial with 3rd party
safety, headphones and no voice
commands
Connectivity Conrolled, ideal WiFi available Offline is viable LAN-only is viable
Anchoring Manual quick-placement
On-device mapping combined with
controlled environment
Cloud spatial anchors Computer vision Not required
Comfort Session based for short periods

Premium Selling / Space Planning
Stryker ByDesign HoloLens companion – Patient Care Room Design Use Case
Category Requirements Checklist
Space Indoors Controlled outdoor
Fiducial targets
acceptable
Data Entry Minimal Voice dictation Barcode scanning
External
device
Carefully manage context
and scale transitions
Content
fidelity
Low color fidelity and low
detail of complex object
acceptable
Low color fidelity and
high detail of low
complexity object
acceptable
Remote rendering
Not content
focused
Content
Carefully curated and
optimized with durable
value
Hand optimized with high
short-term value
Remote rendering
Not content
focused
Environmental
Context
Heavy industrial with 3rd
party safety, headphones
and no voice commands
Connectivity
Conrolled, ideal WiFi
available
Offline is viable LAN-only is viable
On-device mapping
combined with controlled
environment
Cloud spatial anchors
Computer
vision
Not required
Comfort
Session based for short
periods

Premium Selling, then Design Review
Pre-sales presentations and post sales client reviews
Category Requirements Checklist
Space Indoors Controlled outdoor
Fiducial targets
acceptable
Data Entry Minimal Voice dictation Barcode scanning
External
device
Carefully manage context
and scale transitions
Content
fidelity
Low color fidelity and low
detail of complex object
acceptable
Low color fidelity and
high detail of low
complexity object
acceptable
Remote rendering
Not content
focused
Content
Carefully curated and
optimized with durable
value
Hand optimized with high
short-term value
Remote rendering
Not content
focused
Environmental
Context
Heavy industrial with 3rd
party safety, headphones
and no voice commands
Connectivity
Conrolled, ideal WiFi
available
Offline is viable LAN-only is viable
On-device mapping
combined with controlled
environment
Cloud spatial anchors
Computer
vision
Not required
Comfort
Session based for short
periods

Platform Approach is Critical

Platform Approach to Delivering Enterprise Value for Today’s Needs
Adopt an integrated approach, for seamless hybrids of multiple use cases
Support enterprise-scale capabilities
Adaptable to complex client needs under a variety of workflows
Flexible design to enable rapid integration of emerging technology
Manage in the cloud
Adapters to enable enterprise back-end integration
Device agnostic by supporting 2D and 3D UX
White label capabilities (web and device)

XR enterprise platform
Prism by Object Theory
Features
• Integrated multi-use case platform (not siloed)
• Device agnostic, cross platform (2D and 3D)
• SaaS subscription (operational expense)
• Cloud-based enterprise management
• Supports many use cases in one solution
• Unlimited virtual spaces that persist indefinitely
• 2D and 3D content optimization pipeline
• Easy drag-and-drop content import
• Remote collaboration with avatars 
Remote assist with live streaming
• Security via authentication and private links
• WAN & offline LAN modes
• Customizable
RemoteRendering
SpatialAnchors

Enterprise clients are using our Prism platform for:
XR enterprise platform
Prism by Object Theory
prism.objecttheory.com
Collaboration Hard Skills Training Task Guidance
Space Planning
Remote Assistance
Premium Selling Design Review Conceptual Education

Thank you!
Michael Hoﬀman
Founding Partner
michael@objecttheory.com
linkedin.com/in/mthoﬀman
prism.objecttheory.com
mailto: prism@objecttheory.com

From Promise to Delivery: Identifying Best Use Cases for Spatial Computing

Recommended

Recommended

More Related Content

What's hot

What's hot (13)

Similar to From Promise to Delivery: Identifying Best Use Cases for Spatial Computing

Similar to From Promise to Delivery: Identifying Best Use Cases for Spatial Computing (20)

Recently uploaded

Recently uploaded (20)

From Promise to Delivery: Identifying Best Use Cases for Spatial Computing