This document discusses the future of augmented reality infrastructure. It outlines that AR can decrease complexity, increase efficiency, and create new data and knowledge. The key components of AR infrastructure are discussed as software (e.g. SLAM, AI) and hardware (e.g. sensors, optics, chips). The document also notes issues like poor user experience and battery drain and how the form factor needs to shrink from phones to glasses to lenses. It concludes that more sensors provide better experiences but require more processing power and energy.

1. The Future of Augmented Reality
Infrastructure
(Software and Hardware)
Vitaliy Goncharuk
2018

2. Why AR is critical in the future?
AR:
1. decreases the complexity of the external
world /environment
2. increases your personal efficiency;
3. creates new data and new knowledge;

3. Augmented Reality Infrastructure
SOFTWARE HARDWARE
• SLAM;
• Real-Time AI
(CV/ML/DP);
• Maps;
• Cloud AI / AR Cloud;
• UI/UX;
• Content creation &
distribution platforms;
• Services;
• Sensors;
• Optics;
• Chips;
• Battery;
• Data transfer tech;

4. AR + Phone - > AR + Glasses –> AR +
Lenses

5. Issues
1. Poor user experience (latency, stability, not
realistic image quality, etc.)
2. Battery drain issues
3. Big form-factor (impossible to carry around
all day due to the weight)

6. Software stack
SLAM + FUSION
Real time AI
Simple Scene
Semantics
Classification
Recognition
Detection
Advanced re-
localization
Loop closure
Content
creation, B2C,
C2C Services:
AR *outube
AR Cooperative
Work and Games
AR *acebook
AR *elp
AR + Maps for
DP, Robotics,
B2B,
Human2Human,
Robot2Human,
Robot2Robot.
DENSE / SPARSE
Mapping
CLOUD Infrastructure
Cloud AI / “AR
Cloud”
Advanced
Scene Semantic
Smart Maps
management
(Merge ,
upgrade, etc.)
Maps Analytics
& Statistics
Labeling,
Matching

7. Hardware stack
IMAGE SENSORS
INERTIAL SENSORS
OPTICS
BATTERY
Silicon Chips
SOUND
Data Transfer

8. DETAILS

9. “Visual” sensors
Mono
Stereo
IR
TOF
Event Based
LiDAR

10. CHIPS
Main:
• Hardware acceleration of all critical AI algorithms (“AI
processor”).
• The most common configuration - ARM cores + DSPs
Leaders:
Movidius, Qualcomm Snapdragon 835(build in DSP),
Intuitive, Apple, Microsoft.

11. Cloud based AI / AR Cloud
NOT FOR PUBLISHING

12. Real Time “AI” software Stack
NOT FOR PUBLISHING

13. Conclusions
1. More sensors -> More data -> better quality
of user experience, BUT more CPU and
energy consumption
2. B2B – first wave.
3. B2C – second wave. Perfect quality of
hardware and media content is needed.

14. Author
Vitaliy Goncharuk
About: http://vactivity.com/aboutauthor/
E-mail: vactivity@gmail.com