Uplin q'14 david beard - smart terrain™ feature for depth sensing cameras

1. 1

2. Smart Terrain™ feature for
Depth Sensing Cameras
David Beard
Developer Evangelist, Qualcomm Connected Experiences, Inc.
Smart Terrain is a feature of the Qualcomm Vuforia SDK.
Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc.

3. 33
Smart Terrain
Reconstructs the environment
Awareness of your environment
Intelligence to interact with objects
and surfaces

4. 4
Overview
Smart Terrain for standard device cameras
Advantages of Depth Sensing
How it works
Developing with Smart Terrain

5. 5
Smart Terrain for
Standard Device Cameras

6. 6
Supported Environments
Simulated images

7. 7
Initializing Smart Terrain
Simulated images

8. 8
Builds Primary Surface
Simulated images

9. 9
Detects Props
Simulated images

10. 10
Approximates Objects
& Surfaces
Simulated images

11. 11
Smart Terrain for
Depth Sensing Cameras

12. 12
Advantages of Depth Sensing Devices
Standard Device Cameras
Uses an initialization target
Requires user motion
Approximates objects
Infrared Depth Sensors
Automatic initialization
No motion required
Faster and richer results

13. 13
Depth Sensing Cameras
Standard Device Cameras
Uses visible light
Senses contrast
Infrared Depth Sensors
Projects Infrared light
Fuses RGB image &
depth map

14. 14
Automatic initialization
Simulated images

15. 15
Faster and richer results
Simulated images

16. 16
Surface reconstruction
Simulated images

17. 17
Object reconstruction
Simulated images

18. 18
Automatic scale estimation
Simulated images

19. 19

20. 20
Developing with
Smart Terrain

21. 21
Best Practices
Recommendations for the best user experiences
Supported Environments
User Experience
Designing content
Managing meshes

22. 22
Near range experiences
Stages with visually distince borders
Opaque non-reflective surfaces
Stable room lighting
Supported Environments

23. 23
Designing Content
Simulated images

24. 24
Managing Meshes
Simulated images

25. 25
Abstracts the features of the hardware
Consistent life cycle management
Consistent event handling
Easy portability
Smart Terrain API
A universal API for depth aware devices

26. 26
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)

27. 27
Initialize Smart Terrain
Simulated images

28. 28
Initialize Smart Terrain
StartMeshUpdates()

29. 29
Build Mesh
Simulated images

30. 30
Build Mesh
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)

31. 31
Detect Props
Simulated images

32. 32
OnPropUpdated(Prop prop)
Detect Props

33. 33
StopMeshUpdates(Prop prop)
Stop Reconstruction

34. 34
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)

35. 35
Creating a Smart
Terrain App in Unity

36. 36
For more information on Qualcomm, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.
Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other
countries,. Uplinq and Smart Terrain are trademarks of Qualcomm Incorporated. Alll Qualcomm
Incorporated trademarks are used with permission.Other products and brand names may be
trademarks or registered trademarks of their respective owners.of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm
Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate
structure, as applicable.
Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of
its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm
Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering,
research and development functions, and substantially all of its product and services businesses,
including its semiconductor business, QCT.
Thank you FOLLOW US ON: