SlideShare a Scribd company logo
1 of 36
Download to read offline
1
Smart Terrain™ feature for
Depth Sensing Cameras
David Beard
Developer Evangelist, Qualcomm Connected Experiences, Inc.
Smart Terrain is a feature of the Qualcomm Vuforia SDK.
Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc.
33
Smart Terrain
Reconstructs the environment
Awareness of your environment
Intelligence to interact with objects
and surfaces
4
Overview
Smart Terrain for standard device cameras
Advantages of Depth Sensing
How it works
Developing with Smart Terrain
5
Smart Terrain for
Standard Device Cameras
6
Supported Environments
Simulated images
7
Initializing Smart Terrain
Simulated images
8
Builds Primary Surface
Simulated images
9
Detects Props
Simulated images
10
Approximates Objects
& Surfaces
Simulated images
11
Smart Terrain for
Depth Sensing Cameras
12
Advantages of Depth Sensing Devices
Standard Device Cameras
Uses an initialization target
Requires user motion
Approximates objects
Infrared Depth Sensors
Automatic initialization
No motion required
Faster and richer results
13
Depth Sensing Cameras
Standard Device Cameras
Uses visible light
Senses contrast
Infrared Depth Sensors
Projects Infrared light
Fuses RGB image &
depth map
14
Automatic initialization
Simulated images
15
Faster and richer results
Simulated images
16
Surface reconstruction
Simulated images
17
Object reconstruction
Simulated images
18
Automatic scale estimation
Simulated images
19
20
Developing with
Smart Terrain
21
Best Practices
Recommendations for the best user experiences
Supported Environments
User Experience
Designing content
Managing meshes
22
Near range experiences
Stages with visually distince borders
Opaque non-reflective surfaces
Stable room lighting
Supported Environments
23
Designing Content
Simulated images
24
Managing Meshes
Simulated images
25
Abstracts the features of the hardware
Consistent life cycle management
Consistent event handling
Easy portability
Smart Terrain API
A universal API for depth aware devices
26
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
27
Initialize Smart Terrain
Simulated images
28
Initialize Smart Terrain
StartMeshUpdates()
29
Build Mesh
Simulated images
30
Build Mesh
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
31
Detect Props
Simulated images
32
OnPropUpdated(Prop prop)
Detect Props
33
StopMeshUpdates(Prop prop)
Stop Reconstruction
34
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
35
Creating a Smart
Terrain App in Unity
36
For more information on Qualcomm, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.
Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other
countries,. Uplinq and Smart Terrain are trademarks of Qualcomm Incorporated. Alll Qualcomm
Incorporated trademarks are used with permission.Other products and brand names may be
trademarks or registered trademarks of their respective owners.of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm
Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate
structure, as applicable.
Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of
its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm
Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering,
research and development functions, and substantially all of its product and services businesses,
including its semiconductor business, QCT.
Thank you FOLLOW US ON:

More Related Content

Similar to 34vuforiasmartterraindepthsensingbeard9-140926174456-phpapp02

Rendering Techniques for Augmented Reality and a Look Ahead at AR Foundation
Rendering Techniques for Augmented Reality and a Look Ahead at AR FoundationRendering Techniques for Augmented Reality and a Look Ahead at AR Foundation
Rendering Techniques for Augmented Reality and a Look Ahead at AR FoundationUnity Technologies
 
Developing a Multiplayer RTS with the Unreal Engine 3
Developing a Multiplayer RTS with the Unreal Engine 3Developing a Multiplayer RTS with the Unreal Engine 3
Developing a Multiplayer RTS with the Unreal Engine 3Nick Pruehs
 
Visibility Optimization for Games
Visibility Optimization for GamesVisibility Optimization for Games
Visibility Optimization for GamesUmbra
 
Visibility Optimization for Games
Visibility Optimization for GamesVisibility Optimization for Games
Visibility Optimization for GamesSampo Lappalainen
 
Photogrammetry for Architecture and Construction
Photogrammetry for Architecture and ConstructionPhotogrammetry for Architecture and Construction
Photogrammetry for Architecture and ConstructionDat Lien
 
Implementing a Simple Game using libGDX
Implementing a Simple Game using libGDXImplementing a Simple Game using libGDX
Implementing a Simple Game using libGDXJussi Pohjolainen
 
Using Android Things to Detect & Exterminate Reptilians
Using Android Things to Detect & Exterminate ReptiliansUsing Android Things to Detect & Exterminate Reptilians
Using Android Things to Detect & Exterminate ReptiliansNilhcem
 
Flash runtime on mobile
Flash runtime on mobileFlash runtime on mobile
Flash runtime on mobilehoward-wu
 
Convolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detectionConvolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detectionDarian Frajberg
 
mDevcon tour 2014 beyondar
mDevcon tour 2014 beyondarmDevcon tour 2014 beyondar
mDevcon tour 2014 beyondarJoan Puig Sanz
 
Lucio marcenaro tue summer_school
Lucio marcenaro tue summer_schoolLucio marcenaro tue summer_school
Lucio marcenaro tue summer_schoolJun Hu
 
Advanced Game Development with the Mobile 3D Graphics API
Advanced Game Development with the Mobile 3D Graphics APIAdvanced Game Development with the Mobile 3D Graphics API
Advanced Game Development with the Mobile 3D Graphics APITomi Aarnio
 
Game development with Cocos2d
Game development with Cocos2dGame development with Cocos2d
Game development with Cocos2dVinsol
 
Integration for Planet Satellite Imagery
Integration for Planet Satellite ImageryIntegration for Planet Satellite Imagery
Integration for Planet Satellite ImagerySafe Software
 
Enhance your world with ARKit. UA Mobile 2017.
Enhance your world with ARKit. UA Mobile 2017.Enhance your world with ARKit. UA Mobile 2017.
Enhance your world with ARKit. UA Mobile 2017.UA Mobile
 
ARCore 101: A Hands-on Workshop
ARCore 101: A Hands-on WorkshopARCore 101: A Hands-on Workshop
ARCore 101: A Hands-on WorkshopUnity Technologies
 
Custom SRP and graphics workflows - Unite Copenhagen 2019
Custom SRP and graphics workflows - Unite Copenhagen 2019Custom SRP and graphics workflows - Unite Copenhagen 2019
Custom SRP and graphics workflows - Unite Copenhagen 2019Unity Technologies
 
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK AugmentedWorldExpo
 
Developing Rich Interfaces in JavaFX for Ultrabooks
Developing Rich Interfaces in JavaFX for UltrabooksDeveloping Rich Interfaces in JavaFX for Ultrabooks
Developing Rich Interfaces in JavaFX for UltrabooksBruno Borges
 

Similar to 34vuforiasmartterraindepthsensingbeard9-140926174456-phpapp02 (20)

Rendering Techniques for Augmented Reality and a Look Ahead at AR Foundation
Rendering Techniques for Augmented Reality and a Look Ahead at AR FoundationRendering Techniques for Augmented Reality and a Look Ahead at AR Foundation
Rendering Techniques for Augmented Reality and a Look Ahead at AR Foundation
 
Developing a Multiplayer RTS with the Unreal Engine 3
Developing a Multiplayer RTS with the Unreal Engine 3Developing a Multiplayer RTS with the Unreal Engine 3
Developing a Multiplayer RTS with the Unreal Engine 3
 
Visibility Optimization for Games
Visibility Optimization for GamesVisibility Optimization for Games
Visibility Optimization for Games
 
Visibility Optimization for Games
Visibility Optimization for GamesVisibility Optimization for Games
Visibility Optimization for Games
 
Photogrammetry for Architecture and Construction
Photogrammetry for Architecture and ConstructionPhotogrammetry for Architecture and Construction
Photogrammetry for Architecture and Construction
 
Implementing a Simple Game using libGDX
Implementing a Simple Game using libGDXImplementing a Simple Game using libGDX
Implementing a Simple Game using libGDX
 
Using Android Things to Detect & Exterminate Reptilians
Using Android Things to Detect & Exterminate ReptiliansUsing Android Things to Detect & Exterminate Reptilians
Using Android Things to Detect & Exterminate Reptilians
 
Flash runtime on mobile
Flash runtime on mobileFlash runtime on mobile
Flash runtime on mobile
 
Convolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detectionConvolutional Neural Network for pixel-wise skyline detection
Convolutional Neural Network for pixel-wise skyline detection
 
mDevcon tour 2014 beyondar
mDevcon tour 2014 beyondarmDevcon tour 2014 beyondar
mDevcon tour 2014 beyondar
 
Lucio marcenaro tue summer_school
Lucio marcenaro tue summer_schoolLucio marcenaro tue summer_school
Lucio marcenaro tue summer_school
 
Advanced Game Development with the Mobile 3D Graphics API
Advanced Game Development with the Mobile 3D Graphics APIAdvanced Game Development with the Mobile 3D Graphics API
Advanced Game Development with the Mobile 3D Graphics API
 
Game development with Cocos2d
Game development with Cocos2dGame development with Cocos2d
Game development with Cocos2d
 
Integration for Planet Satellite Imagery
Integration for Planet Satellite ImageryIntegration for Planet Satellite Imagery
Integration for Planet Satellite Imagery
 
Enhance your world with ARKit. UA Mobile 2017.
Enhance your world with ARKit. UA Mobile 2017.Enhance your world with ARKit. UA Mobile 2017.
Enhance your world with ARKit. UA Mobile 2017.
 
ARCore 101: A Hands-on Workshop
ARCore 101: A Hands-on WorkshopARCore 101: A Hands-on Workshop
ARCore 101: A Hands-on Workshop
 
Custom SRP and graphics workflows - Unite Copenhagen 2019
Custom SRP and graphics workflows - Unite Copenhagen 2019Custom SRP and graphics workflows - Unite Copenhagen 2019
Custom SRP and graphics workflows - Unite Copenhagen 2019
 
Svr Raskar
Svr RaskarSvr Raskar
Svr Raskar
 
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
 
Developing Rich Interfaces in JavaFX for Ultrabooks
Developing Rich Interfaces in JavaFX for UltrabooksDeveloping Rich Interfaces in JavaFX for Ultrabooks
Developing Rich Interfaces in JavaFX for Ultrabooks
 

34vuforiasmartterraindepthsensingbeard9-140926174456-phpapp02