This is the second version of Build an AR app presentation. It gives a detailed step by step guide on building a complete AR app from scratch using Vuforia
6. Content
Difference between AR and VR and XR
Devices - Hardware
Applications - Consumer and Business
Technology standards
Design fundamentals
Let’s do it !!!
8. Virtual
Immersive
Block the real world
Teleport to a new world and time
Part of simulation
Augmented
Overlay information
View the real world
Present in time and space
Part of real world
13. Design Fundamentals Mobile AR
Single Hand use
Still a WINDOW - you can move around
3d in Flat screen
Interactions attached to world UI and not flat screen
Prompt to move around
Visual affordances to interactive elements
14. Design Fundamentals Mobile AR
Interactions and information based on Proximity
Portals - door to VR
Minimal animation which are grounded to plane
Add Text with background - solid or translucent
Feedback - sound, haptics
Embed a story, not just 3d popup
15. Everything is placed on a reference Plane
User onboarding every time for first 10 times
18. Let’s Create !
Vuforia
Unity
Photoshop
We’ll create a marker based AR
experience using Vuforia SDK and
Unity Game Engine.
The app will work in Desktop
To publish an android you’ll need
Android SDK and JDK also installed
19. How marker based AR works
Mobile
Device
World Image
Image
captured by
camera
Database of
Images in
Software
Software continuously compares captured
image with database and creates reference
orientation mesh aligning the orientation
of image in world space
App Software running in background
20. Setting up Vuforia
Go to https://developer.vuforia.com/ and register yourself
Once registered, login to the portal and you’ll see a dashboard as shown
You can create a free license key for test and development purpose
License Manager manages license keys to be used while
testing and publishing the app in Unity. This is an
authentication mechanism.
You can use the same license across different applications
in test mode. However for publishing to app store, you’ll
need to create different license for each app
Target Manager manages the target images which the
app will match with the live camera feed.
These images are downloaded and embedded in the app
at the time of creating the app
21. Creating License
The created license key is a long list of alphanumeric characters.
We will use this license key in later steps
22. Adding Target Database
Database is collection of images that are used as target
Target is an image that the application will compare live
camera feed with to find a match in the real world
The image should be such that it has got enough detailing
to be able to recognize in real world
The rating shows how good are the features in the
image
Once all the target images are uploaded, check all and
click on download database. This download as unity
package file with .unitypackage file extension
24. When downloading
database make sure to
select Unity Editor as we are
working in Unity and the
database will be
downloaded as Unity
Package
25. Now time to work in Unity
Download latest version of Unity from
https://unity3d.com/get-unity/download
For this tutorial am using 2018.1.1f1 version
26. When downloading make sure to check Android Build
Support and iOS Build support depending on what
device framework you want to publish your app to
Have taken this screenshot from internet hence it’s
showing version as 5.3.1f1, however we need to have
latest version. For this tutorial I have used 2018.1.1f1
Vuforia comes as part of Unity in its latest builds.
27. Learn more about Unity Development environment at below link
https://unity3d.com/learn/tutorials/topics/interface-essentials/editor-basics
Project hierarchy
Project folder
Project assets/resources
Property panel of
Selected Object
Visual
representation of
3d scene
Buttons to test the
application
Very basic understanding of Unity IDE
28. Open Unity and Create a new project
Select 3d Template. Since we are going to deal
with 3d environment.
Specify the location where you want to save
your project
29. Default Camera and Light
Unity IDE on creating a new project
Default Sample Scene.
If you do Ctrl+S (windows)
it will save the current
scene
30. Setup project for publishing it for AR environment
Open Build settings from File->Build Settings
Open Player Settings and browse to XR Settings Tab and select Vuforia Augmented Reality
Player Settings Button
Player Settings Panel
31. Scene Main Camera
Remove default Main Camera from scene by first selecting and then hit Delete button (on keyboard)
We need a camera that supports AR (basically a Camera object provided by Vuforia)
Vuforia comes as part of Unity in its latest builds. If not you can search for Vuforia Unity sdk and download and install
32. Vuforia AR Camera
Add Vuforia AR Camera to scene
On adding Unity will import packages for Vuforia
33. Add Database marker created in Vuforia developer portal
Import custom package and browse to folder where database marker unitypackage is downloaded
35. Vuforia AR Camera
Setup Vuforia configuration
Select AR Camera in Project hierarchy panel to open its Property Inspector in right side panel
In inspector panel look for “Open Vuforia configuration”
36. Add License key and check for marker database
Remember creating a license key in Vuforia developer portal? Time to use it now. Go to portal copy the
license key and paste it in the App license key box
Also check the marker database file you just imported is present in configuration panel
Vuforia App license key
Refer page 21
Do not click on Add
License
Marker database
37. Test the app and ARCamera
Play button to test the app
My finger is on camera so this space
is blank. You should see yourself if
your laptop/desktop camera is on and
pointing you !
38. Add a GameObject to hold the marker image
This is just for reference to place augmented information around it.
Remember in Unity all units are in meters. You specified width (in mtrs) for your marker image in developer portal
My finger is on camera so this space
is blank. You should see yourself if
your laptop/desktop camera is on and
pointing you !
39. Set up image target
Image Target in scene
Marker database and image
You added this in developer
portal and then downloaded
as unitypackage and then
imported to Unity
40. Set up image target
Click in Scene area and hit “F” key. This will focus on the selected GameObject.
Make sure you have selected ImageTarget and then click in scene area and hit “F” key to focus on Image Target
Image Target in scene
41. Time to add some augmented data around marker
Right click on Image Target and browse to Cube. This will add a cube in scene as child of Image Target
42. Layouting the augmented data
By default the cube dimension is 1mtr. So you can change the scale parameter to adjust it according to the marker dimension
and also change its position with respect to marker
Cube scale
Quick tools for
Position
Rotation
scale
44. Time to test the camera
Hit play button to start the camera, now when you bring the marker infront of camera
you’ll see the object you added around the marker image
That’s all we need.
You can go ahead create an interesting 3d model around marker image and create an AR
experience.
Research a bit on adding external 3d model to the scene to make a richer experience
You can download models from poly.google.com or turbosquid.com
47. We are hiring
Front End Developer
Virtual Reality Programmers
3d Artist
UI Designer
UX Researcher
Flexible work hours
Equity options
Monthly Team activity
Lucrative package