Introduction to AR with Unity3D

AR with Unity3D
Introduction to Augmented Reality
with
Unity3D

Saturday, May 26, 12

Intro

• Examples
• Pantalla Global (CCCB)

• Animac

• Salón de Turisme

AR with Unity3D 26/05/2012 - CatDroid Unity3D II @aquarioverde


Koffa@Animac

http://vimeo.com/37868229



What is AR?

• Virtual content overlayed onto the real
word
• 2D / 3D & audio
• Realtime / Live camera view



Detection
• Vision based
• QR codes
• Markers
• Real life objects

• Location based (GPS, Compass)


Vision Based AR

• Tracking
• Frame by frame analysis searching for
“trackables”
• Return position and orientation relative to
device



AR Apps
• Layar
• http://www.layar.com/

• Junaio
• http://www.junaio.com/

• Wikitude
• http://www.wikitude.com/

• Appunta ;-)
• http://appunta.com/



Use
• Arts & Gaming
• Advertising
• Navigation
• Tourism
• Education
• ... and a lot more


Unity3D Libraries

• String
• www.poweredbystring.com

• Vuforia (Qualcomm)
• https://developer.qualcomm.com/mobile-development/mobile-
technologies/augmented-reality



String - Tracking
• Framed Markers
• Multiple marker detection
• <= 10

• Unﬂexible marker creation
• black border surrounded by a white border
necessary



String - Tracking
• Any png

• Full marker has to be in camera (>85%)

• Markers not in scene
• diﬁcult scaling



Vuforia - Tracking
• Image Target
• Frame Markers
• Simple 3D Objects (Boxes)

• More ﬂexible than String on marker
creation



Vuforia - Tracking
• Multiple Image Targets or Frame Markers
• <= 5

• Works if only part of the marker is seen
• Markers placed into 3D Scene
• easy scaling

• Virtual Buttons


Target Management
• Online
• ImageTargets
• MultiTargets

• jpg & png
• RGB & B&W
!
Rich in detail
High in contrast

• Scaling (Unity units) No repetitive patterns



Performance

• String a little bit faster in detection and
tracking

• String is more stable



Platform support

• Vuforia
• Android & iOS

• String
• iOS


String - Setup

• Download library
• Unity3d
• iOS
• Add to Unity3D project
• Add to XCode project


Vuforia - Setup

• Download Vuforia library
• available in Assets Store
• Add to Unity3D Project



Testing
• String:
• In-Editor testing using webcam

• Vuforia:
! Unity Remote

• No image tracking nor life camera

• Device Only Testing



Licensing
• Unity / Unity iOS / Unity Android
• https://store.unity3d.com/

• String
• Expensive!

• http://www.poweredbystring.com/licensing

• Vuforia
• Free!!!



Decision ???



Vuforia


Requirements iOS

• Mac OS Snow Leopard & Lion
• XCode
• https://ar.qualcomm.at/qdevnet/sdk/ios



Requirements Android
• MS Windows 7 & XP
• Linux & Mac OS posssible but not
documented
• JDK + Eclipse + ADT
• Android SDK + NDK
• https://ar.qualcomm.at/qdevnet/sdk/android



Installation

• Download pagackage vuforia-unity-OS-
Version.zip and install
• base extension & samples

• Asset Store


Simple Project
• New project

• Add Vuforia

• Add Dataset (markers)

• Add ARCamera Prefab to scene

• Add ImageTarget Prefab to scene

• Select Dataset and ImageTarget

• Add 3D objects + Light

• Set Load Dataset

• Deploy



Unity Folder Structure



Hands-On

• DroidBalls
• Floating spheres in space
• Touch to dissappear



Raycasting

• Detect 3D object touched on screen
• Ray from touched screen point to
camera
• Detect object collisions



Tracking
• ITrackableEventHandler
• OnTrackableStateChanged

• DefaultTrackableEventHandler

• enable/disable rendering

• ITrackerEventHandler
• OnTrackablesUpdated



Splash Screen

• Display when no marker is detected
• Modify ITrackableEventHandler



Virtual Buttons

• Hotspots on an ImageTarget
• IVirtualButtonEventHandler
• OnVirtualButtonPressed
• OnVirtualButtonReleased
• Can be created at runtime


Problems

• Perfomance
• Image Recognition
• symmetry / similar elements

• contrast / illumination

• Real world sizing


Problems

• Fixed camera vs ﬁxed space
• Physics!!!
• Multiple markers
• center???



Tips & Advices
• 3D Models
• < 2K polygons overall

•
•
< 200 polygons/object (draw calls)

<= 3 materials/object
! Device dependent

• Animations
• < 30 bones

• Use texture sequences


Tips & Advices
• Attach markers to cardboard
• Good lightning but avoid reﬂections

• Disable objects that are not in view

• Test using mouse instead of touch


Tips & Advices

• Scale correctly from the beginning
• Create simple reference objects to map to
real world
• e.g. cubes



Resources

• Unity3D
• http://forum.unity3d.com

• http://answers.unity3d.com

• Vuforia Forums
• https://ar.qualcomm.at/qdevnet/forums

• String ???


Thank you!
Andreas Blick @aquarioverde


Introduction to AR with Unity3D

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Recently uploaded

Recently uploaded (20)

Introduction to AR with Unity3D