Engineers @ NudgeNudge - July master lecture slides


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Engineers @ NudgeNudge - July master lecture slides

  1. 1. AUGMENTED REALITY AND 3D<br />By<br />Ivan Trajkovic<br />and<br />DamirBurazerovic<br />
  2. 2. INDEX<br />What is Augmented Reality ?<br />Problems in Augmented Reality<br />Augmented Reality on Android platform<br />Development platform and system requirements<br />LG Optimus 3D additional requirements<br />ARToolKit<br />
  3. 3. WHAT IS AUGMENTED REALITY (AR) ?<br />It is a variation of Virtual Environments (VE)<br />It is a system that supplements the real world with computer-generated virtual objects which seem to coexist in the same space and present the following properties:<br />It combines real and virtual objects in real environment<br />It executes interactively in real time<br />It lines up real and virtual objects<br />It is applied to all senses of the user<br />
  4. 4. PROBLEMS IN AUGMENTED REALITY<br />There are three major challenges associated with AR:<br />CAMERA <br />TRACKING<br />HANDLING <br />OCCLUSIONS<br />ILLUMINATION <br />CONSISTENCY<br />
  5. 5. CAMERA TRACKING<br />Fig 1: the Simple Program Running a virtual block aligned with a real mark<br />Fig 2: Threshold Video Image <br />with Identified Pattern<br />
  6. 6. HANDLING OCCLUSIONS<br />Problem: real objects are in front of the virtual objects in the scene<br />
  7. 7. ILLUMINATION CONSISTENCY<br />Three frames from a 3 hour long sequence showing virtual sculpture <br />rendered into scene with consistent illumination.<br />
  8. 8. AUGMENTED REALITY ON ANDROID PLATFORM<br />AndAR - Android Augmented Reality.<br />ARToolKit for Android.<br />( )<br />NyARToolkit.<br /><ul><li>Java/C#/Android.</li></ul>( )<br />
  9. 9. DEVELOPMENT PLATFORM AND SYSTEM REQUIREMENTS<br />Multiplatform (Linux, MacOS and Windows)<br />Windows XP (32-bit), Vista (32- or 64-bit), or Windows 7 (32- or 64-bit)<br />Mac OS X 10.5.8 or later (x86 only)<br />Linux (tested on Ubuntu Linux, Lucid Lynx)<br />Android SDK<br />(<br />Eclipse IDE<br />ADT Plugin for Eclipse<br />
  10. 10. LG OPTIMUS 3D ADDITIONAL REQUIREMENTS<br />Real3D SDK <br />(<br />What LG Real3D provides<br />Real3D API that helps you to control the display hardware block interliving<br />Real3D API demos<br />The emulator that enables you to test your 3D applications with red-cyan glasses<br />
  11. 11. WHAT IS Real3D?<br />
  12. 12. HOW Real3D WORKS?<br />Source: LG Real3D SDK<br />
  13. 13. ARToolKit<br />Software library for building AR applications.<br />Originally developed by Dr. Hirokazu Kato.<br />Human Interface Technology Laboratory (HIT Lab) at the University of Washington,<br />HIT Lab NZ at the University of Canterbury, New Zealand,<br />ARToolworks, Inc, Seattle.<br />
  14. 14. ARToolKit<br />Uses computer vision algorithms to solve AR tracking problem.<br />Calculate the real camera position and orientation relative to physical markers in real time.<br />
  15. 15. ARToolKitFEATURES<br />Multiplatform (Linux, MacOS and Windows)<br />Single camera tracking using any black square.<br />Distributed with complete source code.<br />Fast rendering based on OpenGL.<br />Simple and modular API (in C and C++).<br />A complete set of samples and utilities.<br />
  16. 16. ARToolKit FEATURES<br />OpenSource with GPL license for non- commercial usage.<br />Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA. <br />
  17. 17. ARToolKit ARCHITECTURE<br />ARToolKit has three basic modules:<br />Scene Capturer<br />2. Augmented Reality (AR)<br />3. Augmented Image Generator<br />
  18. 18. HOW DOES ARToolKit WORK?<br />Source:<br />
  19. 19. LIMITATIONS<br />Virtual objects appear only when complete markers are visible.<br />Size of virtual objects<br />Movement of virtual objects<br />If users cover up part of the pattern with their hands or other objects the virtual object will disappear<br />
  20. 20. LIMITATIONS<br />Range issues<br />Pattern complexity<br />Marker orientation relative to the camera<br />Lighting conditions<br />
  21. 21. ARToolKit – DEVELOPMENT PRINCIPLES<br />There are two stages when developing an ARToolKitapplication:<br />1. Writing the application.<br />2. Training image-processing routines on markers that will be <br /> used in the application.<br />
  22. 22. ARToolKit – Development Principles<br />
  23. 23. LITERATURE<br />Augment Reality (Edited by SohaMaad), 2010 Intech<br />ARToolKit<br /><br />Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach<br /> Authors: Yuan Tian, Tao Guan* and Cheng Wang<br /><br />
  24. 24. LINKS<br />ARToolKit<br /><br />ARToolkitPro for Android<br /><br />ARToolkitPlus 2.1.1<br /><br />NyARToolkit for Android<br /><br />