Augmented Reality with Open Source Software

4,721
-1

Published on

The presentation summarizes the process and results of a marker-based Augmented Reality pilot project implemented using open source software, e.g. FLARToolKit.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,721
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
72
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Augmented Reality with Open Source Software

  1. 1. Open Source AR Software Business Case DirectFactory Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 1
  2. 2. BeCompany – About UsHead office in ZurichIndependent integratorTechnology evaluation, focus on new technologiesConsulting, implementation, supportSpecialized in open source technologiesSwiss Post solution provider:DirectFactory and other web applications Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 2
  3. 3. DirectFactory & AR: Requirements DirectFactory as tool for AR campaigns Allow users to create/import 3D scenes Use postcards as advertisement and carrier/interaction medium Personalization (text/other possibilities) AR platforms: Desktop, iOS, Android Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 3
  4. 4. Marker-based AR Video Tracking 3D Model 3D Processing Marker position in 3D space Camera position for rendering Textures Composition 3D Rendering & Animation Animation Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 4
  5. 5. Business Case DirectFactory Step 1: Technology Evaluation Step 2: Prototype Step 3: Pilot Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 5
  6. 6. Step 1: Technology EvaluationTechnologies (open & closed source)Technical requirements & conditionsLegal conditions (licensing)Options & capabilities (supported content &markers, quality, reliability, personalization, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 6
  7. 7. Step 1: Technology EvaluationClosed Source VendorsHigh quality showcasesCross-platform solutionsNo out-of-the-box personalization capabilityCore customization requires cooperation withvendor Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 7
  8. 8. Step 1: Technology EvaluationOpen Source VendorsLack of high-quality showcasesProjects focusing on single platforms, driven byindividual use cases, not market penetrationSmall core development communitiesLarge supply of knowledgeable developers forindividual platforms, but not across platformsLow initial costs Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 8
  9. 9. Open Source Marker-Based AR Platforms RuntimeHardware Operating System Video Tracking 3D Rendering Environment Away3D Flash FLARToolKit Papervision3D Windows,Desktop Mac OS Silverlight 5 3D Silverlight SLARToolKit Balder Native OpenSceneGraph iOS ARToolKit for iOS (Objective C) (OpenGL) Android Native (Java) ARToolKit/AndAR OpenGL Mobile Native (C#) / Windows Phone Mango / SLARToolKit Native (C#) Silverlight Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 9
  10. 10. Flash vs. Silverlight Flash Nov 10 - Apr 11 Source: statowl.comSilverlight Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 10
  11. 11. Decision: Flash + FLARToolKitBased on proven ARToolKit algorithmsLarge supply of knowledgeable developersDual license (GPL for non-commercial use)Supports multiple 3D engines:Papervision3D, Away3D, Sandy, Alternativa3DMarker: simple geometric forms, asymmetric Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 11
  12. 12. Step 2: PrototypeGoalsProof of concept: Integration DF & ARBasic technical capabilities & limitationsBasic project workflow Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 12
  13. 13. Step 2: Desktop PrototypeLessons learned during ImplementationEasy integration of DF personalization service(objects rendered independent from 3D scene)Very fast implementationPostcard feasible as marker carrierNo no-go criteria foundBut: no anmiation yet – critical! Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 13
  14. 14. Step 3: PilotGoalsReality check, verify assumptionsActual implementation cost & complexity3D model & anmiation workflowAcceptance, understanding by recipientsReal-world technical limitations (webcam, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 14
  15. 15. Limitations & ConclusionAndreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 15
  16. 16. Technical LimitationsAR solutions still in early development stage:„Peak of Inflated Expectations“ (Gartner)No cross-platform runtime environment(except proprietary plug-ins)Flash usability problems:Browser window size bug on Firefox Mac,Keyboard focus Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 16
  17. 17. Handling LimitationsUsers not familiar with AR applicationsWebcam not available in older computersRigid lenses (notebooks) can impede handlingfor some applicationsConsideration: Alternative content for userswithout webcam Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 17
  18. 18. 3D Scene LimitationsExisting standards (OpenGL) not consistentlyavailable across platformsNo universal standard for 3D scenes(3D modelling -> 3D rendering):Built in Cinema4D, problems importing in Away3DGeneric application + arbitrary pluggable 3D scenesvery hard to achieve („AR scene library“)Close cooperation between designer and AR/Flashdeveloper necessary Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 18
  19. 19. Rendering Performance Limitations 3D Rendering Flash Stage3D Flash („Molehill“) DirectX 9, zzzz… OpenGL 1.3, OpenGL ES 2.0 „Future version of Flash Player“CPU GPU Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 19
  20. 20. Marker LimitationsBlack & whiteSimple, asymmetric shape (orientationdetection)Size approx. 10 x 10 cmSurface not shiny (postcard varnishing!)Rigid carrier material to ensure that themarker stays flat Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 20
  21. 21. Personalization LimitationsPersonalization of 3D scene problematic(personalized objects separate from 3D scene)Marker-based personalization not possible withARToolKitAlphanumeric code: cumbersome, risk of typingerrorsVisual code (QR): additional visual marker couldbe confusing Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 21
  22. 22. Conclusion – as things are now :)Many technical problems not related to AR itselfMultiple components with individual limitationsinvolved, incompatibilitiesTechnical limitations dictate conceptual & functionalpossibilities – „function follows form“Easy implementation, low initial costsRealization in short timeframe possibleBe aware of non-technical limitations(appeal, handling, usability, guidance) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 22
  23. 23. When to Use Closed SourceHigh quality requirementsComplex 3D scenes (many polygons)Image (e.g. photo) as markerSupport for multiple platforms (desktop, mobile) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 23
  24. 24. When to Use Open SourceLow initial costsLow quality/complexity requirements(3D scene, marker)Short time-to-marketSingle target platform(desktop or particular mobile platform)Customizability (personalization, integration inother services, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 24
  25. 25. The End Thank you for your attention!Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 25
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×