Augmented Reality with Open Source Software

  • 4,260 views
Uploaded on

The presentation summarizes the process and results of a marker-based Augmented Reality pilot project implemented using open source software, e.g. FLARToolKit.

The presentation summarizes the process and results of a marker-based Augmented Reality pilot project implemented using open source software, e.g. FLARToolKit.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
4,260
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
60
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Open Source AR Software Business Case DirectFactory Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 1
  • 2. BeCompany – About UsHead office in ZurichIndependent integratorTechnology evaluation, focus on new technologiesConsulting, implementation, supportSpecialized in open source technologiesSwiss Post solution provider:DirectFactory and other web applications Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 2
  • 3. DirectFactory & AR: Requirements DirectFactory as tool for AR campaigns Allow users to create/import 3D scenes Use postcards as advertisement and carrier/interaction medium Personalization (text/other possibilities) AR platforms: Desktop, iOS, Android Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 3
  • 4. Marker-based AR Video Tracking 3D Model 3D Processing Marker position in 3D space Camera position for rendering Textures Composition 3D Rendering & Animation Animation Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 4
  • 5. Business Case DirectFactory Step 1: Technology Evaluation Step 2: Prototype Step 3: Pilot Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 5
  • 6. Step 1: Technology EvaluationTechnologies (open & closed source)Technical requirements & conditionsLegal conditions (licensing)Options & capabilities (supported content &markers, quality, reliability, personalization, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 6
  • 7. Step 1: Technology EvaluationClosed Source VendorsHigh quality showcasesCross-platform solutionsNo out-of-the-box personalization capabilityCore customization requires cooperation withvendor Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 7
  • 8. Step 1: Technology EvaluationOpen Source VendorsLack of high-quality showcasesProjects focusing on single platforms, driven byindividual use cases, not market penetrationSmall core development communitiesLarge supply of knowledgeable developers forindividual platforms, but not across platformsLow initial costs Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 8
  • 9. Open Source Marker-Based AR Platforms RuntimeHardware Operating System Video Tracking 3D Rendering Environment Away3D Flash FLARToolKit Papervision3D Windows,Desktop Mac OS Silverlight 5 3D Silverlight SLARToolKit Balder Native OpenSceneGraph iOS ARToolKit for iOS (Objective C) (OpenGL) Android Native (Java) ARToolKit/AndAR OpenGL Mobile Native (C#) / Windows Phone Mango / SLARToolKit Native (C#) Silverlight Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 9
  • 10. Flash vs. Silverlight Flash Nov 10 - Apr 11 Source: statowl.comSilverlight Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 10
  • 11. Decision: Flash + FLARToolKitBased on proven ARToolKit algorithmsLarge supply of knowledgeable developersDual license (GPL for non-commercial use)Supports multiple 3D engines:Papervision3D, Away3D, Sandy, Alternativa3DMarker: simple geometric forms, asymmetric Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 11
  • 12. Step 2: PrototypeGoalsProof of concept: Integration DF & ARBasic technical capabilities & limitationsBasic project workflow Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 12
  • 13. Step 2: Desktop PrototypeLessons learned during ImplementationEasy integration of DF personalization service(objects rendered independent from 3D scene)Very fast implementationPostcard feasible as marker carrierNo no-go criteria foundBut: no anmiation yet – critical! Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 13
  • 14. Step 3: PilotGoalsReality check, verify assumptionsActual implementation cost & complexity3D model & anmiation workflowAcceptance, understanding by recipientsReal-world technical limitations (webcam, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 14
  • 15. Limitations & ConclusionAndreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 15
  • 16. Technical LimitationsAR solutions still in early development stage:„Peak of Inflated Expectations“ (Gartner)No cross-platform runtime environment(except proprietary plug-ins)Flash usability problems:Browser window size bug on Firefox Mac,Keyboard focus Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 16
  • 17. Handling LimitationsUsers not familiar with AR applicationsWebcam not available in older computersRigid lenses (notebooks) can impede handlingfor some applicationsConsideration: Alternative content for userswithout webcam Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 17
  • 18. 3D Scene LimitationsExisting standards (OpenGL) not consistentlyavailable across platformsNo universal standard for 3D scenes(3D modelling -> 3D rendering):Built in Cinema4D, problems importing in Away3DGeneric application + arbitrary pluggable 3D scenesvery hard to achieve („AR scene library“)Close cooperation between designer and AR/Flashdeveloper necessary Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 18
  • 19. Rendering Performance Limitations 3D Rendering Flash Stage3D Flash („Molehill“) DirectX 9, zzzz… OpenGL 1.3, OpenGL ES 2.0 „Future version of Flash Player“CPU GPU Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 19
  • 20. Marker LimitationsBlack & whiteSimple, asymmetric shape (orientationdetection)Size approx. 10 x 10 cmSurface not shiny (postcard varnishing!)Rigid carrier material to ensure that themarker stays flat Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 20
  • 21. Personalization LimitationsPersonalization of 3D scene problematic(personalized objects separate from 3D scene)Marker-based personalization not possible withARToolKitAlphanumeric code: cumbersome, risk of typingerrorsVisual code (QR): additional visual marker couldbe confusing Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 21
  • 22. Conclusion – as things are now :)Many technical problems not related to AR itselfMultiple components with individual limitationsinvolved, incompatibilitiesTechnical limitations dictate conceptual & functionalpossibilities – „function follows form“Easy implementation, low initial costsRealization in short timeframe possibleBe aware of non-technical limitations(appeal, handling, usability, guidance) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 22
  • 23. When to Use Closed SourceHigh quality requirementsComplex 3D scenes (many polygons)Image (e.g. photo) as markerSupport for multiple platforms (desktop, mobile) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 23
  • 24. When to Use Open SourceLow initial costsLow quality/complexity requirements(3D scene, marker)Short time-to-marketSingle target platform(desktop or particular mobile platform)Customizability (personalization, integration inother services, …) Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 24
  • 25. The End Thank you for your attention!Andreas Hartmann: Open Source AR Software – Business Case DirectFactory 2011-05-31 25