Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Augmented reality for the Enterprise

1,120 views

Published on

Talk 3 in my HoloLens talk series focused on use in the Enterprise, All video content removed.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Augmented reality for the Enterprise

  1. 1. www.cameronvetter.com 1 Augmented Reality Let’s Make Some Holograms!
  2. 2. Goal of this Presentation www.cameronvetter.com 2 Learn AR Terminology Build an Application Enterprise Use Cases See Lots of Examples
  3. 3. www.cameronvetter.com About Me Senior Software Architect www.cameronvetter.com @PoshPorcupine
  4. 4. HoloLens Video Collage www.cameronvetter.com
  5. 5. Presentation Roadmap www.cameronvetter.com 5 Holograms Control Real World Understanding Spatial Mapping Plane Finding Spatial Understanding Gaze Cursor Gestures Voice Billboarding Placement Physics
  6. 6. Holographic Lens 1268 x 720 Per Eye 3 Waveguide Lenses Per Eye Intel Atom CPU X5-Z8100 1.4 GHZ 2GB Ram Holographic Processing Unit Custom build Microsoft GPU Sensors 4 Environment Cameras 1 Depth Camera 1 Video Camera 4 Microphones 1 Light Sensor What is the HoloLens? www.cameronvetter.com 06
  7. 7. Development Stack www.cameronvetter.com 7 Visual Studio 2015 Update 3 Windows 10 SDK Unity 3D v5.4+ HoloLens Emulator HoloToolkit / HoloToolkit-Unity
  8. 8. Trimble Architecture www.cameronvetter.com
  9. 9. Real World Understanding www.cameronvetter.com 9
  10. 10. World Coordinate System 1 Unit = 1 Meter User Start is Origin X=0, Y=0, Z=0 Hidden Triangles Called the Spatial Mesh Spatial Anchors Attach Hologram to Reference Points in the Spatial Map Spatial Mapping www.cameronvetter.com 010
  11. 11. Room Spatial Mesh Visualized with Solids in the Illustration Physics Holograms and Real World interact with each other through Game Engine Physics Occlusion Works Both Ways Plane Finding Ability to Find Planes in the Real World What do we get? www.cameronvetter.com 011
  12. 12. Uses Spatial Map Spatial Map Data used to find Planes Type of Planes Walls Floor Ceiling Horizontal Surfaces Other Skipping this Topic We now have Spatial Understanding Plane Finding www.cameronvetter.com 012
  13. 13. World Understanding More Detail than Spatial Map Topology Queries Simple Surface and Spatial Queries Object Placement Solver Constraint Based Placement of Object Sets Shape Queries Look for Real World Shape Matching Custom Shape by the User Spatial Understanding www.cameronvetter.com 013
  14. 14. Demos www.cameronvetter.com Spatial Mapping Spatial Understanding
  15. 15. Thyssenkrupp Elevator www.cameronvetter.com
  16. 16. Holograms www.cameronvetter.com 16
  17. 17. Body Locked Tags Along with the Display Display Locked Positionally Locked to the Display Use Sparingly Clinginess is Frustrating for Users Breaks Illusion Holograms are Intended to Blend, Not Overlay Billboarding www.cameronvetter.com 017
  18. 18. Relative to Origin Origin is Starting Position, Not Current Position Relative to Real World Must take into Account, Real World Objects Spatial Understanding Used to Accurately Place Objects with Object Placement Solver Plane Finding Used to Quickly Find Ceiling, Tables, Walls, and Other Surfaces Placement www.cameronvetter.com 018
  19. 19. Tracks World State Real World Objects and Holograms Placement Types OnFloor, OnWall, OnCeiling, OnShape, OnEdge, OnFloorAndCeiling, RandomInAir, InMidAir, UnderFurnitureEdge Placement Constraint NearPoint, NearWall, AwayFromOtherObjects, AwayFromPoint Placement Rules AwayFromPosition, AwayFromWalls, AwayFromOtherObjects Object Placement Solver www.cameronvetter.com 019
  20. 20. Unity Engine Provided Add a RigidBody to Any Hologram to Make it Observe Game Engine Physics Spatial Map Collider Each Plane in the Spatial Mesh Receives a Unity Collider Not the Other Way Real World Objects are not Impacted by Holograms Real World Impact Holograms are Impacted by Real World Physics www.cameronvetter.com 020
  21. 21. Demos www.cameronvetter.com Placement Solver
  22. 22. PGA Tournament www.cameronvetter.com
  23. 23. Control www.cameronvetter.com 23
  24. 24. Detects Using Raycast Raycast from User’s Eyes to Unity Collider Primary Interaction Looking At Holograms is the Primary Way to Interact with Holograms Real World has Colliders Remember During Spatial Mapping the Real World is given Colliders Invisible Objects Any Holograms missing a Collider are not Selectable with Gaze Gaze www.cameronvetter.com 024
  25. 25. Center of View Display Locked to Center of View Requires Gaze Cursor Depends on Gaze, Expect Both to be in Every Project Stick with Standard Cursor Use Microsoft Provided Cursors Unless you Have a Good Reason to Customize, TIP: You Don’t Selection Primarily used for Selection Confirmation in Conjunction with Gaze and Gestures Cursor www.cameronvetter.com 025 The Cursor
  26. 26. Bloom Task Switch / Start Menu Air Tap Similar to Primary Mouse Button Manipulation Typically Used to Move or Drag Items Hold Similar to Right Clicking Gestures www.cameronvetter.com 026
  27. 27. Auxiliary Controls The Real Right Click Use Windows 10 Speech Standard Engine Built into Windows System Level Commands Select == Air Tap Face Me Bigger Smaller Concise Commands Too Long is Hard to Remember Too Short is Hard to Differentiate Voice Input www.cameronvetter.com 027
  28. 28. Caterpillar Sales www.cameronvetter.com
  29. 29. LIVE DEMO!!! www.cameronvetter.com 29 01 02 03 04 05 06 Place Holograms Map the Room Use A Gesture Shadows Voice Commands Physics
  30. 30. In Summary www.cameronvetter.com 30 Holograms Control Real World Understanding Spatial Mapping Plane Finding Spatial Understanding Gaze Cursor Gestures Voice Billboarding Placement Physics
  31. 31. Interior Design Reimagined www.cameronvetter.com
  32. 32. www.cameronvetter.com 32 www.cameronvetter.com cameron@cameronvetter.com @poshporcupine Any Questions?

×