A talk from the Develop Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018. Yoon Park (Microsoft): Open-source Building Blocks for Windows Mixed Reality Experiences Learn about useful building blocks and examples in Mixed Reality Toolkit(MRTK) that helps you jumpstart your mixed reality app development for HoloLens and immersive headsets. http://AugmentedWorldExpo.com

1. Open-Source Building Blocks for
Windows Mixed Reality Experiences
Yoon Park
Principal UX Designer, Windows Mixed Reality Design, Microsoft

2. Foundational components, common interactions and UI controls
for building Windows Mixed Reality experiences
Mixed Reality Toolkit - Unity
http://aka.ms/MRTK

3. Mixed Reality Toolkit - Unity
http://aka.ms/MRTK

4. Input Interactable Object
& Receiver
Bounding Box
& App Bar
Voice
Command
Spatial
Understanding
MRTK
Standard Shader
Solver
System
Object
Collection
Two Hand
Manipulation
Attach to
Controller
http://aka.ms/MRTK

5. Input

7. |
InputManagerTest.unity
HoloToolkit-Examples/Input/Scenes/MotionControllerTest.unity

8. |
Mixed Reality Toolkit Configure Apply Mixed Reality Scene Settings
InputManager
MixedRealityCameraParent
DefaultCursor

9. |
MixedRealityCamera.prefab MixedRealityCameraParent.prefab
Camera only Camera + Motion Controller
+ Teleportation + Boundary

10. |

11. |

13. Interactable Object
& Receiver

15. |
InteractableObjectExample.unity

16. |
BASE
ANIMATION
TEXT
SOUND
SPEECH

17. |
CompoundButton.cs
CompoundButtonMesh.cs
CompoundButtonIcon.cs
CompoundButtonText.cs
CompoundButtonSound.cs
CompoundButtonSpeech.cs
CompoundButtonAnim.cs
CompoundButtonToggle.cs
Mixed & match for your purpose

19. InputDown
List<GameObject> interactables
FocusEnter
HoldCompleted
InputClicked
InputUp

20. |

21. |

22. Bounding Box
& App Bar

24. |
BoundingBoxGizmoExample.unity

25. |
BoundingBoxRig.cs
TwoHandManipulatable.cs

26. |

28. Two Hand
Manipulation

30. TwoHandManipulationTest.unity
|

31. |
TwoHandManipulatable.cs
BoundingBoxBasic.prefab

33. Object Collection

35. |
ObjectCollectionExample.unity

36. |

37. |
ObjectCollection.cs

39. Solver

41. |
SolverExamples.unity

42. |
SolverHandler.cs
SolverBodyLock.cs
SolverConstantViewSize.cs
SolverRadialView.cs
SolverSurfaceMagnetism.cs
SolverMomentumizer.cs
Base class (automatically added)
Mixed & match for your purpose

43. Solver | Body LockSolver | Surface Magnetism

44. Solver | Radial View

45. Solver | Body Lock

46. Voice Command

48. |
SpeechInputSource.unity

49. |
SpeechInputSource

50. |
ISpeechHandler
OnSpeechKeywordRecognized

51. Spatial Understanding

53. |
SPATIAL MAPPING SPATIAL PROCESSING SPATIAL UNDERSTANDING
Meshes only Planes Semantic labeling
SpatialMapping.unity SpatialProcessing.unity SpatialUnderstanding.unity

54. Object placement on physical surface

55. Attach to Controller

57. |
AttachToController.cs

58. |
AttachToController.cs Where do you want to attach to?

60. MRTK Standard Shader

62. |
MaterialGallery.unity

64. Contributing to
Mixed Reality Toolkit

73. Resources for Building Apps
http://aka.ms/MR
Academy Tutorials Development Guideline Design Guideline

74. http://aka.ms/MRTK
@cre8ivepark
“Open-Source Building Blocks for Windows Mixed Reality Experiences”
Post on Medium.com