Building Holographic
Experiences with the
HoloToolkit for Unity
Nick Landry
Defining Mixed Reality
Physical Reality Digital RealityMixed Reality
Windows Mixed Reality Holographic Device (See-through)
Windows Mixed Reality Immersive Devices (Opaque)
Windows Mixed Reality:
• Includes Perception / Environment Awareness
• Any Mix of People, Places, or Things
Mixed Reality Spectrum
AR Today VR Today
REALITY VIRTUALITY
REALITY VIRTUALITY
REALITY VIRTUALITY
REALITY VIRTUALITY
REALITY VIRTUALITY
Hardware details for development
edition devices from Acer and HP
▪ Two high-resolution LCD at 1440 x 1440
▪ 2.89” diagonal display size (x2)
▪ Front hinged display
▪ 95° horizontal field of view
▪ Display refresh rate up to 90 Hz (native)
▪ Built-in audio out and microphone support through
3.5mm jack
▪ Single cable with HDMI 2.0 (display) and USB 3.0 (data)
for connectivity
▪ 4.00m/0.60m removable cable
▪ Inside-out tracking
Windows Mixed Reality collection
Immersive headsets
Powered by
Windows Mixed Reality
What is HoloLens?
Holograms enhance the
real world
Microsoft HoloLens is the first, fully untethered holographic computer
that redefines personal computing and empowers you in new ways.
New ways to connect,
create, and explore
A more natural way to
interact
Advanced technology
from Microsoft
Windows Mixed Reality
Universal Windows Platform
Models Materials Textures Shaders Sounds Scripts
Cursor
prefabs
Sharing
prefab
Spatial
prefabs
Utilities Shaders Tests
Gaze
Input
Gesture
Input
Voice
Input
Spatial
Anchors
Spatial
Mapping
Spatial
Sound
Try your app on the HoloLens emulator today
You need:
Visual Studio 2015 or 2017
64-bit Windows 10 Pro, Enterprise, or
Education with a 64-bit CPU (4+ cores)
8GB RAM
GPU (DirectX 11, WDDM 1.2 driver)
Windows 10 SDK (10.0.10586 or newer)
HoloLens Emulator (requires, Hardware-
assisted virtualization, SLAT & DEP)
A UWP app that builds for x86
Unity not needed for 2D UWP apps
dev.microsoft.com/windows/mixed-reality
http://aka.ms/mr
“Hello World” Introduction Gaze Input
Gesture Input Voice Input Spatial Sound
Spatial Mapping Shared Experiences
Galaxy Explorer
Open source application available in the store. The idea was voted by the
community and originally built for HoloLens. It now supports all mixed reality
devices, and is a useful end-to-end demonstration of how to build a Unity app for
Windows Mixed Reality.
Toolkit
Library with many component that make it easier to build mixed reality apps,
including plug-ins for Unity. Some of the more popular components are the
sharing services for multiplayer mixed reality apps and spectator view.
Academy Tutorial Apps
The tutorials are great starting points for your app, and they improve with
community contributions too.
Work with our teams or our agencies
Join the community
Online tools & resources
dev.windows.com/mixedreality
Download the tools
aka.ms/hololensdevtools
Follow the training
aka.ms/holographicacademy
Forums.hololens.com
Questions, discussion, and feedback
from the mixed reality development
community.
Github/microsoft
aka.ms/GalaxyExplorer
aka.ms/holotoolkitunity
aka.ms/holotoolkit
aka.ms/windowsdeviceportalwrapper
aka.ms/holographicacademygithub
aka.ms/MRcommunity
Microsoft Technology Centers
Experience HoloLens & discuss core business uses
aka.ms/iwantmr
Join MR@MS: A program tailored to your needs,
providing guidance and support from ideation to
publish.
aka.ms/MRcommunity
Technical Evangelists - Connect with one of our technical evangelists in your area.
Meetups: join one of the hundreds of meetups around the world
aka.ms/agencies
Agency partners have HoloLens
development expertise and dedicated
teams to take on application
development for clients.
mpcbdesk@microsoft.com
Our teams will work with you from envisioning,
to proof of concepts, all the way to
deployment.
Acer - Windows Mixed Reality
Development Edition
Microsoft HoloLens
Development Edition
Available today on microsoftstore.com
Shipping to : Australia, Canada, France, Germany, Ireland, Japan, New
Zealand, United Kingdom and United States. (pre-order available soon
for China)
English only
HoloLens Development Edition: $3000
HoloLens Commercial Suite: $5000
For more information: www.hololens.com
Sign up today on aka.ms/iwantmr
Shipping to: TBA
Languages: English, French, German, Chinese (simplified) and Japanese
http://docs.microsoft.com
activenick@microsoft.com
https://microsoft.github.io/techcasestudies
Thank You
Nick Landry
Sr. Technical Evangelist, Microsoft
activenick@microsoft.com
slideshare.net/ActiveNick
github.com/ActiveNick
@ActiveNick
Building Mixed Reality Experiences with the HoloToolkit for Unity

Building Mixed Reality Experiences with the HoloToolkit for Unity

  • 1.
    Building Holographic Experiences withthe HoloToolkit for Unity Nick Landry
  • 5.
  • 6.
    Physical Reality DigitalRealityMixed Reality Windows Mixed Reality Holographic Device (See-through) Windows Mixed Reality Immersive Devices (Opaque) Windows Mixed Reality: • Includes Perception / Environment Awareness • Any Mix of People, Places, or Things Mixed Reality Spectrum AR Today VR Today
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 13.
    Hardware details fordevelopment edition devices from Acer and HP ▪ Two high-resolution LCD at 1440 x 1440 ▪ 2.89” diagonal display size (x2) ▪ Front hinged display ▪ 95° horizontal field of view ▪ Display refresh rate up to 90 Hz (native) ▪ Built-in audio out and microphone support through 3.5mm jack ▪ Single cable with HDMI 2.0 (display) and USB 3.0 (data) for connectivity ▪ 4.00m/0.60m removable cable ▪ Inside-out tracking
  • 14.
    Windows Mixed Realitycollection Immersive headsets Powered by Windows Mixed Reality
  • 19.
    What is HoloLens? Hologramsenhance the real world Microsoft HoloLens is the first, fully untethered holographic computer that redefines personal computing and empowers you in new ways. New ways to connect, create, and explore A more natural way to interact Advanced technology from Microsoft
  • 21.
  • 29.
    Models Materials TexturesShaders Sounds Scripts Cursor prefabs Sharing prefab Spatial prefabs Utilities Shaders Tests Gaze Input Gesture Input Voice Input Spatial Anchors Spatial Mapping Spatial Sound
  • 32.
    Try your appon the HoloLens emulator today You need: Visual Studio 2015 or 2017 64-bit Windows 10 Pro, Enterprise, or Education with a 64-bit CPU (4+ cores) 8GB RAM GPU (DirectX 11, WDDM 1.2 driver) Windows 10 SDK (10.0.10586 or newer) HoloLens Emulator (requires, Hardware- assisted virtualization, SLAT & DEP) A UWP app that builds for x86 Unity not needed for 2D UWP apps dev.microsoft.com/windows/mixed-reality
  • 34.
    http://aka.ms/mr “Hello World” IntroductionGaze Input Gesture Input Voice Input Spatial Sound Spatial Mapping Shared Experiences
  • 35.
    Galaxy Explorer Open sourceapplication available in the store. The idea was voted by the community and originally built for HoloLens. It now supports all mixed reality devices, and is a useful end-to-end demonstration of how to build a Unity app for Windows Mixed Reality. Toolkit Library with many component that make it easier to build mixed reality apps, including plug-ins for Unity. Some of the more popular components are the sharing services for multiplayer mixed reality apps and spectator view. Academy Tutorial Apps The tutorials are great starting points for your app, and they improve with community contributions too.
  • 36.
    Work with ourteams or our agencies Join the community Online tools & resources dev.windows.com/mixedreality Download the tools aka.ms/hololensdevtools Follow the training aka.ms/holographicacademy Forums.hololens.com Questions, discussion, and feedback from the mixed reality development community. Github/microsoft aka.ms/GalaxyExplorer aka.ms/holotoolkitunity aka.ms/holotoolkit aka.ms/windowsdeviceportalwrapper aka.ms/holographicacademygithub aka.ms/MRcommunity Microsoft Technology Centers Experience HoloLens & discuss core business uses aka.ms/iwantmr Join MR@MS: A program tailored to your needs, providing guidance and support from ideation to publish. aka.ms/MRcommunity Technical Evangelists - Connect with one of our technical evangelists in your area. Meetups: join one of the hundreds of meetups around the world aka.ms/agencies Agency partners have HoloLens development expertise and dedicated teams to take on application development for clients. mpcbdesk@microsoft.com Our teams will work with you from envisioning, to proof of concepts, all the way to deployment.
  • 37.
    Acer - WindowsMixed Reality Development Edition Microsoft HoloLens Development Edition Available today on microsoftstore.com Shipping to : Australia, Canada, France, Germany, Ireland, Japan, New Zealand, United Kingdom and United States. (pre-order available soon for China) English only HoloLens Development Edition: $3000 HoloLens Commercial Suite: $5000 For more information: www.hololens.com Sign up today on aka.ms/iwantmr Shipping to: TBA Languages: English, French, German, Chinese (simplified) and Japanese
  • 39.
  • 40.
    Thank You Nick Landry Sr.Technical Evangelist, Microsoft activenick@microsoft.com slideshare.net/ActiveNick github.com/ActiveNick @ActiveNick