This document discusses analyzing visual content using HoloLens, computer vision APIs, Unity and the Mixed Reality Toolkit. It introduces mixed reality as existing on a spectrum between physical and digital reality, with virtual reality and augmented reality on that spectrum. It describes some input methods for mixed reality applications like gaze, gesture, voice and motion control. It also lists some Microsoft tools and resources for computer vision and mixed reality development like the Windows ML APIs, Mixed Reality Toolkit, Cognitive Services and Microsoft Ignite.

1. Analysing visual content using HoloLens,
Computer Vision APIs,
Unity and the Mixed Reality Toolkit
Davide Zordan
B: https://www.davidezordan.net
E: mail@davidezordan.net
T: @DavideZordan

2. Davide Zordan
Software Engineer
MCSD, MCSA, MS, MCP
Xamarin Certified Mobile Developer
Microsoft MVP (2009-2014)

3. MIXED REALITY
VIRTUAL REALITYPHYSICAL REALITY

4. PHYSICAL
REALITY
DIGITAL
REALITY
MIXED REALITY (MR)
WINDOWS MIXED REALITY HOLOGRAPHIC DEVICES (SEE-THROUGH)
WINDOWS MIXED REALITY IMMERSIVE DEVICES (OPAQUE)
AR
TODAY
VR
TODAY
Physical - Digital Reality Spectrum
*The term mixed reality was originally introduced in a 1994 paper by Paul Milgram and Fumio Kishino, "A Taxonomy of Mixed Reality Visual Displays."

5. A new way to interact

6. Source: https://www.microsoft.com/en-us/research/blog/microsoft-hololens-facilitates-computer-vision-research-by-providing-access-to-raw-image-sensor-streams-with-research-mode/

7. Gaze

8. Gesture

9. Voice

10. Motion control

11. World coordinates
Spatial mapping
Spatial audio

14. Windows ML

26. Mixed Reality Academy
https://docs.microsoft.com/en-us/windows/mixed-reality/academy
Mixed Reality Toolkit
https://github.com/Microsoft/MixedRealityToolkit-Unity
Cognitive Services
https://azure.microsoft.com/en-gb/services/cognitive-services/
Microsoft Ignite
https://8gportalvhdsf9v440s15hrt.blob.core.windows.net/ignite2017/session-
presentations/BRK2404.PPTX

27. “Any sufficiently advanced technology is
indistinguishable from magic”
Arthur C. Clark, Profiles of the future, 1961

28. Thanks
Davide Zordan
B: https://www.davidezordan.net
E: mail@davidezordan.net
T: @DavideZordan