Alexander is begin dit jaar benoemd tot Microsoft MVP HoloLens en Mixed Reality. Hij neemt je mee in de wereld van mixed reality met de HoloLens van Microsoft. Mixed reality brengt mensen, plaatsen en objecten uit je fysieke en digitale wereld bij elkaar. Deze gemengde omgeving wordt je canvas, waar je een breed scala aan ervaringen kunt creëren en genieten.

1. Mixed Reality
and HoloLens
as part of your industry
April 11th, 2018
ETTU
Functional Session – Level 100

2. ABOUT ME
• HoloLens Evangelist / Solutions Architect @ ETTU
• Mixed Reality Team
• Microsoft Windows Development MVP since 2018
• Founder of the Mixed Reality User Group
Email: a.meijers@ettu.nl
Twitter: @ameijers
Blog: http://www.appzinside.com

3. MIXED REALITY USER GROUP
• Elke 2 maanden een community evenement met twee sprekers
• 2 keer per jaar een Mixed Reality Hackathon
• Onderdeel van de Global AI Bootcamp
• Mogelijkheid tot bloggen
• Bestuurders zijn Alexander Meijers & Sjoukje Zaal
• https://www.mixug.com

4. AGENDA
• Realities explained & the future
• HoloLens, how does it work
• Fields of Application
Use cases
• Quality Control & Training
• Modelling
• World of Cubes
• Spatial Design Concept
• Warehouse order picking system

5. REALITIES EXPLAINED
Merging of real and
virtual worlds to produce
new environments and
visualizations where
physical and digital
objects co-exist and
interact in real time.
An overlay of synthetic
content on the real world
that is anchored to and
interacts with the real
world
MIXED REALITY
Direct or indirect view of a
physical, real-world
environment whose
elements
are augmented by
computer-generated
sensory input such as
sound, video, graphics
or GPS data
An overlay of content on
the real world where that
content is not anchored
to or part of it
AUGMENTED REALITY
Generation of realistic
images, sounds and other
sensations that replicate a
real environment or create
an imaginary setting
An immersive experience
created entirely from
computer-generated
Content. Also similar to
360 degree video
VIRTUAL REALITY

6. EVERYTHING BECOMES MIXED REALITY
 Virtual Reality devices
 SteamVR
 AltSpaceVR
 October/November 2017
IMMERSIVE HEADSETS
 Mixed Reality Device
 Developer and Commercial Suite
version
 Since October 2016
HOLOLENS
2019
HoloLens v3March
2018
Prelease
Software
update

7. MICROSOFT
HOLOLENS

8. In the beginning…

9. SENSORS, OPTICS
AND SPEAKERS

10. MICROSOFT HOLOLENS
SPECIFICATIONS
• Windows 10 device based
on 32 bit architecture
• 64GB flash
• 2GB memory
• 1GB Holographic Processor Unity (HPU)
• First of its kind
• Device is more powerful than a laptop
• No overheating due to warm air flows to the sides
• 2-3 hours active and 2 weeks standby
• Weight 579g

11. INPUT CONTROLS

12. Gaze
• The direction of the HoloLens
pointing is called the gaze
• Hits an object or part of the
environment

13. Gestures
• Recognize input by tracking the position of either or both hands
• Gesture frame
• Recognized input from hands
• Bloom
• Press, hold and release

14. Voice
• Use words or sentences to control your environment
• English language only at the moment
• Cortana
• Start with “Hey Cortana”
• Some thing you can say
• Move <app name> here
• Take a picture
• Start or stop recording
• Call <contact>
• How much battery do i have left?
• Restart or Shutdown
• Cortana can be turned on/off

15. SOUND

16. Spatial Sound
• Simulates 3D sound using direction,
distance and environmental simulations
• Above, below, behind, to the side,
etc.
• Attach sound to holographic objects
• Works also when object is not in line
of sight
• Used to draw attention

17. SPATIAL PERCEPTION
AND UNDERSTANDING

18. Spatial perception
• Spatial perception is the ability to be aware of your relationships with the
environment around you and with yourself
• Rooms
• Device scans your environment and builds a digital model in real time
• It allows HoloLens to see different surfaces, walls and ceiling

19. SPATIAL MAPPING IN
PRACTICE

20. Fields of application
•Enables the user to visualize
surrounding which is not directly
visible
•Get visual insight of an object or
model
•Modelling of non-existing objects
visualization
•Enrich real-world environment
objects with information
•Show information as part of the
real-world on a wall or table
•Show additional information to
objects, persons or activities
Provisioning of
information
•Support through linked view, voice
and gestures
•Meetings around Holographic
objects
•Working together on projects
whereby visualization is an
important part
•Working together when distance
is involved
Working
together
•Experience learning
•Getting more realistic teaching by
moving 2D presentations in books
to 3D holographic models
Education
•Holographic media
•Enrich media with additional
holographic objects
Media &
entertainment
•Play games as part of your real-
world environment
•Game interaction with your walls,
ceiling and floor
Gaming

21. SCENARIO’S EN
VOORBEELDEN

22. Quality Control
Guidance around safety
operations at the work site

23. Case Warehousing
Order picking automation with
Mixed Reality and HoloLens

24. Order picking process
• AI controlled support with finding the shortest route in the warehouse
• Markers used to define exact location of products
• Employee selects order from ERP system
• Employee starts picking orders wearing the HoloLens
• Only navigates to existing products
• Navigation and directions through arrows on floors and walls
• Auto sign off when product is picked
• HoloLens updates the ERP system

29. Product recognition

30. Spatial Design Concept

31. SPATIAL DESIGN CONCEPT

32. Jumbo Maritime

33. Jumbo Shipping

34. Deck Marking to support the
loading process on board

35. Deck Marking projection

36. Deck Marking test in action
together with young Feyenoord

37. DECK MARKING

38. World Of Cubes
Teaching children
folding different models
into realistic cubes

39. World Of Cubes
Teaching children
folding different models
into realistic cubes

40. World Of Cubes
Teaching children
folding different models
into realistic cubes

41. WORLD OF CUBES

42. Enrich 3D models with
explanation in text, movies
and exploded view of parts
Train personnel in
machines and equipment

43. Quickly train new
personnel using floor
machinery
HoloLens gives directions
and explains how the
machine needs to be
operated

44. Life training in a real world
environment. Enrich with
hazardous elements
Possible to play or replay different scenarios. Can be
played together. People can wear the actual clothes
and safety gear

45. Architecture models
Visualize infrastructure,
business functions,
applications and objects

46. Thank you!