Event: IoTDayItaly - www.iotday.it 24 Nov 2017 Speaker: Clemente Giorio Theme: Mixed Reality & IoT

1. Mixed Reality & IoT
Clemente Giorio
R&D Engineer @Crionet
Naples, November 24th 2017

3. #IoTDayItaly

4. ......

5. 1784 – First Meccanical loom

6. 1870 – First Assembly line

7. 1969 – First programmable controller

9. 1968, Apollo Guidance
Computer
2000 Transistor
4k Memory

10. UI Dimensions
{
Transactional
App, Office, Web
Immersive
Games,
3DRendering
{2D UI
Personal
Assistant:
Siri, Cortana
Machine
Learning
Machine2Machin
e
{
1D UI
Virtual,
Augmented and
Mixing Reality
3D UI

12. Some examples
AR
AV
VR

13. Some examples
AR
AV
VR

14. Some examples
AR
AV
VR

15. Some examples
AR
AV
VR

16. Some examples
AR
AV
VR

17. Some examples
AR
AV
VR

18. Some examples
AR
AV
VR

19. Some examples
AR
AV
VR

20. RECAP

23. Why Windows Mixed Reality?
Give your users the freedom
to interact with your
software using gesture,
gaze, and voice—as well as
traditional inputs like mice,
keyboards, and controllers.
Inside-out tracking lets your
users jump right in without
setting up room-based gear,
and eliminates room size
requirements so they can
experience your app almost
anywhere.
Microsoft HoloLens is the
first self-contained
holographic computer, and a
broad range of new devices
with a broad range of
capabilities are on the way.
More devices means more
users and more demand.
.
Windows Mixed Reality
improves your workflow
between coding and testing.
View your 2D desktop from
within your headset or view
your physical surroundings
without fully removing your
headset.

26. History of HoloLens
• Codenamed Project HoloLens
• Chief inventor Alex Kipman
• Official title is technical fellow
• He dreamed up Kinect in at the end of 2007
and set a vision which incorporated HoloLens
• It is the start of a transforming world
• In the new reality, sensors will be anywhere
• A visual computing platform controlled by speech and gesture
Satya Nadella - “The emergence of
the next computing interface”

29. What is HoloLens?
HoloLens is the first, fully wireless holographic
computer that redefine personal computing and
empowers people in new ways.

34. Ambient
Light
Sensor
2MP Photo (2048x1152)/ HD Video Camera (1408x792)
Depth Camera
IR Camera based on Time-Of-Fly
Hands Tracking + Surface reconstruction + Object Position
4 Environment Understanding Camera
Gray Scale Cameras
Create Map of the Room

36. Hololens Device – Optics
IMU
Gyroscope + Magnetometer + Accelerometer
Fast Position Updates (<10ms )
2 HD 16:9 light engines
Project images on lenses
Holographic Resolution: 2.3M total light points
Holographic Density >2.5k radiants
(light points per radian)
Automatic pupillary distance calibration
See-through holographic lenses (waveguides)
R - G – B Layers

38. ●Memory: 64GB Flash / 2GB RAM
●Processor: Intel Atom x5-Z8100 1.04
GHz 64-bit
Intel Airmont (14nm) 4 Logical
●GPU: Intel 8086h, Dedicated Video
Memory 114 MB, Shared System Memory
980 MB
●Custom-built Microsoft Holographic
Processing Unit (HPU 1.0)
Battery: 16,500 mWh
Weight : 579g

40. Built-in speakers.
A precise audio experience without
headphones that is immersive, yet
won’t block out the real world.
Spatial sound.
Using a scientific model that
characterizes how the human ear
receives sound from a specific
location, Microsoft HoloLens
synthesizes sound so that you can
hear holograms from anywhere in
the room.

41. The Gesture frame

42. Bloom

43. Menu

44. Gaze

45. Air tap

46. A holographic app

47. ●Scroll
●Drag
●Zoom
●Pin, unpin, or uninstall an app
●Resize an app
●Move an app
Tap and hold

48. ●Select
●Place
●Face me
●Bigger/Smaller
●Hey Cortana, go to Start
●Hey Cortana, shut down
●Hey Cortana, move <app name> here
●Hey Cortana, take a picture
Voice commands

49. HoloLens clicker

50. Cortana on HoloLens

51. Cortana on HoloLens
• What can I say?
• Increase the volume
• Decrease the brightness
• Shut down
• Restart
• Go to sleep
• Mute
• Launch <app name>
• Move <app name> here
• Go to Start
• Take a picture
• Start/Stop recording
• Call <contact>
• What time is it?
• Show me the latest NBA
scores
• How much battery do I
have left?
• Tell me a joke

55. Collaborate and communicate
HoloLens enables colleagues from around the world to collaborate in the same
environment or with the same objects, interacting with one another and sharing the
experience as if they were together.

56. Data Overlay
Users can project overlays that display important associated information, helping them
gain a clearer understanding of the project or activity at hand

57. Holographic renderings of a product, building, or any other object, can placed, sized and
manipulated in a mix of real world and virtual environments.
3D modeling

58. Full holographic representations of objects and processes enable training to be far more
effective as users explore and interact in scenarios that look and respond as if they were
the real thing
Training

59. Go beyond what a 2D rendering can do by working in 3D.
Visualize your work

60. See holograms from your colleague’s prospective even if she’s on the other side of the
word.
Explore spaces and ideas

64. Thank you!

65. @Tinux80
@HoloLensDevelop
https://it.linkedin.com/in/clemente-giorio-03a61811
https://www.facebook.com/tinux
https://www.facebook.com/groups/winholographicdevs/
https://www.linkedin.com/groups/8243800 (HoloLens - Mixed Reality Developers Group)