To create an immersive experience both, AR and VR, require a natural and easy way of control and interaction. Todays devices are either fairly passiv (like the Cardboard or Glyph) or require an additional controler hardware (like the HTC Vive). Even if these controllers work really well, they remain bulky, require abstract interaction and power. --- The easier solution to AR and VR control would be using our hands: always available and always on. Plus, to create a truely immersive experience we need to see our hands and fingers in the virtual scene. Moritz is going to elaborate on the opportunities to create the most natural user interaction in AR and VR.

1. A NATURALUSERINTERFACE
IN EVERYCAR,HOME,EVERYPERSONALDEVICE

2. Virtual-/Augemented- and MixedReality
require hand based natural interaction.
… everyoneknows!

5. In Augmented Reality you
need your hands even more.

6. You can usecontrollers.
And they are not bad.

10. But arecontrollers
NATURAL?
ALWAYSON?
EVERYWHEREAVAILABLE?

11. gestigon puts your hands into AR,VRand MR.
5 years of relevant experience.28 software engineers.
Keylearnings.

12. 3D depth sensors provide the data.

13. Avatar
How do you visualize the hand?
vs RGB-cut-out vs truehand & skin customization

14. Latency.
Matters.
Most.

15. How did we solve it?

16. HAND DETECTIONAND SKELETONTRACKINGISGREAT.

17. FINGERTIPDETECTIONISFASTER AND SUFFICIENT

18. > 35 DIFFERENTDEPTHSENSORSINTEGRATED
any technology, any chipset,any supplier

19. CAMBOARDPICOFLEXX(TOF Sensor)
• Direct measurement of depth in every pixel for highest
accuracy
• Monocular system architecture with no requirement for mechanical
baseline
• Easyonce-in-a-lifetime calibration and no need for recalibration
• Ready for AR,VRand 3D scanning - only depth sensing technology which
is integrated into mobile devices (Lenovo Phab2 Pro)

20. INUITIVEVERONICA
REFERENCEDESIGN
 Veronica is the Inuitive‘ reference design for
AR/VR
 Enhanced IRstereo depthsensor
 NU3000 Multicoreprocessors
 Additional vision processors by CEVA
 gestigon and Inuitive cooperate to provide
gesture control and hand visualisation solutions
forAR/VR

21. FOCUSON EMBEDDEDSYSTE MS
Example - A R M Cortex M4
• ARM Cortex M4 based processor
(STM32F429NIH6 microcontroller)
• 180MHz
• 2 GB Micro5Dcard
• 8MB RAM
-+ Fingertiptracking runs at 1oof ps

22. MOVIDIUSVISIONPROCESSING
PLATFORM‚MYRIAD2‘
 Movidius is the leader in platforms for
embedded visualintelligence
 Ultra low power,high performance
 Programmable achitecture
 Small size / footprint
 gestigon integrated it‘s gesture tracking
solutions on the Myriad 2 platform with a
focus on AR/VRusecases

23. DIN ISO9001 (certified 06/16)
2016:A-SPICELevel2
2017:A-SPICELevel3

24. It simplyworks.

25. You don‘t need more than this..

26. Components you need.
gestigon. CARNIVALAR/VRInteractionSuite.

27. POKEMONGOon a Cardboard in Mixed Reality

28. PRODUCTION PROCESSPLANNING
Using gestigon‘ VRtools for digital planning of production lines

29. VR IS ARRIVING INTHE MARKET
Obama and Merkel at HannoverMesse 2016
using gestigon‘ SDK& cardboarddesign

30. www.gestigon.com
Moritz von Grotthuss,CEO
moritz@gestigon.com
Tel.+49-176-10216788