Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Matteo Valoriani - How Augment your Reality: different perspective on the Reality-Virtuality Continuum - Codemotion Milan 2017

If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. Apple with ARkit, Google with ARCore , Microsoft with HoloLens, Facebook with Oculus and many others are working to transform our Reality with new products and services in the not-too-distant future. Therefore Apple, Microsoft, Google and Facebook is approaching AR/VR from different perspectives and in this session we will try to understand how these different technologies work and which best suits the different areas (industry 4.0, tourism, healthcare, ...)

Related Books

Free with a 30 day trial from Scribd

See all
  • Be the first to comment

  • Be the first to like this

Matteo Valoriani - How Augment your Reality: different perspective on the Reality-Virtuality Continuum - Codemotion Milan 2017

  1. 1. How Augment your Reality: Different perspective on the Reality / Virtuality Continuum Matteo Valoriani CODEMOTION MILAN - SPECIAL EDITION 10 – 11 NOVEMBER 2017
  2. 2. How Augment your Reality: Different perspective on the Reality / Virtuality Continuum
  3. 3. Nice to Meet You matteo.valoriani@fifthingenium.com Matteo Valoriani, PhD CEO of FifthIngenium mvaloriani at gmail.com @MatteoValoriani Slideshare: www.slideshare.net/MatteoValoriani Linkedin: https://it.linkedin.com/in/matteovaloriani Blog: http://fifthingenium.com/blog GitHub: https://github.com/mvaloriani
  4. 4. How we are arrived here Virtual Continuum VR • Outside-in vs Inside-out AR • Visual Inertial Odometry (VIO) • ARKit/ARCore • HoloLens Agenda
  5. 5. 2010 - 2017
  6. 6. 1968, Apollo Guidance Computer 2000 Transistor 4k Memory
  7. 7. CPU evolution (Transistors) 5M 160M 1B 7B / 2B on mobile 10B / 3.3B on mobile
  8. 8. 230  4.400  32.000  90.000 (1996) (2003) (2008) (2016)
  9. 9. https://www.youtube.com/watch?time_continue=257&v=z6 wvFg-c0Rs
  10. 10. RECAP
  11. 11. Virtual Reality
  12. 12. CAVE vs HMD (Head Mounted Display)
  13. 13. Mobile VR
  14. 14. Console VR
  15. 15. Desktop VR (Outside-in)
  16. 16. Pros • Accuracy (you can add more trackers around the room to increase accuracy) • Latency very low (reduce VR sickness). Cons • Setup • Occlusion • Limitation of the cameras (field of view)
  17. 17. Desktop VR (Inside-out)
  18. 18. • . Pros • Simplicity / No Setup • Less hardware needed (no external camera) • No limit of space (potentially) Cons • Reduced accuracy and latency • Only the object in front to the user can be tracked • Powerful hardware
  19. 19. VR addons
  20. 20. VR Scenarios and Limitations
  21. 21. Augmented Reality
  22. 22. Optical vs Video see - through
  23. 23. Visual Inertial Odometry (VIO)
  24. 24. Visual Inertial Odometry (VIO) 6dof in real time : • 3D of xyz motion (translation) • 3D of pitch/yaw/roll (rotation) Pose is tracked: • via the Camera system, by matching a point in the real world to a pixel on the camera sensor each frame. • by the Inertial system (accelerometer & gyroscope — Inertial Measurement Unit or IMU) The output of both of those systems are then combined via a Kalman Filter which determines which of the two systems is providing the best estimate of your “real” position.
  25. 25. b 𝑑 = 𝑥𝑙 − 𝑥 𝑟 𝑏+𝑥 𝑙 − 𝑥 𝑟 𝑍−𝑓 = 𝑏 𝑍 Z = 𝑏∗𝑓 𝑑 Depth Sensing (Multi camera)
  26. 26. Single Camera?
  27. 27. The secret here is to have *really* good IMU error removal: Dead-reckoning
  28. 28. • . TrueDepth Camera Face tracking. Scene Understanding Detection of horizontal planes (tables, floors, …) and tracking of object. Lighting Estimation Estimation of light available in a scene in order to apply the correct amount of lighting to virtual objects. Hardware and Rendering Optimizations Apple A9, A10, and A11 processors.
  29. 29. • . Motion tracking Estimates a phone’s relative location based on internal sensors and video footage Scene Understanding Uses the camera to detect flat surfaces Lighting Estimation Helps virtual props cast accurate shadows and otherwise fit in with their surroundings Anchoring objects
  30. 30. • . ARCore vs Tango Tango’s dedicated infrared depth- sensing camera to create detailed 3D meshes. ARCore has to estimate scale based on the camera feed, while Tango directly measures distance. Nikhil Chandhok (AR director of product): “ARCore is for all the apps that we think that users want”
  31. 31. HoloLens
  32. 32. What is HoloLens? HoloLens is the first, fully wireless holographic computer that redefine personal computing and empowers people in new ways.
  33. 33. How to use
  34. 34. DEMO
  35. 35. Hololens Hadware Blocks
  36. 36. Holographic Processing Unit v 1.0 TSMC-fabricated 28 nm co-processor. 24 Tensilica DSP cores (12 clusters) 65 million logic gates (used 50%) 8 MB of SRAM 1GB DRAM 1 Trillion Operation per second Sensor aggregator with gesture and environment processing 200x over software implementation Low Power (<10 Watts) 12 mm 12mm
  37. 37. AR Devices
  38. 38. Altri framework: Vuforia
  39. 39. • . I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched C-beams glitter in the dark near the Tannhäuser Gate. All those moments will be lost in time, like tears in rain. Time to die.
  40. 40. Developer Resources Preview Pricing Documentation Client SDKs Example Code Join Our Community Thank you!
  41. 41. Developer Resources Preview Pricing Documentation Client SDKs Example Code Join Our Community Thank you! How Augment your Reality Matteo Valoriani
  42. 42. https://medium.com/super-ventures-blog/how-is-arcore-better-than-arkit-5223e6b3e79d https://www.theverge.com/2017/8/29/16219696/google-arcore-augmented-reality-platform-announce-release-pixel- samsung https://www.youtube.com/watch?v=dNXBvDKRg1M https://www.marxentlabs.com/deep-dive-apple-arkit-game-changer-augmented-reality/ https://developer.apple.com/arkit/ https://developers.google.com/ar/discover/concepts https://kotaku.com/how-lara-croft-has-changed-over-the-last-16-years-1505856265 http://www.ign.com/articles/2016/07/11/23-perfectly-timed-pokemon-go-screenshots https://www.wareable.com/trending/trending-vr-add-ons-are-next-big-thing https://www.howtogeek.com/246333/oculus-rift-vs.-htc-vive-which-vr-headset-is-right-for-you/ https://www.slideshare.net/AugmentedWorldExpo/hiren-bhinde-qualcomm-ondevice-motion-tracking-for-immersive-vr references

×