Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018
•
0 likes•140 views
If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. ARkit, ARCore, HoloLens, Magic Leap, Oculus and many others are working to transform our Reality with new products and services. Apple, Microsoft, Intel, Google and Facebook are approaching AR/VR from different perspectives and technologies: in this session we will try to understand how these different technologies can work together and create a shared multi device experience.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018
Similar to Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018 (20)
More from Codemotion
More from Codemotion (20)
Recently uploaded
Recently uploaded (20)
Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018
- 1. Immerge yourself in a new Reality Alessandro Pozone – Matteo Valoriani CODEMOTION ROMA 2018
- 2. Nice to Meet You Alessandro Pozone Xamarin Certified Developer @_poz1 Linkedin: https://it.linkedin.com/in/alessandropozone Blog: http://poz1.com GitHub: https://github.com/poz1
- 3. Nice to Meet You matteo.valoriani@fifthingenium.com Matteo Valoriani, PhD CEO of FifthIngenium mvaloriani at gmail.com @MatteoValoriani Slideshare: www.slideshare.net/MatteoValoriani Linkedin: https://it.linkedin.com/in/matteovaloriani Blog: http://fifthingenium.com/blog GitHub: https://github.com/mvaloriani
- 6. Virtual Continuum VR/AR • Visual Inertial Odometry (VIO) • ARKit/ARCore • HoloLens Shared Development • Sharing code • Sharing information • Demo Conclusion Agenda
- 8. 1969, Apollo Guidance Computer 2000 Transistor 4k Memory
- 9. CPU evolution (Transistors) 5M 160M 1B 7B / 2B on mobile 10B / 3.3B on mobile
- 10. 230 4.400 32.000 90.000 (1996) (2003) (2008) (2016)
- 11. RECAP
- 13. Virtual Reality
- 14. Mobile VR
- 15. Console VR
- 19. • .
- 22. Optical vs Video see - through
- 23. Visual Inertial Odometry (VIO)
- 24. Visual Inertial Odometry (VIO) 6dof in real time : • 3D of xyz motion (translation) • 3D of pitch/yaw/roll (rotation) Pose is tracked: • via the Camera system, by matching a point in the real world to a pixel on the camera sensor each frame. • by the Inertial system (accelerometer & gyroscope — Inertial Measurement Unit or IMU) The output of both of those systems are then combined via a Kalman Filter which determines which of the two systems is providing the best estimate of your “real” position.
- 25. b 𝑑 = 𝑥𝑙 − 𝑥 𝑟 𝑏+𝑥 𝑙 − 𝑥 𝑟 𝑍−𝑓 = 𝑏 𝑍 Z = 𝑏∗𝑓 𝑑 Depth Sensing (Multi camera)
- 26. Single Camera?
- 27. The secret here is to have *really* good IMU error removal: Dead-reckoning
- 29. • . TrueDepth Camera Face tracking. Scene Understanding Detection of horizontal planes (tables, floors, …) and tracking of object. Lighting Estimation Estimation of light available in a scene in order to apply the correct amount of lighting to virtual objects. Hardware and Rendering Optimizations Apple A9, A10, and A11 processors.
- 32. • . Motion tracking Estimates a phone’s relative location based on internal sensors and video footage Scene Understanding Uses the camera to detect flat surfaces Lighting Estimation Helps virtual props cast accurate shadows and otherwise fit in with their surroundings Anchoring objects
- 34. HoloLens
- 36. What is HoloLens? HoloLens is the first, fully wireless holographic computer that redefine personal computing and empowers people in new ways.
- 38. Sharing Code
- 39. Cross Platform HoloLens Support WYSIWYG Editor Quick Interaction Times Powerful Asset Pipeline Easy to lean API’s Programming Language: C# Wrapper and dlls support: C++ UNITY3D
- 40. Cross Platform HoloLens Support Integrated with Xamarin Quick Interaction Times Easy to lean API’s Simple 3D rendering Programming Language: C# XAMARIN+URHOSHARP
- 41. URHOSHARP
- 42. Urho (Finnish for “hero” or “brave fighter”) was a legendary, tyrannical king among the fish. He always hunted without mercy. Sadly, he passed away on 6th November 2009. This engine was originally called Bofh3D (hinting at the covert goal of reimplementing the game BOFH: Servers under Siege in 3D) but was renamed to Urho3D in his honor. URHO3D For more of Urho’s legend, see also the music project http://www.mikseri.net/Urho/
- 44. UWP SHARED PROJECT UWP App
- 46. • A Scene is the root of a game ‘world’ and is rendered into a Viewport by a Camera • A Scene contains a hierarchy of Nodes • A Node has an identifier and a translation in 3D-space • A Node may contain child Nodes • Node type include Light and Camera • Trasform applied to Node and children SCENE TREE
- 47. • A Node can contain Components which add behaviour • StaticModel – allows the the node to be rendered • RigidBody – allows the node to participate in physics • SoundSource – allows the node to emit audio • Light – allows the node to emit light • Actions can also be attached to a Node, allowing declarative specification of behaviour SCENE TREE (2)
- 48. static void Main() => CoreApplication.Run( new UrhoAppViewSource<GhostAttack>( new ApplicationOptions("Data"))); public partial class GhostAttack { shared code } public partial class GhostAttack : StereoApplication { specific platfom code for XR} public partial class GhostAttack: Application { specific platfom code for Mobile} URHO APPLICATION
- 49. CODE
- 50. COMUNICATION
- 51. HANDSHAKE
- 52. CODE
- 53. • . I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched C-beams glitter in the dark near the Tannhäuser Gate. All those moments will be lost in time, like tears in rain. Time to die.
- 54. Developer Resources Preview Pricing Documentation Client SDKs Example Code Join Our Community Thank you!
- 61. Developer Resources Preview Pricing Documentation Client SDKs Example Code Join Our Community Thank you!