Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Introduction to Google Project Tango and Intel® RealSense™
Similar to Introduction to Google Project Tango and Intel® RealSense™ (20)
Recently uploaded
Recently uploaded (20)
Introduction to Google Project Tango and Intel® RealSense™
- 1. Introduction to Google Project Tango and Intel® RealSense™ Technologies and Usages Francesca Tosi Intel Software Innovator 1
- 2. #droidconIT About me Francesca Tosi • Intel Software Innovator • Freelance Developer • GDG-Firenze/Ancona Manager @francescatosi francesca@jooink.com 2
- 4. #droidconIT Computer Vision Computer Vision on Android - OpenCV C/C++ lib http://opencv.org - BoofCV pure Java lib http://boofcv.org 4
- 5. #droidconIT Computer Vision Computer Vision - Face recognition - Object tracking - Space & lines detection 5
- 9. #droidconIT Project Tango & Intel RealSense 3D World 9
- 10. #droidconIT Intel RealSense ZR300 Details 10 Video here: https://youtu.be/8ceDOk0qJbM
- 11. #droidconIT Intel RealSense ZR300 11 RealSense R200 Fisheye camera
- 13. #droidconIT Google Project Tango • Motion Tracking • Area Learning • Depth Perception RealSense solution Fisheye camera 13
- 14. #droidconIT Google Project Tango Motion Tracking Gives the relative position and orientation of the device 14
- 15. #droidconIT Google Project Tango Motion Tracking how it works in practice —> EXPLORER 15
- 16. #droidconIT Google Project Tango Area Learning Gives the absolute position and orientation in pre-registered environments 16
- 17. #droidconIT Google Project Tango Area Learning Gives the absolute position and orientation in pre-registered environments 17
- 18. #droidconIT Google Project Tango Depth Perception Gives the distance of all the elements in front of the camera 18
- 19. #droidconIT Google Project Tango Depth Perception how it works in practice —> Constructor 19
- 20. #droidconIT Google Project Tango - SDK Tango SDK developers.google.com 20
- 21. #droidconIT Tango Cube Stacker & Tango Blaster Demos – Tango 21
- 23. #droidconIT 23 RealSense Cameras - 2015 devkits available today products User-facing (F200) Rear-facing (R200)
- 24. World Facing Intel® RealSense™ SDK Modules Scene Perception Enhanced Photography Augmented Reality Person & Face Tracking Gesture Recognition Background Removal Object Recognition and Tracking Speech Recognition 3D Object Scanning Hand & Blob Tracking User Facing 24
- 25. #droidconIT Intel® RealSense™ SDK Architecture (Windows-only atm) * Your Application HERE - C++ 25
- 26. #droidconIT Intel® RealSense™ SDK - C++ 26 Technical Specification • Required OS •Microsoft Windows* 8.1 or 10 OS 64-bit •Support for Android* Coming Soon** • Supported Intel® RealSense™ Cameras •SR300 – Front-facing •R200 – Rear-facing • Supported Languages •C++, JavaScript* •C# (Microsoft .NET* 4.0 Framework is required) •Java* (JDK 1.7.0_11 or later) •Processing* 2.1.2 or later • IDE used for Samples and Tutorials •Background Segmentation •3D Object / Face / Room Scanning •2D/3D Object Tracking • Supported browsers for JavaScript* development •Microsoft Internet Explorer* 10.0.13 •Google Chrome* 33.0.1750.146 •Mozilla Firefox* 27.0.1
- 27. #droidconIT Intel® RealSense™ Driver for Linux & OS X - C++ 27 Librealsense • Features •Multi-camera capture: librealsense can be used with all 3 camera models (F200, SR300, and R200) and can provide multi-camera capture with either single or multiple models simultaneously. •Native streams: depth, color, infrared •Synthetic streams: rectified images, depth aligned to color and vice versa, etc. •Intrinsic/extrinsic calibration information •Most of the hardware-specific functionality (UVC XU controls) • Supported OS •Ubuntu 14.04.03 x64 with an updated 4.4 kernel with GCC 4.9 (Other distros may require a patched uvcvideo driver) •OS X 10.8. with Clang toolchain •Windows 8.1 with Visual Studio 2013 Update 5 • https://github.com/IntelRealSense/
- 28. #DroidconIT User Facing Technologies Capabilities Features • Finger Tracking • Gesture Recognition •22-point Hand and Finger Tracking •Poses and Dynamic Gestures • Face Tracking • Face Recognition •Multiple Face Detection and tracking •78-point Face Landmarks •Facial Expressions •Face Recognition •Pulse Estimator • Speech Recognition • Voice Synthesis •Command and Control •Dictation •Text to Speech • Segmentation • 3D Scanning • Augmented Reality •Background Segmentation •3D Object / Face / Room Scanning •2D/3D Object Tracking
- 29. #DroidconIT User Facing Technologies Capabilities Features • Finger Tracking • Gesture Recognition •22-point Hand and Finger Tracking •Poses and Dynamic Gestures Video here: https://youtu.be/r42z259-HHE?t=177
- 30. #DroidconIT User Facing Technologies Capabilities Features • Facial Analysis Capabilities Features • Identify the presence of faces in the camera’s range • 78 landmarks points • 3D face detection
- 31. #DroidconIT Facial Analysis Video here: https://youtu.be/r42z259-HHE?t=89
- 32. #droidconIT User Segmentation / Background Subtraction 32
- 33. #DroidconIT Background Removal Video here: https://youtu.be/HSr_Cw1dlO8
- 34. #droidconIT Opentrack and IRFaceRig Demos – head and F200 34
- 37. #droidconIT Demos – hands and F200 Hands Viewer, Longbow, Hoplites 37
- 41. Placeholder Footer Copy / BU Logo or Name Goes Here 41 Video here: https://youtu.be/btwU_pT-tao
- 42. #droidconIT Demos – ZR300 42 Hands Viewer, Longbow, Hoplites
- 44. #DroidconIT • Artistic Filters • Depth layers • Segmentation (Object/Human) • Refocus • Measurements • Euclidian Distance • Surface / Area measurements • Motion Effects • Point of View Shift • Parallax • Dolly Zoom • Editing Effects • 2D/3D object insertion • Stickers Enhanced Photography
- 45. #DroidconIT Person Tracking - Person Detection - Detect all people within the scene - Track the same person throughout the session - Person segmentation - Rough segmentation - Remove, fully/partially replace person in the frame - Body parts detection - Detect body parts and add virtual accessories in the frame - Four points tracking - Track head, hands and center of mass - Person Recognition - Identify specific people