Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
GlobalWindows Azure Bootcamp
Kinecting the Cloud
Nice to meet you
Tom Kerkhove
Kinect for Windows MVP
Integration Professional
hello@tomkerkhove.be
+32 473 701 073
@TomKer...
Agenda
• Hardware
• Feature overview
• Xbox &Windows
• Concepts
• Scenarios & Real-world cases
• Kinecting the Cloud
3
Disclaimer
➔ Kinect forWindows v2 is alpha hardware
➔ Not all features are available yet
This is preliminary software and/...
Hardware
Camera
6
Depth
7
Microphone array
8
Feature Overview
Supported systems
➔ Supported systems
➔ Windows 8+ (.Net 4.5 / Desktop only)
➔ Windows Embedded
➔ Not supported
➔ Micro Fr...
Tools
➔ Kinect Studio
➔ Record & play Kinect-data
➔ Comes in handy for development/testing
Feature Overview
Feature Overview
12
Camera
➔ Color camera
➔ RGBA
➔ GBRA
➔ YUV2
➔ 1920x1080 - 30/15 FPS
➔ Greenkeying
13
Feature Overview
Depth
➔ Active Infrared mechanism
➔ 500 mm – 4.500 mm
➔ 512x424 – 30 fps
➔ Ability to get distance of pixels based on the ...
Skeletal tracking
➔ Tracked skeleton means :
➔ Up to 25 tracked joints
➔ Fully tracks 6 skeletons
➔ Unique ID per skeleton...
Skeletal tracking
➔ Ability to perform hand tracking
➔ Tracking state
• Unknown
• NotTracked
• Open
• Closed
• Lasso
➔ Con...
Skeletal tracking
➔ Skeleton joints
➔ Tracked state
• Not tracked
• Inferred
• Tracked
➔ 3D position
➔ Joint orientation a...
Skeletal tracking
➔ Activities
➔ Eye left closed
➔ Eye right closed
➔ Mouth open
➔ Mouth moved
➔ Looking away
➔ More might...
Skeletal tracking
➔ Appearance
➔ Wearing glasses
➔ More might be added
➔ Expressions
➔ Happy
➔ Neutral
➔ More might be add...
Speech
➔ Tracks loudest audio input
➔ Automatic ambient noise filter
➔ Can track position by noise
➔ Audio beam will be st...
FaceTracking
➔ 87 tracked head points
➔ Not unique per user
➔ Not for authentication
21
Feature Overview
NOTE - Not availa...
Interaction
➔ Grip recognition up to 2 persons
➔ Interaction controls
➔ Push
➔ Grip
➔ Cursor
➔ Viewer
22
Feature Overview
...
Kinect Fusion
➔ 3D rendering of environment
23
Feature Overview
Highly requested
➔ Forces on muscles
➔ Skin color
➔ Heartbeat
24
Feature Overview
Kinect for Windows vs Xbox
25
Hardware NOTE - Not available for second generation yet
26
Kinect for Windows vs Xbox
Developers Perspective
➔ Kinect for Xbox API != Kinect forWindows API
27
Kinect for Windows vs Xbox
Kinect for Xbox360 functionality
28
Kinect for Windows vs Xbox
Concepts
30
Scenarios &
Real-World Cases
Real-World cases
➔ Family Eye
➔ Fall detection
➔ Burglar detection system
➔ Human tracking after configured time
➔ Kiosk
➔...
Burglar detection system
➔ Detects people in certain timewindow
➔ Render, save & host video as proof
➔ Notify owner of bre...
Kinect ApplicationTypes
➔ Visualize in 3D env
➔ 3D Processing
➔ Green keying
➔ Fun, fun, fun!
➔ Interaction
➔ Combination ...
Kinecting the Cloud
Kinecting the Cloud
44
Scale
Scale based on users
Plug-and-play
Plug-and-play applications
Data Protection
Store and secur...
Kinecting the Cloud
Demo - Codit Integration Cloud
45
Scenario
➔ MICVlaanderen has an exhibition
➔ Kinect tracks certain data of the attendees
➔ Time at booth
➔ Photo of person...
Global Picture
47
Codit Integration Cloud
Architecture
48
Codit Integration Cloud
Demo
49
50
GWAB - Kinecting the Cloud.
GWAB - Kinecting the Cloud.
GWAB - Kinecting the Cloud.
GWAB - Kinecting the Cloud.
GWAB - Kinecting the Cloud.
GWAB - Kinecting the Cloud.
Upcoming SlideShare
Loading in …5
×

GWAB - Kinecting the Cloud.

1,105 views

Published on

Published in: Technology
  • Be the first to comment

GWAB - Kinecting the Cloud.

  1. 1. GlobalWindows Azure Bootcamp Kinecting the Cloud
  2. 2. Nice to meet you Tom Kerkhove Kinect for Windows MVP Integration Professional hello@tomkerkhove.be +32 473 701 073 @TomKerkhove be.linkedin.com/in/tomkerkhove
  3. 3. Agenda • Hardware • Feature overview • Xbox &Windows • Concepts • Scenarios & Real-world cases • Kinecting the Cloud 3
  4. 4. Disclaimer ➔ Kinect forWindows v2 is alpha hardware ➔ Not all features are available yet This is preliminary software and/or hardware and APIs are preliminary and subject to change
  5. 5. Hardware
  6. 6. Camera 6
  7. 7. Depth 7
  8. 8. Microphone array 8
  9. 9. Feature Overview
  10. 10. Supported systems ➔ Supported systems ➔ Windows 8+ (.Net 4.5 / Desktop only) ➔ Windows Embedded ➔ Not supported ➔ Micro Framework ➔ VM supported ➔ Four sensors on one machine (First gen.) Feature overview
  11. 11. Tools ➔ Kinect Studio ➔ Record & play Kinect-data ➔ Comes in handy for development/testing Feature Overview
  12. 12. Feature Overview 12
  13. 13. Camera ➔ Color camera ➔ RGBA ➔ GBRA ➔ YUV2 ➔ 1920x1080 - 30/15 FPS ➔ Greenkeying 13 Feature Overview
  14. 14. Depth ➔ Active Infrared mechanism ➔ 500 mm – 4.500 mm ➔ 512x424 – 30 fps ➔ Ability to get distance of pixels based on the sensor & gives player index 14 Feature Overview
  15. 15. Skeletal tracking ➔ Tracked skeleton means : ➔ Up to 25 tracked joints ➔ Fully tracks 6 skeletons ➔ Unique ID per skeleton ➔ Positions are in three dimensional world based on the sensor 15 Feature Overview
  16. 16. Skeletal tracking ➔ Ability to perform hand tracking ➔ Tracking state • Unknown • NotTracked • Open • Closed • Lasso ➔ Confidence • High • Low 16 Feature Overview
  17. 17. Skeletal tracking ➔ Skeleton joints ➔ Tracked state • Not tracked • Inferred • Tracked ➔ 3D position ➔ Joint orientation as a quaternion 17 Feature Overview
  18. 18. Skeletal tracking ➔ Activities ➔ Eye left closed ➔ Eye right closed ➔ Mouth open ➔ Mouth moved ➔ Looking away ➔ More might be added ➔ Leaning 18 Feature Overview NOTE - Not available yet
  19. 19. Skeletal tracking ➔ Appearance ➔ Wearing glasses ➔ More might be added ➔ Expressions ➔ Happy ➔ Neutral ➔ More might be added ➔ Engaged 19 Feature Overview NOTE - Not available yet
  20. 20. Speech ➔ Tracks loudest audio input ➔ Automatic ambient noise filter ➔ Can track position by noise ➔ Audio beam will be steerable in second generation ➔ Manually shift focus of cone 20 Feature Overview NOTE - Not available for second generation yet
  21. 21. FaceTracking ➔ 87 tracked head points ➔ Not unique per user ➔ Not for authentication 21 Feature Overview NOTE - Not available for second generation yet
  22. 22. Interaction ➔ Grip recognition up to 2 persons ➔ Interaction controls ➔ Push ➔ Grip ➔ Cursor ➔ Viewer 22 Feature Overview NOTE - Not available for second generation yet
  23. 23. Kinect Fusion ➔ 3D rendering of environment 23 Feature Overview
  24. 24. Highly requested ➔ Forces on muscles ➔ Skin color ➔ Heartbeat 24 Feature Overview
  25. 25. Kinect for Windows vs Xbox 25
  26. 26. Hardware NOTE - Not available for second generation yet 26 Kinect for Windows vs Xbox
  27. 27. Developers Perspective ➔ Kinect for Xbox API != Kinect forWindows API 27 Kinect for Windows vs Xbox
  28. 28. Kinect for Xbox360 functionality 28 Kinect for Windows vs Xbox
  29. 29. Concepts
  30. 30. 30
  31. 31. Scenarios & Real-World Cases
  32. 32. Real-World cases ➔ Family Eye ➔ Fall detection ➔ Burglar detection system ➔ Human tracking after configured time ➔ Kiosk ➔ Browse the articles of a shop and try them on Scenarios & Real-World Cases
  33. 33. Burglar detection system ➔ Detects people in certain timewindow ➔ Render, save & host video as proof ➔ Notify owner of breach ➔ Enable / Disable monitoring remotely 39 Scenarios & Real-World Cases
  34. 34. Kinect ApplicationTypes ➔ Visualize in 3D env ➔ 3D Processing ➔ Green keying ➔ Fun, fun, fun! ➔ Interaction ➔ Combination with other hardware 41 Scenarios & Real-World Cases ➔ Image Processing ➔ Video Rendering ➔ Content Delivery ➔ Depth Analytics ➔ 3D Processing ➔ Image storage ➔ Data farming ➔ Body tracked/trigger Kinect-based Big Picture
  35. 35. Kinecting the Cloud
  36. 36. Kinecting the Cloud 44 Scale Scale based on users Plug-and-play Plug-and-play applications Data Protection Store and secure data Compute Heavy data processing
  37. 37. Kinecting the Cloud Demo - Codit Integration Cloud 45
  38. 38. Scenario ➔ MICVlaanderen has an exhibition ➔ Kinect tracks certain data of the attendees ➔ Time at booth ➔ Photo of person ➔ Attendee can ask question by raising hand ➔ Local vendor receives notification if person has question or left the booth 46 Codit Integration Cloud
  39. 39. Global Picture 47 Codit Integration Cloud
  40. 40. Architecture 48 Codit Integration Cloud
  41. 41. Demo 49
  42. 42. 50

×