Master RIAtec 2013 - Bloque 1

1,737 views

Published on

Presentations used in the 2013 version for the RIAtec master session

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,737
On SlideShare
0
From Embeds
0
Number of Embeds
990
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Master RIAtec 2013 - Bloque 1

  1. 1. Bruno Capuano Innovation Manager @elbrunohttp://www.elbruno.co m
  2. 2. I also work here I live / work here I was born here
  3. 3. IR Emitter Color Sensor IR Depth Sensor Tilt Motor Microphone Array
  4. 4. • http://kinectforwindows.org
  5. 5. DEMO
  6. 6. DEMO
  7. 7. DEMO
  8. 8. D D D D D D D D D D D D D P P P15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
  9. 9. Feet 1.3’ 2.6’ 9.8’ 13.1’ 26.2’Meters .4 .8 3 4 8Default Mode Near Mode Unknown Normal
  10. 10. Feet 1.3’ 2.6’ 9.8’ 13.1’ 26.2’Meters .4 .8 3 4 8Default Mode Near Mode Unknown Too Near Normal Too Far
  11. 11. short[] allData = new short[depthFrame.PixelDataLength];Get depth for a point (X:160, Y:120, Width: 320)int index = (width * y) + x; // 38,560int // 200int //15short depthPoint = allData[index];int depth = depthPoint >> DepthImageFrame.PlayerIndexBitmaskWidth; // 2,000int player = depthPoint & DepthImageFrame.PlayerIndexBitmask; // 1
  12. 12. WORKING WITH DEPTH DATA DEMO
  13. 13. Max of two skeletons per Kinect6 Player Proposals
  14. 14. Joints in meters from camera Positive Positive Negative Negative
  15. 15. • Each joint has associated tracking state • Tracked, Not tracked, or Inferred • Inferred - Occluded, clipped, or low confidence joints • Use TransformSmoothParameters to smooth joint data to reduce jitterSkeleton.ClippedEdges = FrameEdges.Top; http://en.wikipedia.org/wiki/Holt-Winters
  16. 16. Fatigue Kills Use Coding4Fun ScaleTo Gestures extension method
  17. 17. DEMO
  18. 18. -50 0 +50
  19. 19. <!-- Confirmation_Yes._value: string ["Yes"]--><rule id="Confirmation_Yes" scope="public"> <example> yes </example> var grammar = new Choices(); <example> yes please </example> grammar.Add(“yes please"); <one-of> <item> yes </item> grammar.Add(“yes"); <item> yeah </item> grammar.Add(“yeah"); <item> yep </item> grammar.Add(“ok"); <item> ok </item> </one-of> <item repeat="0-1"> please </item> <tag> out._value = "Yes";</tag>
  20. 20. Engagement modelMic indicator for speech-enabled menusKeyword to engageFeedback and confirmation
  21. 21. DEMO
  22. 22. • Real-time tracking of multiple faces• 2D Mesh and Points• 3D Head Pose• Animation Units
  23. 23. • 100 2D Points • 87 in picture • 13 additional for center of eye, corners of mouth, center of nose, head bounding box
  24. 24. Neutral • Six Animation Units • Uses Candide3 model Jaw LowererLip Corner Depressor
  25. 25. DEMO
  26. 26. What we want to do with Kinect forWindows• Provide common Kinect UI interactions to developers so that they can easily build Kinect apps• Solve the most common app tasks and UI requirements • E.g., engagement, targeting and selection, X/Y navigation• Ensure that K4W interactions and controls are intuitive and delightful for end users• Advance the capabilities of Kinect • Show progression!
  27. 27. Kinect interactionsKinect for Windows Prototype controls DEMO

×