Download to read offline
BA_Kinect1.7SDK
- 1. Kinect SDK 1.7 FACETRACKING INTERACTIONS FUSION Presented by Reuben Ahmed (Bennett Adelson)
- 2. Disclaimer Smelly codemay be shown Purpose Kinect 1.7 SDK overview 200-level WPF/C# examples
- 3. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 4.
- 5. Hardware Overview ColorStream DepthStream SkeletonStream
- 6. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 7. System Requirements Software Visual Studio 2010/2012 Windows 7/8 Kinect 1.7 SDK and 1.7 Toolkit (600MB total) Hardware Kinect for Windows ($230) 2.66-3ghz Dual Core Kinect Fusion DirectX 11 Capable GPU GTX560/AMD 6950 and higher
- 8. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 9.
- 10. Face Tracking References Microsoft.Kinect Microsoft.Kinect.Toolkit.FaceTracking Candide-3 model – “A parameterized face” 100 polygons
- 11. Face Tracking –Candide-3 Refactor “Parameterized Face” – 100 Polygons
- 12.
- 13.
- 14. Face Tracking –DEMO Refactor Animation Units (AU) are “wrappers” to give general idea (-1 to 1) Facial Expression recognition Control objects with tracked vector movements DEMO: Polygon overlay (Toolkit) DEMO: Awesome Face
- 15. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 16. Kinect Interactions ModifiedActivate Gesture Hover – Out of date Open vs. Closed Hand Push for selection Grip and Move with momentum Simultaneous recognition of 4 hands
- 17. Kinect Interactions KinectSensorUI KinectRegion Add KinectInteractionexperiences to an app KinectUserViewer Shows an image of the user (depth stream) KinectTileButton, KinectCircleButton, KinectScrollViewer
- 18. Kinect Interactions Kinectifying CustomControl Checkbox
- 19.
- 20.
- 21. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 22.
- 23. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 24. Future Kinect 1.8SDK September 2013 K4W Desktop Apps using HTML5/JS Kinect 2.0 November 2013 SDK 2014 Hardware
- 25. Future Ultra-wide 1080pRGB Camera Fully track 6 people
- 26. Future Rotation betweenjoints Forces on muscles
- 27. Future Extended JointModel (Thumbs)
- 28. Future Expressions+ OpenEyes, Smiling, Glasses, Blinks
- 29.
- 30. Agenda Hardware Overview System Requirements Face Tracking Kinect Interactions Kinect Fusion Future Q&A
- 31. Q & A Credits/Resources http://www.icg.isy.liu.se/candide/ main.html
- 32. TODO Reorganize Demos/Folders Demos Face Tracking Toolkit AwesomeFace Interactions Push Grip Console App Interactions Paint Interaction Demo Solitaire Demo Note Mouse Up/Mouse Down issue Fusion Demo Toolkit Demo STL file Solid Works eDrawing Download and show Augmented Reality Video: http://www.kurzweilai.net/kinect-brain-scans-augmented-reality-for-neurosurgeons 3D Printing of STL Fusion Slides Re-read articles for talking points Rehearse
Editor's Notes
- #2 Subject: Fun new features to code with your Kinect for Windows sensor (SDK 1.7 overview) Description: Let’s discover what can be done with the latest Kinect SDK. Kinect Fusion and Kinect Interactions have been added. Kinect Fusion allows the Kinect for Windows sensor to scan 3D objects and environments, then model them on a PC. Kinect Interactions allow developers to create interactive applications with a new, well-designed and ergonomically friendlier interaction language than before. Join us while we walk through demonstrations of the new feature set! Knowledge of the Kinect sensor’s hardware for this presentation (depth camera via IR emitter, RGB camera, microphone array, etc.) is preferred, but not essential. Understanding and coding towards those lower level topics will not be covered during this presentation.
- #17 Press for Selection. This provides, along with the new KinectInteraction Controls, improved selection capability and faster interactions. If you’re familiar with previous Kinect for Windows interaction capabilities, this replaces the hover select concept. Grip and Move for Scrolling. This provides, along with the new KinectInteraction Controls, 1-to-1 manipulation for more precise scrolling, as well as large fast scrolls with a fling motion. If you’re familiar with previous Kinect for Windows interaction capabilities, this replaces the hover scroll model.
- #18 SAMPLE: http://dotneteers.net/blogs/vbandi/archive/2013/03/25/kinect-interactions-with-wpf-part-i-getting-started.aspx Interaction stream outside of WPF (console): http://blogs.msdn.com/b/k4wdev/archive/2013/05/01/using-kinect-interactionstream-outside-of-wpf.aspx Kinect Slider: http://blogs.msdn.com/b/k4wdev/archive/2013/06/20/using-kinect-interactions-to-create-a-slider-control.aspx Controls: http://www.soulsolutions.com.au/Blog/tabid/73/EntryId/851/Kinect-For-Windows-Interactions-Gallery.aspx KinectRegion, KinectUserViewer, KinectTileButton, KinectcircleButton, KinectScrollViewer, InteractionStream
- #19 SAMPLE: http://dotneteers.net/blogs/vbandi/archive/2013/03/25/kinect-interactions-with-wpf-part-i-getting-started.aspx Interaction stream outside of WPF (console): http://blogs.msdn.com/b/k4wdev/archive/2013/05/01/using-kinect-interactionstream-outside-of-wpf.aspx Kinect Slider: http://blogs.msdn.com/b/k4wdev/archive/2013/06/20/using-kinect-interactions-to-create-a-slider-control.aspx Controls: http://www.soulsolutions.com.au/Blog/tabid/73/EntryId/851/Kinect-For-Windows-Interactions-Gallery.aspx KinectRegion, KinectUserViewer, KinectTileButton, KinectcircleButton, KinectScrollViewer, InteractionStream
- #20 SAMPLE: http://dotneteers.net/blogs/vbandi/archive/2013/03/25/kinect-interactions-with-wpf-part-i-getting-started.aspx Interaction stream outside of WPF (console): http://blogs.msdn.com/b/k4wdev/archive/2013/05/01/using-kinect-interactionstream-outside-of-wpf.aspx Kinect Slider: http://blogs.msdn.com/b/k4wdev/archive/2013/06/20/using-kinect-interactions-to-create-a-slider-control.aspx Controls: http://www.soulsolutions.com.au/Blog/tabid/73/EntryId/851/Kinect-For-Windows-Interactions-Gallery.aspx KinectRegion, KinectUserViewer, KinectTileButton, KinectcircleButton, KinectScrollViewer, InteractionStream
- #21 SAMPLE: http://dotneteers.net/blogs/vbandi/archive/2013/03/25/kinect-interactions-with-wpf-part-i-getting-started.aspx Interaction stream outside of WPF (console): http://blogs.msdn.com/b/k4wdev/archive/2013/05/01/using-kinect-interactionstream-outside-of-wpf.aspx Kinect Slider: http://blogs.msdn.com/b/k4wdev/archive/2013/06/20/using-kinect-interactions-to-create-a-slider-control.aspx Controls: http://www.soulsolutions.com.au/Blog/tabid/73/EntryId/851/Kinect-For-Windows-Interactions-Gallery.aspx KinectRegion, KinectUserViewer, KinectTileButton, KinectcircleButton, KinectScrollViewer, InteractionStream
- #25 http://www.kinectingforwindows.com/ Develop Kinect for Windows Desktop applications using Html5/Javascript Ultra-wide 1080p RGB Camera Fully track 6 persons Extended Joint Model (thumbs) Extended Depth Additoinal Tracking (Rotation between joints, Forces on muscles, skin color, Expressions (open eyes, smiling, etc),
- #27 Rotation between joints, Forces on muscles
- #29 Expressions (open eyes, smiling, glasses, eye blinks)