DIY motion capture with KinectToPin


Published on

Slides from the 12/4 Volumetric Society presentation at Pratt

Published in: Technology
  • @FakeGreenDress Ahhhhh! Thank you so much for that. That mustve been my problem in my search:D
    Are you sure you want to  Yes  No
    Your message goes here
  • @adamansorge Microsoft doesn't want you to buy them, but they work just fine. :-)

    You weren't finding them because what you're looking for is usually listed as an AC adapter -- they're designed so you can use the Kinect that comes bundled with the slimmer newer Xbox with an older Xbox. But it also works for connecting to a PC!

    Here's one:
    Are you sure you want to  Yes  No
    Your message goes here
  • I tried looking for an adapter either cheap or expensive. Can you direct us all to one of the said adapters that turn the XBOX Kinect into one that can plug into a PC? I couldn't find one by description and I called in to request one and the tech said it wasn't possible. There's a PC Kinect for that they said:/
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Why DIY MoCap?Motion capture is now cheap and accessibleNo longer need a giant studioIt’s FAST.Ideal use cases: short-turnaround animation, rapid prototyping etc.
  • Microsoft SDK vs. OpenNI
  • Can add multiple motion tracks and duplicate nullsPin names need to match control nulls
  • 2D vs. 3D: Avoiding the “Uncanny Valley”Awesome glitches
  • DIY motion capture with KinectToPin

    1. 1. DIY Motion Capture 12/5 Volumetric Society of NYC
    2. 2. How does the Kinect work? Photo by y3rdua
    3. 3. Getting Started: HardwareYou will need:• A Kinect, or generic equivalent such as the Asus Xtion• USB adapter cable, if you have a Kinect that was bundled with the Xbox (don’t buy the Microsoft adapter, the cheap ones work fine)• Enough space to perform
    4. 4. Getting Started: SoftwareOpenNI driver
    5. 5. KinectToPinKinect Motion Capture for After Effects
    6. 6. What is KinectToPin? + A standalone motion A UI panel for After Effects capture application
    7. 7. What can you do with it?
    8. 8. Rig 2D character models in 3D
    9. 9. Setting up your space to record 6 – 10 feet
    10. 10. Capturing• Record 15-point 3D skeletal tracking data• Capture in sync to dialogue• Remote control with a standard presentation remote• Open source and cross-platform: runs on OpenNI, built in Processing, also works with generic sensors like the Asus Xtion
    11. 11. Acting for Kinect• The Kinect can’t record what it can’t see. • Keep your entire body in the camera’s range • Face the camera when capturing • Watch out for occluded joints (sitting down, putting your hands behind your back etc. can cause it to lose the track)• It’s surprisingly good at picking up subtle posture shifts, but not smaller motions like laughter.• Use a different performer for each character if possible
    12. 12. Importing tracking dataNative import or copy & paste
    13. 13. Getting data into After EffectsData format options:• 3D Point Controls (CS5.5+)• 2D Point Controls (CS4+)• Puppet pins• Raw XML and JSON
    14. 14. UI Panel• Create character templates• 2D and 3D setups• Native XML import (SLOW)• Automatically add expressions to smooth tracking data• Automate rigging
    15. 15. Building a CharacterRigging with the UI panel
    16. 16. The Puppet ToolTHREE OR MORE PINS ON ONE LAYER: TWO PINS EACH, MULTIPLE LAYERS:Elbows don’t bend this way. Ow. Rotation with stretch and squash!
    17. 17. AE Puppet best practices• Work BIG. Start high-res, scale down in the puppet comp, then scale back up in the project comp (enable Collapse Transformations).• Precompose if you’re using vectors or shape layers• Keep multiple angles of the same character in sync High-res Start big. Character Layers Project Comp End big. Rigging Template
    18. 18. Retargeting for arbitrary charactershapes
    19. 19. Quick auto-lip sync1. Convert audio amplitude to keyframes2. Connect to mouth animation3. Size the audio data to fit. Use this expression: linear(source,sourceMin,sourceMax,targetMin,targetMax)
    20. 20. Beyond After EffectsMotion capture for live production
    21. 21. One last thought:Embrace the limitations of the format.
    22. 22. Further non-K2P toolsFREE COMMERCIALBrekel Kinect iPi Soft Open-source capture for 3D Uses two Kinects to record animation (Windows-only) NI MateDuik Kinect for OSC/MIDI/Blender Inverse kinematics plugin for AE
    23. 23. Questions?
    24. 24. the software!
    25. 25. Contact UsNick Fox-Gieg Victoria @FakeGreenDress