Kinect seminar 121208v1(동영상x)

4,576 views
4,504 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
4,576
On SlideShare
0
From Embeds
0
Number of Embeds
3,561
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Kinect seminar 121208v1(동영상x)

  1. 1. Kinect를 활용한 Chan Seok Kang 동작 인식 프로그래밍 KIST 2012.12.08 KINECT FOR WINDOWS
  2. 2. Biography 강찬석 (Chan Seok Kang) • 2011 Microsoft Student Partner 5기 • 2012 Imagine Cup 2012 : Kinect Fun Lab Semi-Finalist • KIST 실감교류 연구센터 위촉 연구원 Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com ) Facebook : http://www.facebook.com/kcsgoodboy KINECT FOR WINDOWS
  3. 3. Today`s Session• Review : Kinect Explorer(1h)• Kinect QuickStart 시청 및 질의 응답 ( 1h )• Beam Angle Detector ( 1.5h ) KINECT FOR WINDOWS
  4. 4. 11th Project: Review – Kinect Explorer KINECT FOR WINDOWS
  5. 5. Review – Kinect Explorer• Add Reference File & namespace KINECT FOR WINDOWS
  6. 6. Review – Kinect Explorer• Split the Grid KINECT FOR WINDOWS
  7. 7. Review – Kinect Explorer• Insert the ImageControl & Canvas, Button KINECT FOR WINDOWS
  8. 8. Review – Kinect Explorer• XAML View KINECT FOR WINDOWS
  9. 9. Review – Kinect Explorer• Initialize Kinect & Enable Stream KINECT FOR WINDOWS
  10. 10. Review – Kinect Explorer• Fill out the ColorStream KINECT FOR WINDOWS
  11. 11. Review – Kinect Explorer• Fill out the DepthStream KINECT FOR WINDOWS
  12. 12. Review – Kinect Explorer• Fill out the Skeleton Stream KINECT FOR WINDOWS
  13. 13. Review – Kinect Explorer• #region Skeleton KINECT FOR WINDOWS
  14. 14. Review – Kinect Explorer• #endregion Skeleton KINECT FOR WINDOWS
  15. 15. Review – Kinect Explorer• Define the DrawBone KINECT FOR WINDOWS
  16. 16. Review – Kinect Explorer• Use the DrawBone KINECT FOR WINDOWS
  17. 17. Review – Kinect Explorer• test KINECT FOR WINDOWS
  18. 18. Review – Kinect Explorer• Make a Button Event KINECT FOR WINDOWS
  19. 19. Review – Kinect Explorer• Fill out the Button Event KINECT FOR WINDOWS
  20. 20. Review – Kinect Explorer• Result KINECT FOR WINDOWS
  21. 21. Review – Kinect Explorer• Insert Anything you want! (Near mode, Seated Mode, slider etc…) KINECT FOR WINDOWS
  22. 22. Kinect Studio• Test the Parameter (Depth Data , Position…) KINECT FOR WINDOWS
  23. 23. Break? Break! KINECT FOR WINDOWS
  24. 24. Kinect QuickStart- Audio Fundamentals KINECT FOR WINDOWS
  25. 25. Kinect QuickStart KINECT FOR WINDOWS
  26. 26. Kinect QuickStart• 4 –Array High Quality Microphone - Can get a direction of SoundSource KINECT FOR WINDOWS
  27. 27. Kinect Audio로 할 수 있는 것• Audio Capture -> Recorder• Sound Information• Speech Recognition• Raw Voice Data Access (using Software-Filter) ->하지만 오디오컨트롤 자체가 하드웨어와 연관되어 있어서 세밀한 조절을 위해서는 궁극적으로 C++을 이용해야 함. KINECT FOR WINDOWS
  28. 28. C++에서 제공하는 API• KinectAudio DirectX Media Object(DMO)• Windows Audio Session API (WASAPI) KINECT FOR WINDOWS
  29. 29. SOUND POSITION• Sound Source Angle : 소리가 나는 방향 과 강도• Beam Angle : 소리가 진행하는 방향 -50 0 +50 KINECT FOR WINDOWS
  30. 30. Recording• KinectAudioSource가 일종의 버퍼 역할• Use Echo Cancellation to not record PC sound KINECT FOR WINDOWS
  31. 31. Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함kinectSensor.Start();kinectSensor.AudioSource.Start(); // --> this will create an audio streamkinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect 나쁜 예 KINECT FOR WINDOWS
  32. 32. Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함 Workaround #1 (start audio after skeleton): kinectSensor.Start(); kinectSensor.SkeletonStream.Enable(); kinectSensor.AudioSource.Start(); Workaround #2 (restart audio after skeleton): kinectSensor.Start(); kinectSensor.AudioSource.Start(); // --> this will create an audio stream kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect kinectSensor.AudioSource.Start(); // --> this will create another audio stream 좋은 예 KINECT FOR WINDOWS
  33. 33. Break? Break! KINECT FOR WINDOWS
  34. 34. 12th Project: Beam Angle Detector KINECT FOR WINDOWS
  35. 35. Beam Angle Detector• Add Reference File & namespace KINECT FOR WINDOWS
  36. 36. Beam Angle Detector• Grid -> Canvas (Width:640 / Height: 480) KINECT FOR WINDOWS
  37. 37. Beam Angle Detector• Sound의 특성상 Thread 의 사용이 필요!! KINECT FOR WINDOWS
  38. 38. Beam Angle Detector• Sound Initialize (순서 유의) KINECT FOR WINDOWS
  39. 39. Beam Angle Detector• 탐지판 생성 KINECT FOR WINDOWS
  40. 40. BeamAngle• test KINECT FOR WINDOWS
  41. 41. Beam Angle Detector• Define DrawLine KINECT FOR WINDOWS
  42. 42. Beam Angle Detector• 탐지침 선언 KINECT FOR WINDOWS
  43. 43. Beam Angle Detector• 입력이 없을 때는 안보이게! KINECT FOR WINDOWS
  44. 44. Beam Angle Detector• 실효값 구하기 (SoundSourceAngle) KINECT FOR WINDOWS
  45. 45. Beam Angle Detector• 잠깐!! • SoundSourceAngle 자체는 키넥트를 기준으로 판단하기 때문에 사람이 잘 보려면 -1을 곱해줘야 함. KINECT FOR WINDOWS
  46. 46. Beam Angle Detector• RotateLine 정의 KINECT FOR WINDOWS
  47. 47. Beam Angle Detector• Add the Line Thickness KINECT FOR WINDOWS
  48. 48. Beam Angle Detector• 현재값 구하기 (BeamAngle) KINECT FOR WINDOWS
  49. 49. Beam Angle Detector• Fill out the BeamAngleChanged KINECT FOR WINDOWS
  50. 50. Beam Angle Detector• Result KINECT FOR WINDOWS
  51. 51. If you need help, Just visit in My blog http://talkingaboutme.tistory.com KINECT FOR WINDOWS
  52. 52. KINECT FOR WINDOWS

×