Your SlideShare is downloading. ×
Kinect를 활용한                     Chan Seok Kang         동작 인식 프로그래밍                      KIST                              ...
Biography            강찬석 (Chan Seok Kang)            • 2011 Microsoft Student Partner 5기            • 2012 Imagine Cup 201...
Today`s Session• Review : Kinect Explorer(1h)• Kinect QuickStart 시청 및 질의 응답 ( 1h )• Beam Angle Detector ( 1.5h )          ...
11th Project: Review – Kinect Explorer              KINECT FOR WINDOWS
Review – Kinect Explorer• Add Reference File & namespace                 KINECT FOR WINDOWS
Review – Kinect Explorer• Split the Grid                   KINECT FOR WINDOWS
Review – Kinect Explorer• Insert the ImageControl & Canvas, Button                  KINECT FOR WINDOWS
Review – Kinect Explorer• XAML View              KINECT FOR WINDOWS
Review – Kinect Explorer• Initialize Kinect & Enable Stream                   KINECT FOR WINDOWS
Review – Kinect Explorer• Fill out the ColorStream                   KINECT FOR WINDOWS
Review – Kinect Explorer• Fill out the DepthStream                   KINECT FOR WINDOWS
Review – Kinect Explorer• Fill out the Skeleton Stream                   KINECT FOR WINDOWS
Review – Kinect Explorer• #region Skeleton                     KINECT FOR WINDOWS
Review – Kinect Explorer• #endregion Skeleton                  KINECT FOR WINDOWS
Review – Kinect Explorer• Define the DrawBone                 KINECT FOR WINDOWS
Review – Kinect Explorer• Use the DrawBone                 KINECT FOR WINDOWS
Review – Kinect Explorer• test                 KINECT FOR WINDOWS
Review – Kinect Explorer• Make a Button Event                  KINECT FOR WINDOWS
Review – Kinect Explorer• Fill out the Button Event                    KINECT FOR WINDOWS
Review – Kinect Explorer• Result               KINECT FOR WINDOWS
Review – Kinect Explorer• Insert Anything you want!  (Near mode, Seated Mode, slider etc…)                  KINECT FOR WIN...
Kinect Studio• Test the Parameter (Depth Data , Position…)                   KINECT FOR WINDOWS
Break? Break!  KINECT FOR WINDOWS
Kinect QuickStart- Audio Fundamentals            KINECT FOR WINDOWS
Kinect QuickStart    KINECT FOR WINDOWS
Kinect QuickStart• 4 –Array High Quality Microphone  - Can get a direction of SoundSource                   KINECT FOR WIN...
Kinect Audio로 할 수 있는 것•   Audio Capture -> Recorder•   Sound Information•   Speech Recognition•   Raw Voice Data Access (u...
C++에서 제공하는 API• KinectAudio DirectX Media Object(DMO)• Windows Audio Session API (WASAPI)                 KINECT FOR WINDOWS
SOUND POSITION• Sound Source Angle : 소리가 나는 방향 과 강도• Beam Angle : 소리가 진행하는 방향  -50                0             +50       ...
Recording• KinectAudioSource가 일종의 버퍼 역할• Use Echo Cancellation to not record PC sound                  KINECT FOR WINDOWS
Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화  시킨 후에 활성화시켜야 함kinectSensor.Start();kinectSensor.AudioSource.Start(); //...
Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화  시킨 후에 활성화시켜야 함   Workaround #1 (start audio after skeleton):   kinectSe...
Break? Break!  KINECT FOR WINDOWS
12th Project: Beam Angle Detector               KINECT FOR WINDOWS
Beam Angle Detector• Add Reference File & namespace                 KINECT FOR WINDOWS
Beam Angle Detector• Grid -> Canvas (Width:640 / Height: 480)                   KINECT FOR WINDOWS
Beam Angle Detector• Sound의 특성상 Thread 의 사용이 필요!!             KINECT FOR WINDOWS
Beam Angle Detector• Sound Initialize (순서 유의)                 KINECT FOR WINDOWS
Beam Angle Detector• 탐지판 생성           KINECT FOR WINDOWS
BeamAngle• test          KINECT FOR WINDOWS
Beam Angle Detector• Define DrawLine                    KINECT FOR WINDOWS
Beam Angle Detector• 탐지침 선언           KINECT FOR WINDOWS
Beam Angle Detector• 입력이 없을 때는 안보이게!           KINECT FOR WINDOWS
Beam Angle Detector• 실효값 구하기 (SoundSourceAngle)                      KINECT FOR WINDOWS
Beam Angle Detector• 잠깐!!  • SoundSourceAngle 자체는 키넥트를 기준으로    판단하기 때문에 사람이 잘 보려면 -1을 곱해줘야 함.              KINECT FOR WIND...
Beam Angle Detector• RotateLine 정의                  KINECT FOR WINDOWS
Beam Angle Detector• Add the Line Thickness                  KINECT FOR WINDOWS
Beam Angle Detector• 현재값 구하기 (BeamAngle)                KINECT FOR WINDOWS
Beam Angle Detector• Fill out the BeamAngleChanged                  KINECT FOR WINDOWS
Beam Angle Detector• Result                KINECT FOR WINDOWS
If you need help,       Just visit in My blog http://talkingaboutme.tistory.com           KINECT FOR WINDOWS
KINECT FOR WINDOWS
Upcoming SlideShare
Loading in...5
×

Kinect seminar 121208v1(동영상x)

4,113

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
4,113
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Kinect seminar 121208v1(동영상x)"

  1. 1. Kinect를 활용한 Chan Seok Kang 동작 인식 프로그래밍 KIST 2012.12.08 KINECT FOR WINDOWS
  2. 2. Biography 강찬석 (Chan Seok Kang) • 2011 Microsoft Student Partner 5기 • 2012 Imagine Cup 2012 : Kinect Fun Lab Semi-Finalist • KIST 실감교류 연구센터 위촉 연구원 Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com ) Facebook : http://www.facebook.com/kcsgoodboy KINECT FOR WINDOWS
  3. 3. Today`s Session• Review : Kinect Explorer(1h)• Kinect QuickStart 시청 및 질의 응답 ( 1h )• Beam Angle Detector ( 1.5h ) KINECT FOR WINDOWS
  4. 4. 11th Project: Review – Kinect Explorer KINECT FOR WINDOWS
  5. 5. Review – Kinect Explorer• Add Reference File & namespace KINECT FOR WINDOWS
  6. 6. Review – Kinect Explorer• Split the Grid KINECT FOR WINDOWS
  7. 7. Review – Kinect Explorer• Insert the ImageControl & Canvas, Button KINECT FOR WINDOWS
  8. 8. Review – Kinect Explorer• XAML View KINECT FOR WINDOWS
  9. 9. Review – Kinect Explorer• Initialize Kinect & Enable Stream KINECT FOR WINDOWS
  10. 10. Review – Kinect Explorer• Fill out the ColorStream KINECT FOR WINDOWS
  11. 11. Review – Kinect Explorer• Fill out the DepthStream KINECT FOR WINDOWS
  12. 12. Review – Kinect Explorer• Fill out the Skeleton Stream KINECT FOR WINDOWS
  13. 13. Review – Kinect Explorer• #region Skeleton KINECT FOR WINDOWS
  14. 14. Review – Kinect Explorer• #endregion Skeleton KINECT FOR WINDOWS
  15. 15. Review – Kinect Explorer• Define the DrawBone KINECT FOR WINDOWS
  16. 16. Review – Kinect Explorer• Use the DrawBone KINECT FOR WINDOWS
  17. 17. Review – Kinect Explorer• test KINECT FOR WINDOWS
  18. 18. Review – Kinect Explorer• Make a Button Event KINECT FOR WINDOWS
  19. 19. Review – Kinect Explorer• Fill out the Button Event KINECT FOR WINDOWS
  20. 20. Review – Kinect Explorer• Result KINECT FOR WINDOWS
  21. 21. Review – Kinect Explorer• Insert Anything you want! (Near mode, Seated Mode, slider etc…) KINECT FOR WINDOWS
  22. 22. Kinect Studio• Test the Parameter (Depth Data , Position…) KINECT FOR WINDOWS
  23. 23. Break? Break! KINECT FOR WINDOWS
  24. 24. Kinect QuickStart- Audio Fundamentals KINECT FOR WINDOWS
  25. 25. Kinect QuickStart KINECT FOR WINDOWS
  26. 26. Kinect QuickStart• 4 –Array High Quality Microphone - Can get a direction of SoundSource KINECT FOR WINDOWS
  27. 27. Kinect Audio로 할 수 있는 것• Audio Capture -> Recorder• Sound Information• Speech Recognition• Raw Voice Data Access (using Software-Filter) ->하지만 오디오컨트롤 자체가 하드웨어와 연관되어 있어서 세밀한 조절을 위해서는 궁극적으로 C++을 이용해야 함. KINECT FOR WINDOWS
  28. 28. C++에서 제공하는 API• KinectAudio DirectX Media Object(DMO)• Windows Audio Session API (WASAPI) KINECT FOR WINDOWS
  29. 29. SOUND POSITION• Sound Source Angle : 소리가 나는 방향 과 강도• Beam Angle : 소리가 진행하는 방향 -50 0 +50 KINECT FOR WINDOWS
  30. 30. Recording• KinectAudioSource가 일종의 버퍼 역할• Use Echo Cancellation to not record PC sound KINECT FOR WINDOWS
  31. 31. Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함kinectSensor.Start();kinectSensor.AudioSource.Start(); // --> this will create an audio streamkinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect 나쁜 예 KINECT FOR WINDOWS
  32. 32. Attention!!• 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함 Workaround #1 (start audio after skeleton): kinectSensor.Start(); kinectSensor.SkeletonStream.Enable(); kinectSensor.AudioSource.Start(); Workaround #2 (restart audio after skeleton): kinectSensor.Start(); kinectSensor.AudioSource.Start(); // --> this will create an audio stream kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect kinectSensor.AudioSource.Start(); // --> this will create another audio stream 좋은 예 KINECT FOR WINDOWS
  33. 33. Break? Break! KINECT FOR WINDOWS
  34. 34. 12th Project: Beam Angle Detector KINECT FOR WINDOWS
  35. 35. Beam Angle Detector• Add Reference File & namespace KINECT FOR WINDOWS
  36. 36. Beam Angle Detector• Grid -> Canvas (Width:640 / Height: 480) KINECT FOR WINDOWS
  37. 37. Beam Angle Detector• Sound의 특성상 Thread 의 사용이 필요!! KINECT FOR WINDOWS
  38. 38. Beam Angle Detector• Sound Initialize (순서 유의) KINECT FOR WINDOWS
  39. 39. Beam Angle Detector• 탐지판 생성 KINECT FOR WINDOWS
  40. 40. BeamAngle• test KINECT FOR WINDOWS
  41. 41. Beam Angle Detector• Define DrawLine KINECT FOR WINDOWS
  42. 42. Beam Angle Detector• 탐지침 선언 KINECT FOR WINDOWS
  43. 43. Beam Angle Detector• 입력이 없을 때는 안보이게! KINECT FOR WINDOWS
  44. 44. Beam Angle Detector• 실효값 구하기 (SoundSourceAngle) KINECT FOR WINDOWS
  45. 45. Beam Angle Detector• 잠깐!! • SoundSourceAngle 자체는 키넥트를 기준으로 판단하기 때문에 사람이 잘 보려면 -1을 곱해줘야 함. KINECT FOR WINDOWS
  46. 46. Beam Angle Detector• RotateLine 정의 KINECT FOR WINDOWS
  47. 47. Beam Angle Detector• Add the Line Thickness KINECT FOR WINDOWS
  48. 48. Beam Angle Detector• 현재값 구하기 (BeamAngle) KINECT FOR WINDOWS
  49. 49. Beam Angle Detector• Fill out the BeamAngleChanged KINECT FOR WINDOWS
  50. 50. Beam Angle Detector• Result KINECT FOR WINDOWS
  51. 51. If you need help, Just visit in My blog http://talkingaboutme.tistory.com KINECT FOR WINDOWS
  52. 52. KINECT FOR WINDOWS

×