Kinect seminar 121215v1

6,411 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
6,411
On SlideShare
0
From Embeds
0
Number of Embeds
5,165
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Kinect seminar 121215v1

  1. 1. Kinect를 활용한 Chan Seok Kang 동작 인식 프로그래밍 2012.12.15 KINECT FOR WINDOWS
  2. 2. Biography 강찬석 (Chan Seok Kang) • 2011 Microsoft Student Partner 5기 • 2012 Imagine Cup 2012 : Kinect Fun Lab Semi-Finalist • (전) KIST 실감교류 연구센터 위촉 연구원 Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com ) Facebook : http://www.facebook.com/kcsgoodboy KINECT FOR WINDOWS
  3. 3. Today`s Session• 음성으로 제어하는 Kinect Explorer ( 1h~2h )• Kinect SDK / OpenNI 동시 사용법 ( 1h )• Processing 활용 (ColorMap / Depth Map) (1h) KINECT FOR WINDOWS
  4. 4. 13th Project: Speech Controlled Kinect Explorer KINECT FOR WINDOWS
  5. 5. Speech-Controlled Kinect Explorer• 목적 – Speech Recognition for Tilt control KINECT FOR WINDOWS
  6. 6. Speech-Controlled Kinect Explorer• Speech SDK Install KINECT FOR WINDOWS
  7. 7. Speech-Controlled Kinect Explorer• Add Reference File • + Microsoft.Speech.dll KINECT FOR WINDOWS
  8. 8. Speech-Controlled Kinect Explorer• Add namespace • Using Mircosoft.Kinect • Using Microsoft.speech.recognition • Using Microsoft.speech.AudioFormat; • Using System.IO • Using System.Threading KINECT FOR WINDOWS
  9. 9. Speech-Controlled Kinect Explorer• Split the Grid KINECT FOR WINDOWS
  10. 10. Speech-Controlled Kinect Explorer• Insert the ImageControl & Canvas, TextBlock KINECT FOR WINDOWS
  11. 11. Speech-Controlled Kinect Explorer• XAML View KINECT FOR WINDOWS
  12. 12. Speech-Controlled Kinect Explorer• Initialize Thread, ThreadStart KINECT FOR WINDOWS
  13. 13. Speech-Controlled Kinect Explorer• Find the Speech Engine ( test ) KINECT FOR WINDOWS
  14. 14. Speech-Controlled Kinect Explorer• Result KINECT FOR WINDOWS
  15. 15. Speech-Controlled Kinect Explorer• Modified KINECT FOR WINDOWS
  16. 16. Speech-Controlled Kinect Explorer• Make a thread KINECT FOR WINDOWS
  17. 17. Speech-Controlled Kinect Explorer• Insert the Kinect-Enable KINECT FOR WINDOWS
  18. 18. Speech-Controlled Kinect Explorer• Define the sourceInit KINECT FOR WINDOWS
  19. 19. Speech-Controlled Kinect Explorer• Fill out the ColorStream KINECT FOR WINDOWS
  20. 20. Speech-Controlled Kinect Explorer• Fill out the DepthStream KINECT FOR WINDOWS
  21. 21. Speech-Controlled Kinect Explorer• Fill out the Skeleton Stream KINECT FOR WINDOWS
  22. 22. Speech-Controlled Kinect Explorer• #region Skeleton KINECT FOR WINDOWS
  23. 23. Speech-Controlled Kinect Explorer• #endregion Skeleton KINECT FOR WINDOWS
  24. 24. Speech-Controlled Kinect Explorer• Define the DrawBone KINECT FOR WINDOWS
  25. 25. Speech-Controlled Kinect Explorer• Use the DrawBone KINECT FOR WINDOWS
  26. 26. Speech-Controlled Kinect Explorer• test KINECT FOR WINDOWS
  27. 27. Speech-Controlled Kinect Explorer• Build the Grammar KINECT FOR WINDOWS
  28. 28. Speech-Controlled Kinect Explorer• Hypothesize / Recognize • Hypothesize : 단지 추정하는 값 • Recognize : 추정한 값을 통해 인지된 값 -> Speech Engine이 인식한 값을 받으려면 Recognize 이벤트에서 처리해야 됨 여기서는 추정값으로 테스트 KINECT FOR WINDOWS
  29. 29. Speech-Controlled Kinect Explorer• Define Speech Event (Anything you want) KINECT FOR WINDOWS
  30. 30. Speech-Controlled Kinect Explorer• Result KINECT FOR WINDOWS
  31. 31. Break? Break! KINECT FOR WINDOWS
  32. 32. Break? Break! KINECT FOR WINDOWS
  33. 33. Back To The First Lecture : Installation KINECT FOR WINDOWS
  34. 34. Installation• Purpose • To Develop in Processing Environment!! KINECT FOR WINDOWS
  35. 35. Development Settingwith Kinect OpenNI Bridge KINECT FOR WINDOWS
  36. 36. Step!!• Installing OpenNI v1.5.2.23• Installing NITE v1.5.2.21• Installing SensorKinect v 0.94 • Kinect for Windows 를 OpenNI와 연결시켜주는 드라이버• Installing Bridge Driver • Kinect SDK & OpenNI를 같이 쓰게 만드는 드라이버• Installing Kinect SDK v1.6 KINECT FOR WINDOWS
  37. 37. Before Start!!• 기존에 설치되어 있던 모든 드라이버 삭제• 키넥트가 뽑힌 상태에서 설치가 진행되어야 함• 아직 windows 8 을 지원하지 않음 • Windows 7 & VS2010 에서 진행 가능 KINECT FOR WINDOWS
  38. 38. Installing OpenNI, NITE, Sensor • OpenNI Binaries • Middleware • 유의사항 • 무조건 32bit!! KINECT FOR WINDOWS
  39. 39. Installing OpenNI, NITE ..• 정상적인 결과 KINECT FOR WINDOWS
  40. 40. Installing Kinect SDK / ToolKit• After Installing Bridge Driver• http://talkingaboutme.tistory.com/181 KINECT FOR WINDOWS
  41. 41. Install Processing & Library• Processing.org ->Download 2.0b5 or 2.0b6• http://code.google.com/p/simple-openni/ -> Download SimpleOpenNI 0.27 KINECT FOR WINDOWS
  42. 42. Install Processing & Library• Extract & move it in document directory KINECT FOR WINDOWS
  43. 43. Processing KINECT FOR WINDOWS
  44. 44. For fun: RGB / Depth in Processing KINECT FOR WINDOWS
  45. 45. RGB / Depth in Processing• Import the Library KINECT FOR WINDOWS
  46. 46. RGB / Depth in Processing KINECT FOR WINDOWS
  47. 47. RGB / Depth in Processing• Define Setup KINECT FOR WINDOWS
  48. 48. RGB / Depth in Processing• Result KINECT FOR WINDOWS
  49. 49. RGB / Depth in Processing• Background Subtraction • 거리에 제한을 두고 색상을 입히는 방식 KINECT FOR WINDOWS
  50. 50. If you need help, Just visit in My blog http://talkingaboutme.tistory.com KINECT FOR WINDOWS
  51. 51. Through the Third Eye, See the world deeply. And Change the world! KINECT FOR WINDOWS
  52. 52. Thank you for Listening  KINECT FOR WINDOWS
  53. 53. KINECT FOR WINDOWS

×