2014/10/04 第25回コンピュータビジョン勉強会＠関東 http://connpass.com/event/8082/

1. Introduction to Kinect v2
Tsukasa Sugiura
@UnaNancyOwen

2. Self-Introduction
Tsukasa Sugiura
Microsoft MVP for Kinect for Windows
 @UnaNancyOwen
 http://UnaNancyOwen.com
 t.sugiura0204@gmail.com
(July 2014 - June 2015)

3. ワタシハキネクトチョットデキル
I can develop Kinect App a little

4. Agenda
 What is Kinect v2
 Specifications
 New Features
 Demo

5. Disclaimer
“This is preliminary software and/or hardware and APIs
are preliminary and subject to change.”
（Kinect for Windows v2は暫定的なものであり、ソフトウェア、ハード
ウェア、およびAPIは製品版で変更される可能性があります。）

6. Kinect for Windows v1 Sensor
MULTI-ARRAY MIC MOTORIZED TILT
3D DEPTH SENSORS
RGB CAMERA

7. Kinect for Windows v2 Sensor
MULTI-ARRAY MIC
3D DEPTH SENSOR
( IR Camera + IR Emitters )
RGB CAMERA

8. Kinect for Windows v2 Sensor
Image by iFixit
IR EMITTERS
IR CAMERA

9. Specifications
Kinect for Windows v1 Kinect for Windows v2
Color 640×480 @ 30fps 1920×1080 @ 30fps
Depth 320×240 @ 30fps 512×424 @ 30fps
Sensor Structured Light
(PrimeSense Light Coding)
Time of Flight
(ToF)
Range 0.8~4.0 m 0.5~4.5 m
Angle of View
Horizontal / Vertical
57 / 43 degree 70 / 60 degree
Microphone Array ◯ ◯

10. Specifications
Kinect for Windows v1 Kinect for Windows v2
BodyIndex 6 people 6 people
Body 2 people 6 people
Joint 20 joint/people 25 joint/people
Hand State Open / Closed Open / Closed / Lasso
Gesture ☓ ◯
Face ◯
Speech / Beamforming ◯ ◯

11. System / Software Requirements
OS * Windows 8, 8.1, Embedded 8, Embedded 8.1 (x64)
CPU Intel Core i7 3.1GHz (or higher)
RAM 4GB (or more)
GPU * DirectX 11 supported
USB * USB 3.0 (Intel or Renesas Host Controller)
Compiler * Visual Studio 2012, 2013 (Supported Express)
Language Native (C++), Managed (C#,VB.NET), WinRT (C#,HTML)
Other Unity Pro (Add-in), Cinder, openFrameworks (wrapper)

12. System
Kinect for Windows v1 Kinect for Windows v2
PCPC

13. System
Kinect
Driver
Kinect SDK
Application
Kinect
Driver
Kinect SDK
Application
Kinect
Service
Kinect SDK
Application
Kinect SDK
Application
Kinect for Windows v1 Kinect for Windows v2

14. New Features
 Joint
 Tip (指先), Thumb (親指), Neck (首)の追加
 解剖学的に正しいJointの構成

15. New Features
 Gesture
 機械学習によるジェスチャー認識 (Discrete, Continuous)
 識別器を学習するツール”Visual Gesture Builder”
Video by http://youtu.be/-XYoblrnDpg

16. New Features
 Face
 Bounding Box (囲枠), Rotation (方向), Points (目、鼻、口角)の取得
 Activity (動作), Appearance (外観), Expression (表情)の認識
 Activity … 目の開閉, 口の開閉, Sensorに正対
 Appearance … メガネの有無
 Expression … 笑顔

17. New Features
 HDFace
 顔の3Dモデルを作成するためのデータ
 詳細なPoints (1347点), HairColor (髪色), SkinColor (肌色)の取得
 モデルのフィッティング

18. Other
 Drawing the Point Cloud retrieved from
Kinect v2 using Point Cloud Library
 Kinect v2から取得したPoint CloudをPCLを使って描画
 PCL All-in-one installerはBlogで配布

19. Reference
 Sample Program
 Kinect2Sample | GitHub
https://github.com/UnaNancyOwen/Kinect2Sample
 Article Series
 Kinect for Windows v2 | Build Insider
http://www.buildinsider.net/small/kinectv2cpp
 Blog
 Kinect | Summary?Blog
http://unanancyowen.com/?cat=3