Dave Drach, Managing Director for Emerging Businesses at Microsoft gave this presentation at my Microsoft Pre-MIX11 event ROCK! 1. Emerging Business Team Mission: Building Opportunity with VC & Startup Communities 2. Microsoft BizSpark: Global program designed to help accelerate the success of early stage startups 3. Building for the Kinect: the XBOX Dev Kit, integrates XBOX with PC Development environment 4. Kinect Sensor: a hybrid device with input devices, space control is done through a tilt monitor 5. XBOX Studio Overview 6. Human Depth Sensing: Object pattern similarity determines disparity 7. Kinect Depth Sensing: IR pattern similarity determines disparity 8. The Kinect Play Space 9. Player Framing 10. Tilting the Playing Field 11. Provided Data: Depth & Segmentation Map 12. Depth Map Format 13. Skeleton Tracking & Depth 14. Comparing Depth Map to Skeleton 15. Gaussian Filtering 16. Audio Overview 17. Kinect Audio Routing 18. Talking to Your Kinect 19. Biometric Data for Player Recognition

1. Microsoft® Emerging Business Team
Microsoft Kinect & MIX 11 Game Preview
Dave Drach
Managing Director – BizSpark ONE
XBOX & Windows Portfolio
Emerging Business Team
ddrach@microsoft.com
1

2. Emerging Business Team Mission
Building Opportunity with VC and Startup Communities
Evangelize
Microsoft Role in
Startup Success
Connect Start-ups PLATFORM Build
with Microsoft ADOPTION TRUST Relationships
Ecosystem with VCs
Be the Industry Leader
in helping Startups
Realize their potential
Clarify Start-up
SATISFACTION Attracts new
Start-ups to
Opportunities with Microsoft
Microsoft
2

4. Microsoft BizSpark
Microsoft BizSpark is a global program designed to help accelerate
the success of early stage start-ups. Over 35,000 start-ups have
enrolled since November 2008
SOFTWARE
• Development tools and server licenses
SOFTWARE • No cost to join
SUPPORT
VISIBILITY • Community support from 2,000+ network
and hosting partners
SUPPORT
• Professional technical support from
Microsoft
VISIBILITY
• Profile and promotion in BizSpark Connect
4

5. Microsoft BizSpark criteria
 building software/software as a service
 privately held
 in business for less than 3 years
 less than US $1 million in annual revenue
www.BizSpark.com
@bizspark
Contact Dave Drach (ddrach@microsoft.com)

6. BizSpark™ One Companies
6

7. Technology Coverage
Consumer Client & Gaming Business Applications
Dave Drach Lynda Ting
ddrach@microsoft.com lyndat@microsoft.com
Technology Coverage: XBOX & Windows 7 Technology Coverage:
Office/SharePoint, BPOS, OCS
Consumer Web Consumer Web
Beti Cung Christopher Griffin
beticung@microsoft.com christopher.griffin@microsoft.com
Technology Coverage: Technology Coverage: Windows Azure
Bing, Advertising, Windows Live, IE9, MSN (app layer), Silverlight
Consumer Client & Casual Gaming Business Applications
Brian Hoskins Rodney Bowen-Wright
brian.hoskins@microsoft.com robowri@microsoft.com
Technology Coverage: Windows Phone 7 Technology Coverage:
Dynamics, Industry Verticals
7

8. Developer Links and Product Guidance
SDKs, APIs, Developer Guidance, Downloads
http://msdn.microsoft.com/en-us/bb188199.aspx
Videos, Demos, Training, Code
http://channel9.msdn.com/
XBOX game development
www.xbox.com/dev
http://www.microsoft.com/windowsazure/
http://developer.windowsphone.com/
http://www.silverlight.net/
http://msdn.microsoft.com/en-us/windows/default.aspx
8

9. Building for the Kinect
9

10. XBOX Dev Kit – what is it?
Developer must commit to building an XBOX game
• Typically only for studio produced games – but will do BizSpark
• Integrates XBOX with PC Development environment

11. The Kinect Sensor
A hybrid device containing the following input
devices:
• A color (RGB) camera
• A depth sensor
• A microphone array
• A tilt sensor
Play space control is done through a tilt motor
• Pitch +/- 27 degrees

12. XBOX Dev Kit Studio Components

13. Overview of Xbox Studio
Tool for recording and viewing Kinect data
• UI for everyday usage
• API for in-depth control
No instrumentation needed for NUI streams
Record/playback data streams
• NUI data: color/depth/segmentation/skeleton/identity
• Title data: generic data

14. Human Depth Sensing

15. Kinect Depth Sensing

16. The Kinect Play Space

17. The Kinect Play Space

18. Player Framing

19. Tilting The Playing Field

20. Provided Data

21. Depth Map Format
320 x 240 resolution
16 bits per pixel
• Upper 13 bits: depth in mm: 800 mm to 4000 mm range
• Lower 3 bits: segmentation mask
Depth value 0 means unknown
• Shadows, low reflectivity, and high reflectivity among the few
reasons
Segmentation index
• 0 – no player
• 1 – skeleton 0
• 2 – skeleton 1
• …

22. Provided Data
Depth and segmentation map

23. Skeleton Tracking + Depth
Most depth titles use skeleton + depth. They don’t go
off the deep end and try to make a game with only the
depth map.
• Skeleton keeps you on the rails
• Provides a starting point with 20 joints
• Provides a segmentation map
• Helps you track people and not objects
• The compound fracture
• Elbow hands
• Popping joints
− Shoulders, head, or elbows

25. Gaussian Filtering

26. Kinect hears very well
Four microphone array
with hardware-based
audio processing
• Multichannel echo cancellation (MEC)
• Sound position tracking
• Other digital signal processing (noise
suppression and reduction)

27. Kinect Audio Routing

28. Talking to your Kinect
28

29. Kinect recognizes you and logs on
Recognizes players by using
biometric data
Maps players to enrollment
indexes
• Like game controllers map players
to port numbers
Associates players with
• Biometric enabled profiles
• Manually signed-in profiles

30. So, how about building some
games?
• MIX 11 sessions – they are online
• XNA Game Studio for Fun, Profit, Danger, Excitement
and Windows Phone 7 Games
• Rob Miles, Apr 12 11:30 AM – 12:30 PM
• Interactive Panel: Kinect and Natural User interfaces
• Kristin Tolle: Apr 14 12:00 PM – 1:00 PM
• Building Windows Phone 7 Applications with the
Windows Azure Platform
• Wade Wegner, Apr 12 11:30 AM – 12:30 PM
• Check out the Game Developers Conference
site
30

31. Do you want to win some money?
• Registration Feb28 – May 17
• Submit games May 17 – June 14
• Links to full XNA Game Studio online
• For more tools:
• DreamSpark.com for students
• BizSpark.com for startups
• Prizes:
• Grand Prize: $40,000, 1st prize: $20,000,
2nd prize $10,000, 3rd prize $5,000
31

32. I’ll see you at MIX 11
I’m going to the all day
HTML5 Canvas Mastery Bootcamp
Lanny McNie and Shawn Blais
Apr 11 1:30 PM – 5:00 PM
Questions
32