Microsoft Kinect


Published on

Lee Scott’s presentation discusses Microsoft Kinect within teaching, learning and research.
Since its release of Kinect, there has been tremendous enthusiasm and fascination. Kinect is not only a tool to help navigation and interaction, but a tool to help students to get even more engaged in learning. Kinect is already making a difference in getting students more excited about their learning environment, and helping students to get engaged…and actually get more excited about studying.
We are at an exciting time with the availability of the Kinect for Windows Software Development Kit (SDK). Kinect and NUI will bring more interactive classroom environments, the development of new learning styles that will help students with and without disabilities to get more engaged with learning, as well as the potential for much more interactive navigation tools, helping to get students involved in the teaching, learning and research.
The power of Kinect is here it’s now your turn for ideas and exploration.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Hello everyone my name is Lee Stott I work within Microsoft UK Developer Platform Evangelism group. My role within Microsoft is speak to the UK Academic community about Microsoft Technologies. My role is to offer you best practice, advice and guidance also I love to hear about what great things your doing with our products in relation to teaching, learning and research.
  • So the plan for today is I want to talk about the Microsoft KinectWhat is the Kinect and where did this device come from?With the help of Kenji Takeda from Microsoft Research Cambridge we want to show a new demoI then want to talk about NUII want to then cover how easy the Kinect is and how its inspiring todays staff and studentsThen we will finish with some Q&A
  • So lets start with some interesting factsSo where idea of the Kinect come from?Many people think that Kinect was created by Microsoft Research labs – that’s not exactly how it happened. It’s true that MSR has had decades of work in Computer Vision and Object recognition – but Kinect’s journey actually started in 2007 – when a few members of the Xbox team had the bright idea: why do we need a controller?The Xbox team actually got quite a way down the road – their solution could recognize a person – but it was more of an ideal form of a person. Well as you can see from the email above its was simply a quick lunch time email which sparked this innovation. Jamie shotton had produced a paper based on recognizing forms as you can see in the Sheep Grass image, so this research was key in making a Xbox Succeed especially with its Children. As we all know Children don’t quite move like adults, and certainly they aren’t shaped like adults. So MSR were set a task - How do you create a system that recognizes all body types and all body movements accurately, and not just the idealized form of a person.Another massive problem: Who should it recognize, and when? What happens when your dog jumps into the action. Also gamers aren’t going to play in a warehouse – they’re going to play in a living room. That means furniture… objects… … people in the background watching. Who should it pay attention to, when? Who’s playing? Who’s waiting to play? Who’s just in the way.That means, that the solution has to intrinsically understand participants in context: Find the people in the scene & ignore the background and background observers.It also means that it needs to track individuals and what they’re doing… in the case of Kinect for Xbox 360 – this means faces, voices, and up to 4 people at one time.
  • So what is the kinect ?3D Depth Sensor IR CameraIR Laser Projector Resolution, depth streamQVGA (320 × 240) A depth map signal: 320x240 at 30 fps, 640x480 at 30 fps, 1280x960 at 10 fps. RGB CameraA RBG signal: 320x240 at 30 fps, 640x480 at 30 fps, 1280x960 at 10 fps.Resolution, colour streamVGA (640 × 480) Multi Array MICAudio input characteristicsA four-microphone array with 24-bit analogue-to-digital converter (ADC) and Kinect-resident signal processing such as echo cancellation and noise suppressionAudio format16-kHz, 16-bit mono pulse code modulation (PCM)Optimum Distance Colour and depth stream4 to 11.5 feet (1.2 to 3.5 meters) Skeletal tracking4 to 11.5 feet (1.2 to 3.5 meters) Viewing angle43° vertical by 57° horizontal field of viewMechanized tilt range (vertical)±28°
  • So how does this wokAs you can see in the video IR records the image and relative spacing of the dots field gives an indication of the distance from the IR Emitter. The Kinect device then send a matrix of inters back to the PC or Xbox deviceA depth map is created 1st Pic background segmentation occurs separation of players from the background2nd Pic Body classifier - Inferred body part separately colour codes as you see left hand is blue head is read right hand orange3rd Pic Body Part Identifier - Show the most confident proposals for each joint if above a fixed threshold as you see joint and body part are colour corresponded.4th Pic Skeletal representation As you can image this takes some serious processing power and analysis millions of sample and Microsoft Azure and HPC Dryad Linq were used to create the Classifiers
  • NUI is simply a whole new ball game, its something no-one else can offer for example the wii you need the controller, the sony you need the move baton. The Kinect is simply calibration free!A huge advantage Microsoft has is nearly every product which Microsoft ships includes some form of technologies from Microsoft ResearchSo what does this advantage mean, through exploration and cross company collaboration we can advance the state of art computer science, we can defiantly say that the Kinect has presented a huge opportunity for the academic community.
  • The Kinect for Windows SDK beta is a programming toolkit for application developers. It enables academics and enthusiasts easy access to the capabilities offered by the Microsoft Kinect device connected to computers running the Windows 7 operating system.The Kinect for Windows SDK beta includes drivers, rich APIs for raw sensor streams and human motion tracking, installation documents, and resource materials. It provides Kinect capabilities to developers who build applications with C++, C#, or Visual Basic by using Microsoft Visual Studio 2010.This SDK includes the following features:Raw sensor streamsAccess to raw data streams from the depth sensor, color camera sensor, and four-element microphone array enables developers to build upon the low-level streams that are generated by the Kinect sensor. Skeletal trackingThe capability to track the skeleton image of one or two people moving within the Kinect field of view make it easy to create gesture-driven applications. Advanced audio capabilitiesAudio processing capabilities include sophisticated acoustic noise suppression and echo cancellation, beam formation to identify the current sound source, and integration with the Windows speech recognition API. Sample code and documentationThe SDK includes more than 100 pages of technical documentation. In addition to built-in help files, the documentation includes detailed walkthroughs for most samples provided with the SDK. Easy installationThe SDK installs quickly, requires no complex configuration, and the complete installer size is less than 100 MB. Developers can get up and running in just a few minutes with a standard standalone Kinect sensor unit (widely available at retail outlets). This SDK is designed for non-commercial purposes o
  • I like to welcome Kenji Takeda from Microsoft Research onto the stage who will help with the following demo.
  • Dare to be Digital is a video games design competition targeted at university students and recent graduates, started by University of Abertay Dundee, Scotland in 1999.Teams (typically of 5 university undergraduates or fresh graduates) work together in a microcosm of a games development company under tight deadline (usually 10 weeks; 8 and 1/2 in the 2011 competition) to develop a functional game prototype over summer.The main objective is to help students gain real life working experience in a studio environment. Mentoring support is provided by game industry professionals and University staff. Entrants are paid a basic salary and have accommodation and travel costs covered by the University.Entrance to the competition is based upon each team's ability and the nature of the game concept. This is measured against three criteria: 1. creativity, 2. market potential, 3. and use of technology.These criteria are also used to decide the three winning teams, who go through to be nominated for the BAFTA Ones To Watch AwardKieran Connell, awards judge and Development Lead at Microsoft Studios, said: “I’ve been incredibly impressed with the technical achievements of all the teams this year, but particularly those that have managed to get to grips with Kinect – creating natural and enjoyable game mechanics with such a new piece of hardware in such a short space of time is phenomenal.”
  • Note, this organisation is not affiliated to Microsoft but its there as a specific resource for academia worldwide
  • Microsoft Kinect

    1. 1. Enabling Learning and Research with Kinect for Windows SDK<br />
    2. 2. Agenda<br />About Microsoft Kinect<br />Skeletal tracking demo<br />Natural User Interfaces<br />Inspiring and enabling<br />Microsoft Research<br />Q&A <br />
    3. 3. Some Kinect facts<br />Before launch, online retailers (Amazon, Play, Game, etc.) had all announced that they had currently sold out of their first batch of pre order stock<br />More than 10 millions units sold in 6 months. <br />Fastest-selling consumer electronics device ever<br />Microsoft Research contributed to make Kinect a reality<br />
    4. 4. What is Kinect?<br />What does it looks like:<br />Whatitreally looks like:<br />
    5. 5. Beyond Hardware<br />Software makes magic possible<br />
    6. 6. Natural User Interfaces (NUI)<br />Rethinking ways in which people will interact with computers/technologies of the future<br />Re-evaluating everything from their (non-) physical design to the human needs and interaction models<br />Revolutionize the way we think about technology and what it can do on our behalf<br />
    7. 7. Kinect for Window SDK<br />Provides access to raw sensor streams: <br />Depth camera, RGB camera, audio streams<br />Skeletal tracking<br />Advanced audio capabilities<br /><br />
    8. 8. Demo<br />
    9. 9. Inspiring Young Minds<br /><br />
    10. 10. Limitless Possibilities<br /><br />
    11. 11. Microsoft Research Connections<br />“Work broadly with the academic and research community to speed research, improve education, foster innovation and improve lives around the world.”<br />Kinect for Windows SDK<br />Worldwide Telescope<br />Microsoft Academic Search<br />Chemistry add-in for Word<br />NodeXL<br />Kenji Takeda<br /><br />
    12. 12. Microsoft Research Connections<br />.NET Gadgeteer is a new toolkit for quickly constructing, programming and shaping new small computing devices (gadgets)<br />“From idea to working device quickly and easily”<br /><br />
    13. 13. demo <br />Q&A<br />demo <br />Microsoft UK Academic team visit -<br />Microsoft Research -<br /><br /><br />