Desenvolvendo para Kinect for Windows


Published on

De os primeiros passos no desenvolvimento de aplicativos usando o poder de NUI (Natural User Interface), com o dispositivo Kinect for Windows. Diversas industrias estão inovando com essa solução!

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Key Points:Based in South Korea, this machine uses Kinect to reward dancers with Coke.“The Coca Cola Company recently unveiled the latest vending machine technology in South Korea and the experiment met with great success. The new high tech machine encouraged passing shoppers to demonstrate their break dance moves and rewarded the best efforts with free Cokes.As shoppers stroll through the mall, they are quickly challenged by the machine to emulate the dance moves of South Korea’s ultra popular boy band, 2 PM. When a brave soul accepts the invitation, they are instructed to step on the bright red circle painted on the floor, and the magical machine begins the fun. . . Some of the less technology friendly members of the audience might think there was a person hidden inside the double sized vending machine, but in reality, the crowd friendly soda dispenser makes use of Microsoft’s Kinect technology. Sensors read the dancers body moves and when they copy the dance step correctly, out pops a bottle of Coke. The lucky winner can take their free drink or bust a few more moves to win free Cokes for their friends.Read more at
  • Key Points: Increase in devices and rise of services have dramatically impacted developersBoth are helping blur the line between “consumer” and “enterprise”.Turns out hardware isn’t that interesting without great software and software isn’t that interesting without great hardware.For software developers two trends have dramatically changed the landscape in which they work over the last few years. First, the rise of powerful mobile devices – driven by, but not limited to phones and tablets – have created not only new markets for apps but have also increased the types of experiences possible. Of course the sheer increase in the types and numbers of devices also presents challenges: how do you create multiple versions of apps, across not just differing types of hardware and operating systems but also increasingly incompatible versions of the same operating system. This is where the second trend comes in: services. Cloud-backed software delivered, updated and available to a variety of devices provides not only a better way to support the increasing number of these devices but to also create new types of experiences for all of us. Services can give easy and consistent access to all of your information wherever you may be, they provide access to near-limitless computing power when you need it and they can provide for developers and businesses new types of revenue opportunity.Out of these two trends a number of challenges (and opportunities) have arisen:Finding your audience. Creating an app or an experience is just the first step. Finding and then reaching the right audience is an increasingly difficult task. Differentiating. In a sea of apps, how does your app stand out? Time and skills. With limited time and budget how do you build apps for all the various devices you need to reach your audience? Do you need to learn new programming languages and skills in order to do so?Devices fodder:A recent survey found that in 88% of companies, employees were using their own technology at work. (Avanade, 2012)Information workers “report using an average of 4 consumer devices and multiple third-party applications, such as social networking sites, in the course of their day.” (Unisys/IDC)The technology adoption curves for the enterprise are being re-written by the usersServices fodder:Any interesting client experience these days has a service on the back end – even gamesCloud compute usage, across the industry, is doubling every 6 months. (MSFT – azure insights/internal)Cloud spending will reach $60B in 2012, growing at 26% (IDC) – roughly 4x the rate of growth for IT overallOver 80% of new apps will be distributed/deployed on clouds (IDC)
  • Key Points: Services are required to efficiently power the sheer number of different types of devicesMicrosoft is a global leader in delivering servicesMicrosoft is a leader in delivering services:300 petabytes of Bing data (stored?)200+ services online 24/7350M email accounts40M Xbox Live users5.5B+ monthly searches.What will drive and power this explosion of devices? Services. Connected-software that can do everything from provide simple content updates to amazing experiences driven by mechanical learning taking place in a server farm half a world away.Services provides a means for personalizing an app, for adapting an experience over time and for enabling new business models.By year-end 2013, consumer cloud services for accessing content will be integrated into 90% of all connected devices.(Gartner, Nov 2011)IDC, a tech research firm, recently estimated that revenue from public cloud services exceeded $30.5 billion in 2011 and will grow to a staggering $72.9 billion in 2015. This growth is approximately four times faster than the IT market as a whole.According to Forrester, 46 million Americans used cloud computing services in 2010. Nearly 10 million in that group used paid services. Forrester expects usage to increase more than 400% to 196 million people by 2016, with 97 million of those paying for services.(see slide in the appendix as a way to emphasize our experience in delivering services or simply use the proof points below)
  • Microsoft is the second largest Internet property in the world.1 - Google, 2 - MSFT, 3 - Facebook, 4-Yahoo, 5 - Wikipedia, 6 - Amazon, 7 - AppleMary Meeker (citing comSore Global 8/11)
  • Key Points:Windows is our platform for both devices and servicesCommon thread across all of Windows – PC, Tablet, Phone, Server, Cloud, Data – It is all WindowsWhat we learn from hosting some of the largest services in the world we implement in our products. Windows is our platform, powering both devices and services . . .Continuous feedback loop between what we use in production and what we implement in our productsOur consumer business matters more than ever to our enterprise business – consumers are calling the shots now, re-shaping the adoption curves for tech in the enterprise to reflect their personal tastes and not IT inertia and slownessWe learn a lot from it … implement that learning into our products, all while maintaining an enterprise-grade feature set that matters more to IT today than ever beforeOnly Microsoft plays in both these areas, and now that the line separating the two is gone forever, we’re in a great position to take advantage
  • Key Points:You can more easily create new experiences on a new range of devicesYou can more easily create new experiences on a new range of devices.  Why build just another app when you can harness voice and gesture with Kinect or have your apps work with other apps on Windows 8.Our platform gives developers the opportunity to create more natural, connected and personal experiences. Natural:The Kinect has opened the door for amazing interactions at home, in stores, or work. The Kinect has been used for everything from surgical assistance to autism treatment to helping satellites dock with one another.Windows 8 expands the ability to use touch and penConnected:Xbox Smartglass links and expands entertainment connecting your Xbox to Windows, iOS and Android devices.With Windows 8, apps can more directly work with other apps through the use of ContractsCloud-connectedPersonal:With a Microsoft Account experiences can be linked across phone, slate, PC, Xbox and WebLive tiles provide a consistent way across phone and Windows 8With the Microsoft platform you can more easily create new experiences on a new range of devices.  Why build just another app when you can harness voice and gesture with Kinect or have your apps work with other apps on Windows 8?Change the way people interact with your experience. Kinect has transformed the way people think about interacting with devices as well as igniting the imaginations of developers around the globe. From assisting surgeons to helping satellites dock with one another, the Kinect provides innumerable opportunities to create exciting experiences at home, in stores, or at work. Windows 8 makes it easy to have apps that utilize touch, the keyboard and a pen. Drawing and painting with applications like Fresh Paint, sketching ideas, and freeform note taking in OneNote are all uniquely natural Windows experiences. Make the apps themselves more interactive with each other. With Windows 8, apps can more easily interact with one another through the Share and Search charms. Between devices, companion experiences, such as Xbox Smartglass, provides a contextually intelligent interaction between an Xbox 360 and another device to enhance TV shows, movies, music, sports and games. [What follows are examples of new types of experiences built on our platform. Choose the one that best fits your customer/situation or geographic needs]
  • Diferenças principais entre os dois modelos de Kinect é o fato do modelo para Windows ser totalmente suportado pelo kit de desenvolvimento de software, licenciado para aplicações comerciais e funciona a distância mínima de 40 cm (no Kinect para Xbox é 80cm).O Kinect para Windows pode ser adquirido pela Brasoftware (R$ 999): Kinect é os “olhos e ouvidos” do PC. O software que o acompanha é o cérebro que entende os movimentos, comandos de voz, etc.
  • Easy to connect to Windows and Commercial readySkeletal tracking capability both seated and standingGreen Screening via the Infrared sensors, allows you to put people into various scenarios. It is also what allows some of our partners to create virtual dressing rooms where you can try on clothes or accessories. These are becoming popular in retail environments.Audio Beam Forming and Echo Cancellation – There is a sophisticated 4-Microphone array in the Kinect device that allows for echo cancellation, making it easier to recognize the location of people in the Kinect’s view. With the 4 Microphone array, Kinect can tell where a person is speaking from, which allows the Kinect application to better track an individual and interact with the correct person in the scene.Point Cloud is the ability to know where a person is in space, within the view of the Kinect. Note: This can be demoed in the SDK toolkit, so you can reference that here if you plan to demo that capability.Near Mode allows the Kinect to see you as you move closer to the sensor. This can be quite important in some applications. One area we are seeing this more and more is in retail, where floor space is limited and retailers want to provide a captivating experience within a smaller footprint.You can have up to 4 Kinects per PC, giving developers the opportunity to integrate multiple Kinects into their application.Kinect Studio and Toolkit has many samples and examples for Kinect for Windows. You can download it at
  • 2 esqueletostotalmenterastreados+4 que o Kinect sabequesãohumanosqueestãoali, mas nãorastreiatotalmente
  • Some of the market scenarios that we are seeing today.We launched the beta version of our software in June of 2011. At that time we invited people to get into our Testing and Adoption Program. We received hundreds of nominations for the TAP and have over 400 people in the program. It gave us really good data on what industries have interest in Kinect for Windows. This is a bar graph showing that data. There are some scenarios that emerge. Education is highly interested from an academic perspective. We’ve had a number of requests from higher education institutions to use Kinect for Windows in their Computer Science curriculum. Retail continues to emerge as a highly interested segment. Healthcare is also a relatively active industry. Also notable is the breadth of interest across many areas. People are looking at ways to innovate for their customers.
  • Look at some of the key scenarios and markets:Healthcare – falling into three areas: Physical Therapy – because we’re able to get fairly accurate measurements, this provides the opportunity to monitor specific range of motion activity in the Physical Therapy space. You can then track this over time, to see the efficacy of the exercises. On the backend of this process, it allows providers to know it people have actually done the PT, to make better decisions as to the next steps in the patient’s care.Touchless Operating Room – This allows a surgeon to look through data without touching a mouse, keyboard or screen, thus keeping their hands clean for continuing with the procedure. Patient Monitoring – we see people piloting patient monitoring in hospitals. Currently the patient monitoring is often done with pressure sensitive mats and other detectors, which often provide false positives to the providers. Kinect is being trialed to watch for fall risks in patients and also to monitor hand washing in a patients room. Retail:There are many scenarios being used in Retail. We see Magic Mirrors, where people can try on clothes and accessories. We see virtual fitting rooms where people can have their body scanned for proper fit of clothes. We see interactive digital signage that engages and informs customer as they are in the store. This gives retailers a way to make their shoppers experience more convenient as well as keeping them in the store for longer periods of time. Training simulation software:Allows companies to simulate an environment for training various operations. We have seen this in training people how to lift properly, as well as how to remain safe in hazardous environments. Siemens Jack is one example of 3D training simulation using Kinect for Windows.
  • Our Testing and Adoption Program has attracted many customers and partners. We are seeing many innovative ideas being developed for these customers. Let us know how we can help you with ideas you have to change how you are engaging your customers.
  • Key Points:Reach more people on more devices from Xbox to phone to PCs60M Windows 8 licenses sold; over 100M apps downloaded two months after launchWindows 8 upgrade momentum outpacing Windows 7Quickly and easily monetize your apps with advertising.Creating a world-class app is great but you want to make it available to as many people as possible.From living rooms, to phones, cars, kiosks and reimagined PCs, Microsoft helps developers reach more people in more places. Windows 8 represents a huge business opportunity to develop apps, games, and device experiences to reach customers, extend brands, and drive revenue. With over 60 million licenses sold as of December 2012, Windows 8 has matched the record setting pace of Windows 7 and customers have downloaded 100M apps from the Windows Store. Windows Phonehas increased its market momentum 5x from Christmas 2011 to Christmas 2012 and offers more than 130,000 quality apps and games. Consumer Reports rates Windows Phone in a virtual tie with the iPhone and boasts more satisfied customers than Android or BlackBerry. On the Web, developers recognize that some cross platform experiences are best delivered via the browser given the broad reach of the Web, so Microsoft has increased its investment and pace of innovation in Internet Explorer, the most popular browsing experience on the web with 55% of PC. With Office Apps, developers have the opportunity to reach some of the over one billion people who use Microsoft OfficeComputerWorld, “Consumer Reports: Windows Phone 8 devices are winners,” 12/17/2012.ChangeWave/451 Research, “Mobile Wars: Samsung Bursts Out of the Gate to Start the New Year,” 1/15/2013 Net Applications, “Desktop Browser Market Share,” January, 2013. See also NeoWin, “Internet Explorer passes 55% market share in January,” 2/1/2013Developers recognize a huge opportunity to create apps for the hundreds of millions of devices running Windows; more than a half million have attended a Dev Camp in 87 countries around the world. Stats as of 1/30/2013:Xbox: 70 million, Xbox Live: 40 millionKinect: 19 million Windows 8:At CES, we disclosed a few key metrics (70 days post-launch):60 million licenses sold Windows 8 upgrade momentum outpacing Windows 7100 million Windows Store app downloadsStore visitors up 4.5x since launchNumber of apps in Store quadrupled since launch -- 10K new apps in December aloneTelemetry: Users with touch devices download 4.5X as many paid appsWindows devices: “more than 1,700 certified systems for Windows 8 and Windows RT”Advertising reach: Office Apps reach:Over a billion Office users. IE reachOn the Web, developers recognize that some cross platform experiences are best delivered via the browser given the broad reach of the Web, so Microsoft has increased its investment and pace of innovation with Internet Explorer10. 55% of PC users use Internet Explorer. Net Applications, “Desktop Browser Market Share,” January, 2013. See also NeoWin, “Internet Explorer passes 55% market share in January,” 2/1/2013Windows Phone has increased its market momentum 5x from Christmas 2011 to Christmas 2012 and offers more than 130,000 quality apps and games. Consumer Reports rates Windows Phone in a virtual tie with the iPhone and boasts more satisfied customers than Android or BlackBerry. ComputerWorld, “Consumer Reports: Windows Phone 8 devices are winners,” 12/17/2012.ChangeWave/451 Research, “Mobile Wars: Samsung Bursts Out of the Gate to Start the New Year,” 1/15/2013
  • We know a couple things about how people think about and use devices today … the main one is that there is an increasing expectation of apps, content, and experiences spanning multiple devices and form factors … PC, tablet, phone, even game consoleThe impact on developers is that they need to be on those devices to differentiate – need to have n versions of your app where n >2 or 3This is why a lot of devs are abandoning AndroidLeast common denominator doesn’t always work, and developers will almost always aim to exploit what the specific device can uniquely doThis has always been the caseThis is what happened with the iPhoneWe’re addressing this challengeFrom the latest web technologies to old school programing languages, chances are you already have the skills to build apps and experiences on our platform. From web skills such as HTML 5 and JavaScript to .NET, C#, and C++, developers have a number of options when it comes to building Windows 8 and Windows 8 Embedded applications. Both Windows and open source developers can build new, and migrate existing, applications to Windows Azure by deploying virtual machines for both Windows and Linux workloads. Windows Azure Web Sites support for multiple languages and frameworks, including ASP.NET, PHP, Node.js and Django. Beyond just code and skills, on the Microsoft platform you have more choices on deployment. Your apps can run in your datacenter, a Microsoft datacenter or a Microsoft partner’s datacenter, or a combination of all three. Developers can take a familiar route to building applications that can run anywhere and can be moved anywhere when circumstances change because of Windows Azure and Windows Server’s shared approach to management, virtualization, identity, and interoperability.The shared core between Windows 8, Windows Phone 8 and Windows Embedded 8 enables developers to quickly get from a great idea to a money-making app running on multiple devices, by reusing their skills and, in some cases, the actual code, all built using a common toolset in Visual Studio.
  • Windows StoreSuper flexible terms to enable developers to make money – this is not a strength for apple, frankly70/30 split, but a low bar of $25K in revenue to accelerate that to 80/20 … apps that do well and achieve popularity with users create a path for the developer to make more moneyUse your own commerce platform … it goes to 100% - developers keep everythingIn-app purchasing is no problem3rd-party ad controls are no problem – you want to use Google for ads?  Totally fineThe strategy is basically removal of friction and barriers that get in the way of developers making money because that is the singular driving force behind platform economicsTo be more successful, developers need marketplaces with flexible commerce options and a fast path to monetization. The Windows Store helps customers discover new apps, gives better payout percentages than comparable stores, enables third party commerce systems and advertising platforms, and facilitates in-app purchases. With our Ads in Apps program, we can help you help monetize your app, leveraging Microsoft’s relationships with top advertisers. [See optional Ads-in-Aps slide in the appendix]
  • As of CES100 million Windows Store app downloadsStore visitors up 4.5x since launchNumber of apps in Store quadrupled since launch -- 10K new apps in December aloneThese are to land the point about why it’s smart to bet on ‘touch’  Our own telemetry data is clear evidence that customers with a touch device do more. With a touch device:Customers use SEARCH two times more oftenCustomers use SHARE 2.5x more oftenCustomers snap apps to multitask 2.5 more often Customers spend 4.5x more times in Windows Store apps on a touch device 
  • Thank you.
  • Desenvolvendo para Kinect for Windows

    1. 1. Anos para alcançar 50 milhões de pessoas…38 anos 13 anos 4 anos 3 anos 100 milhões<9 mesesInternet FacebookiPodTVRadiosource:
    2. 2. 484% das empresaspossuem funcionáriosremotosComo trabalhamos65%dasempresas estãoimplementandono mínimo umaferramenta desocial20%esperamrespostadentro de umahora via socialConsumidor “social”Média de 4dispositivos porusuário utilizadostodos os dias44% dosconsumidoresreclama viasocial mediaCloud Big dataMobilidade Social Apps
    3. 3. Computer / Human InterfaceDevelopment Over Time20102006199719841981TIMEVoiceWYSIWYGDOS CLINEXTKinect / IntelligenceOngoing InnovationMotionTouch
    4. 4. Computação Moderna
    5. 5. dispositivosserviçoshardwaresoftware
    6. 6. Gartner, Nov 2011serviçosAo final de 2013, os serviços em nuvempara consumidores estarão integrados em90% de todos os dispositivos conectados.
    7. 7. PC, tablet, foneServidores eNuvem
    8. 8. Natural ConectadoNovas ExperiênciasPessoal
    10. 10. Máximo de 2 esqueletos por Kinect6 Players propostosSeated (10)Default (20)
    11. 11. Consumer GoodsDefenseEducationElectronicsEnergyEntertainmentFinanceGovernmentHealthcareManufacturingMedia and AdvertisingOEMResearchRetailTelecomIndividual
    13. 13. Atingindo mais pessoas com suas Apps+60M licenças Windows 8; 100M appsdownloads70M consoles Xbox; 19M Kinect130.000 Apps Windows PhoneOffice + Windows: +1Bilhão de usuários
    14. 14. Desenvolvendopara Windows 8&Windows Phone8
    15. 15.
    16. 16. @dbordini