• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
ITCamp 2013 - Tim Huckaby - Kinect for Windows - Designing Software for Gesture & Voice Controlled User Interfaces
 

ITCamp 2013 - Tim Huckaby - Kinect for Windows - Designing Software for Gesture & Voice Controlled User Interfaces

on

  • 579 views

 

Statistics

Views

Total Views
579
Views on SlideShare
579
Embed Views
0

Actions

Likes
0
Downloads
3
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike LicenseCC Attribution-NonCommercial-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    ITCamp 2013 - Tim Huckaby - Kinect for Windows - Designing Software for Gesture & Voice Controlled User Interfaces ITCamp 2013 - Tim Huckaby - Kinect for Windows - Designing Software for Gesture & Voice Controlled User Interfaces Presentation Transcript

    • itcampro@ itcamp13# Premium conference on Microsoft technologiesKinect for Windows -Designing Software forGesture & Voice ControlledUser InterfacesTim HuckabyInterKnowlogy Chairman/FounderActus Interactive Software Founder & CEOMicrosoft® Regional Director – Southern CaliforniaMicrosoft® MVP – Kinect for WindowsE-mail: TimHuck@InterKnowlogy.comTimH@Actus-Software.comBlog:team.interknowlogy.com/blogs/timhuckabyFaceBook:www.facebook.com/Tim.Huckaby.CarlsbadLinkedIn: www.linkedin.com/in/timhuckabyTwitter: @TimHuckaby
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionHuge thanks to our sponsors!
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesA little bit about me and why I amhere…A little bit about me and why I am here…Kinect for Windows - Designing Software for Gesture & Voice Controlled User Interfaces
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionAbout Tim, InterKnowlogy & Actus…InterKnowlogy (www.InterKnowlogy.com)Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com)◦ 13+ year old services firm – Custom Application Development◦ focused on building NUI solutions◦ Web, mobile, and desktop◦ Windows 7/8, PixelSense, WP7/8, Azure, Kinect, XAML stack- Largest Client: MicrosoftActus Interactive Software (www.Actus-Software.com)Tim Huckaby, Founder/CEO (TimHuck@Actus-Software.com)◦ Software Product Company◦ Interactive Kiosk and Active Digital Signage◦ Multi-Touch, Gesture, and Voice Driven Solutions
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesRelevant Use Cases (And Use Cases that do not Make Sense)Objectives And AgendaRunway to get startedTechnology RoadmapWhere We have Been and Where we are GoingDemos, Demos, Demos….Gesture & Voice Driven User Experiences
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesNUI: The Natural User InterfaceMulti-Touch Capable•Common Gestures of Touch•Physical Object Interaction•Virtual Object InteractionGesture Capable•Motion Based Interface•Tracking of full-body movement, facial expression, and voice with precisionVoice Capable•Multi-array Microphone•Uniquely Distinguish Audio & VoicesNueral Capable•Conscious and non-conscience interfaces•Non Invasive
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesWorlds Fastest-Selling Consumer Electronics Device… a Future Beyond GamingCombination of RGB camera, depth sensor and multi-array microphone– RGB camera delivers three basic color components– Depth sensors “sees” in 3-D– Microphone locates voices by sound and excludes ambient noiseConsumer Priced: $249.99Tracks full-body movement, facial expression, and voice with precisionKinect sensor bar scans and monitors 1 million points on the bodyKinect for Windows SDK– Skeletal Tracking– Face, Gesture Recognition– Audio Echo cancellation– Audio Beam Forming– Speech Recognition– Machine Learning
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionInterKnowlogy – Picture ViewerTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionUse Case: Data Visualization & 3D ModelingInteractive data visualization3D modeling and designHands-off presentationsKinect Fusion
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionKinect – 3D Anatomical ManipulationTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionA Relatively New Hardware ProductA commercial HW SKU for B2B sales; developers can purchase via Amazonand similar channelsA Commitment Kinect for Windows gives a customer:Fully supported hardware for Windows, plus a new “near mode” to allowinnovation at 40cm from the sensorOngoing updates based on the software innovation that is part ofMicrosoft’s deep investment and commitment to NUI, in both speech andhuman trackingA Future of InnovationKinect for Windows opens up a new wave of innovation for Human ComputerInteraction on Windows platformPuts Natural User Interface (NUI) into the public eye in a broad variety ofvenues: from car dealerships to malls to boardrooms to operating roomsWhat is Kinect For Windows?
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionUse Cases:Exercise, Physical Therapy, Education, TrainingExercise and physical therapySenior wellness – exercise andmonitoringInteractive science experimentsLanguage/speech learningHome Healthcare / Tele-Medicine
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSession• Skeletal Tracking• Near Mode• Depth Mode3 Modes of Operation
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionK4W Skeletal Tracking
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionThe Kinect for WindowsInterKnowlogy - Physical TherapyTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionThe Good News:• The Kinect SDK for WindowsThe Not So Good News:• Windows Only Device; You are not legally allowed to buildWindows apps for your Xbox Kinect;• you cannot build apps for 18 million Xbox Kinect ownerswith it.Kinect for Windows
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesHow to:United States - $249.99 - SKU: L6M-00001Amazon Visit the StoreGameStop Visit the StoreMicrosoft Store Visit the StoreNewegg Visit the Storehttp://www.microsoft.com/en-us/kinectforwindows/purchase/
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionRaw sensor streamsAccess to raw data streams from the depth sensor, color camera sensor, and four-element microphone array enablesdevelopers to build upon the low-level streams that are generated by the Kinect sensor.Skeletal trackingThe capability to track the skeleton image of one or two people moving within the Kinect field of view make it easyto create gesture-driven applications.Advanced audio capabilitiesAudio processing capabilities include sophisticated acoustic noise suppression and echo cancellation, beamformation to identify the current sound source, and integration with the Windows speech recognition API.Sample code and documentationThe SDK includes more than 100 pages of technical documentation. In addition to built-in help files, thedocumentation includes detailed walkthroughs for most samples provided with the SDK.Easy and familiarThe SDK installs quickly, requires no complex configuration, and the complete installer size is less than 100 MB.Developers can get up and running in just a few minutes with a standard standalone Kinect sensor unit (widelyavailable at retail outlets).Windows 7, Windows Embedded Standard, Windows 8 Desktop AppsC++, C#, or Visual Basic in Microsoft Visual Studio 2010.Free!Free SDK download, free run time license!http://www.microsoft.com/en-us/kinectforwindows/develop/What’s in the Kinect for Windows SDK?
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionKinect for Windows SDKTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionLaunch Kinectfor XBoxK4WTeamFormedK4W Non-commercialSDK betaK4WcommercialSDK TAPInitiatedNew K4WHardwareannouncedK4WcommercialReleaseTimelineNov, 2010 April, 2011 June, 2011 Sept, 2011 Nov, 2011 Feb 1, 2012K4W v1.5 K4W v1.6 K4W v1.7 K4W Dev CenterMay 21, 2012 Oct, 2012 March, 2013 May, 2013
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionUse Case: Interactive MediaInteract with customers in-storeVirtual fitting room – in-store orshop-at-homeVending machinesInteractive window exhibitsAugmented Reality web chat
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionPerfect for Kinect: Not designed for KinectWindows 8 / Metro / Modern UI
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionActus Interactive KioskTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionUse Case: Hands-Free ControlDoctors in surgeryoperating medicalimaging devicesthrough gestureand voiceAirplanemechanics/engineering workers viewinginstructionsCooking and otherhousehold scenarios
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionInterKnowlogy: Touch-less Operating RoomTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionLeap Motion– $70– https://leapmotion.com– In developer betaSoftKinetic– http://www.softkinetic.com– $249– Distance and Near Mode– Multiple Products– In the space for over a decadePanasonic– Works outside in broad daylight– $2,600Kinect for Windows Competitors
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionGesturePak: Carl Franklin’s Gesture RecorderTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesBreakoutSessionCarl Franklin’s Gesture RecorderGesturePak is a speech-driven gesture recording WPF app and amatcher class for .NET developers that uses the Kinect For Windowsdevice and SDK.
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesSummaryKinect for Windows is not great in the majority of Use Cases; where itis good:• Hands-Free Control• Exercise, Physical Therapy, Education, Training• Data Visualization, 3D Modeling• Interactive Media, Retail, Digital SignageThe hardware, tools, plumbing and platform for Kinect for WindowsApplications are powerful and available now.…and will just continue to get better, cheaper, powerful and more availableThe concepts of Gesture and Voice Recognition change the way wedesign and build software in some Use Cases.…if the goal is better user experiences
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesMore info on InterKnowlogy:www.InterKnowlogy.comwww.vimeo.com/InterKnowlogyMore info on Actus Software:◦www.Actus-Software.comAbout Tim Huckaby…◦Founder/Chairman, InterKnowlogy◦Founder/Chairman, Actus Software◦Microsoft® Regional Director – SouthernCalifornia◦Microsoft® .NET Partner Advisory CouncilFounder / Member◦Microsoft® MVP – Kinect for Windows◦INETA Speaker – International .NET Users GroupAssociation◦Board Member: Association for CompetitiveTechnology◦Board Member: Microsoft Healthcare PartnerAdvisory Board◦Author / SpeakerContact me:E-mail:TimHuck@InterKnowlogy.comTimH@Actus-Software.comPhone:• Office: 760-444-8640• Mobile:: 619 990 9200Blog:http://team.interknowlogy.com/blogs/timhuckabyFaceBook:http://www.facebook.com/Tim.Huckaby.CarlsbadLinkedIn:http://www.linkedin.com/in/timhuckabyTwitter: @TimHuckabyTim Huckaby
    • itcampro@ itcamp13# Premium conference on Microsoft technologiesQ & A