ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface

517 views

Published on

Published in: Technology, Business
  • Be the first to comment

ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface

  1. 1. itcampro@ itcamp13# Premium conference on Microsoft technologiesThe Engaging User Experience& The Natural User InterfaceTim HuckabyInterKnowlogy Chairman/FounderActus Interactive Software Founder & CEOMicrosoft® Regional Director – Southern CaliforniaMicrosoft® MVP – Kinect for WindowsE-mail: TimHuck@InterKnowlogy.comTimH@Actus-Software.comBlog:team.interknowlogy.com/blogs/timhuckabyFaceBook:www.facebook.com/Tim.Huckaby.CarlsbadLinkedIn: www.linkedin.com/in/timhuckabyTwitter: @TimHuckaby
  2. 2. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteHuge thanks to our sponsors!
  3. 3. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteA little bit about me and why I am here…The Engaging User Experience & the Natural User Interface
  4. 4. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteAbout Tim, InterKnowlogy & Actus…InterKnowlogy (www.InterKnowlogy.com)Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com)◦ 13+ year old services firm – Custom Application Development◦ focused on building NUI solutions◦ Web, mobile, and desktop◦ Windows 7/8, PixelSense, WP7/8, Azure, Kinect, XAML stack- Largest Client: MicrosoftActus Interactive Software (www.Actus-Software.com)Tim Huckaby, Founder/CEO (TimHuck@Actus-Software.com)◦ Software Product Company◦ Interactive Kiosk and Active Digital Signage◦ Multi-Touch, Gesture, and Voice Driven Solutions
  5. 5. itcampro@ itcamp13# Premium conference on Microsoft technologiesNUI enabled applications improve the communication, education anduser experience across the software continuum.Objectives And AgendaThere are a number of tenants of an engaging user interface that willlast the test of timeThe 4 Manifestations of NUI: Multi-Touch, Vocal, Gesture, NeuralWhere We have Been and Where we are GoingDemos, Demos, Demos….The Natural User Interface (NUI)
  6. 6. itcampro@ itcamp13# Premium conference on Microsoft technologiesThe Tenants of an Engaging UXUse the Power of Faces– People love faces; We see faces where they don’t exist– We have DNA with the sole purpose of recognizing faces– Take advantage of this by putting faces on your App• Have the faces to look at important part of your App• People instinctively follow the eyes of the face.Use Food, Sex and Danger– When someone sees something new, they place it into one of fourcategories:1. Can I Eat it?2. Can it Eat Me?3. Can I Mate with it?4. …and everything else.• If you want your App to be engaged and interesting, put it in one ofthe first three categories.
  7. 7. itcampro@ itcamp13# Premium conference on Microsoft technologies
  8. 8. itcampro@ itcamp13# Premium conference on Microsoft technologiesThe Tenants of an Engaging UXTell a story– We learn through stories. It’s how we teach our children. It’s the Bible;It’s what we see in movies.– Stories are a big part of how information is conveyed to us.– If you have information to give to the user, put it in story form.– It doesn’t matter what medium you use (words, pictures, music), butusing a story narrative will help your user understand and retain yourinformation.Build commitment over time– Let the user choose how they want to interact with you (RSS, Twitter,Facebook)– Make sure that you don’t take advantage of the trust that is implicitin that interaction.Use Natural Interactions of Objects– Natural Movements– Fluidity– Animate / Exaggerate: Slow things down so the eye can follow
  9. 9. itcampro@ itcamp13# Premium conference on Microsoft technologies
  10. 10. itcampro@ itcamp13# Premium conference on Microsoft technologies
  11. 11. itcampro@ itcamp13# Premium conference on Microsoft technologiesJanuary 27, 2010
  12. 12. itcampro@ itcamp13# Premium conference on Microsoft technologies
  13. 13. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteThe “Cancer App” & The “Autocad App”Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  14. 14. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteEMN8Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  15. 15. itcampro@ itcamp13# Premium conference on Microsoft technologiesThe “Green Screen”We have come a long way…
  16. 16. itcampro@ itcamp13# Premium conference on Microsoft technologiesImage Courtesy of Computer History Museum
  17. 17. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteTouch Capable Computing Devices Are Not NewPast1972: PLATO IVTouch Screen TerminalThe Samsung SUR40 forMicrosoft PixelSenseWindows 8 - MetroApple iPadPresent Future (now)
  18. 18. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteWhat is Relatively New is:– Inexpensive Touch Capable, Non Proprietary Hardware– A Operating Systems designed for Multi-Touch– A Consistent Multi-Touch API for the major Hardware/SoftwarePlatforms– Developer Productivity in Touch Capable Apps– The Forecast of Multi-Touch Hardware Capability in Every NewComputing Device in the Short Term
  19. 19. itcampro@ itcamp13# Premium conference on Microsoft technologiesNUI: The Natural User InterfaceMulti-Touch Capable•Common Gestures of Touch•Physical Object Interaction•Virtual Object InteractionGesture Capable•Motion Based Interface•Tracking of full-body movement, facial expression, and voice with precisionVoice Capable•Multi-array Microphone•Uniquely Distinguish Audio & VoicesNueral Capable•Conscious and non-conscience interfaces•Non Invasive
  20. 20. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteGrey’s AnatomyTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  21. 21. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteGesture HeartTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  22. 22. itcampro@ itcamp13# Premium conference on Microsoft technologiesHTML 5 Touch Events, Version 1W3C Working Draft 24 January 2013Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.htmlDefines a set of low-level events that represent one or more points ofcontact with a touch-sensitive surfaceChanges of those points with respect to the surface and any DOM elementsdisplayed upon it (e.g. for touch screens) or associated with it (e.g. fordrawing tablets without displays).Addresses pen-tablet devices, such as drawing tablets, with considerationtoward stylus capabilities.“This specification is the 24 January 2013 Last Call Working Draft. Thecomment period for this Last Call Working Draft ends 14 February 2013.”
  23. 23. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynote
  24. 24. itcampro@ itcamp13# Premium conference on Microsoft technologies
  25. 25. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteDemocratic National Convention Voting AppTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  26. 26. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteWhat is also Relatively New:User Experience with Naturally Behaving Objects– Large Form Factorsdemand natural behaviors– The User Experience is“never done”– It can always be improved– Tablet Computing pavedthe way– Software Physics Enginesare readily available inopen source
  27. 27. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteFluid Layout & Pixelsence CrapsTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  28. 28. itcampro@ itcamp13# Premium conference on Microsoft technologies“Game-ification” CultureUser Experiences that Enhance LearningLearning made Fun / EntertainingProven as a learning tool beyond just ChildrenComputer based Games are a significant part of popular cultureEducational Video Game Curriculums– MIT, UC Irvine, Minnesota, Michigan State, etc.
  29. 29. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteNASA MarsboundTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  30. 30. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteKinect for WindowsWorlds Fastest-Selling Consumer Electronics Device… a Future Beyond GamingCombination of RGB camera, depth sensor and multi-array microphone– RGB camera delivers three basic color components– Depth sensors “sees” in 3-D– Microphone locates voices by sound and excludes ambient noiseConsumer Priced: $249.99Tracks full-body movement, facial expression, and voice with precisionKinect sensor bar scans and monitors 1 million points on the bodyKinect for Windows SDK– Skeletal Tracking– Face, Gesture Recognition– Audio Echo cancellation– Audio Beam Forming– Speech Recognition– Machine Learning
  31. 31. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteActus Interactive Digital Content System (Kiosk), IK PhysicalTherapy, IK Touch-less Operating RoomTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  32. 32. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynote3D ModelerTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  33. 33. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteKinect for Windows CompetitorsLeap Motion– $70– https://leapmotion.com– Not available yetSoftKinetic– http://www.softkinetic.com– $249– Distance and Near Mode– Multiple Products– In the space for over a decadePanasonic– Works outside in broad daylight– $2,600
  34. 34. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteNeural Interfaces:Conscious and Non-ConsciousHigh fidelity EG acquisition deviceNo conductive gel, etc.Non-invasiveUse Case Examples:• Conscious: mind manipulation of objects• Non-Conscious: Ranking music• First target market: gaming• $300!!!
  35. 35. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteEmotivTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  36. 36. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteWe are within a decade of building the Holodeck“The Ultimate NUI Application”
  37. 37. itcampro@ itcamp13# Premium conference on Microsoft technologiesKeynoteHoloDesk - Direct 3D Interactions with aSituated See-Through DisplayTim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
  38. 38. itcampro@ itcamp13# Premium conference on Microsoft technologiesSummaryWe are at the cusp of a revolution in software & hardwareUsing Natural User Interface (NUI) technologies improve the UserExperienceThe hardware, tools, plumbing and platforms for NUI computing arepowerful and available now.…and will just continue to get better, cheaper, powerful andmore availableWithin a realistic time frame NUI computing will be the normThe concepts of NUI change the way we design and build softwareThere are a number of design tenants that can enhance User Experience
  39. 39. itcampro@ itcamp13# Premium conference on Microsoft technologiesMore info on InterKnowlogy:www.InterKnowlogy.comwww.vimeo.com/InterKnowlogyMore info on Actus Software:◦www.Actus-Software.comAbout Tim Huckaby…◦Founder/Chairman, InterKnowlogy◦Founder/Chairman, Actus Software◦Microsoft® Regional Director – SouthernCalifornia◦Microsoft® .NET Partner Advisory CouncilFounder / Member◦Microsoft® MVP – Kinect for Windows◦INETA Speaker – International .NET Users GroupAssociation◦Board Member: Association for CompetitiveTechnology◦Board Member: Microsoft Healthcare PartnerAdvisory Board◦Author / SpeakerContact me:E-mail:TimHuck@InterKnowlogy.comTimH@Actus-Software.comPhone:• Office: 760-444-8640• Mobile:: 619 990 9200Blog:http://team.interknowlogy.com/blogs/timhuckabyFaceBook:http://www.facebook.com/Tim.Huckaby.CarlsbadLinkedIn:http://www.linkedin.com/in/timhuckabyTwitter: @TimHuckabyTim Huckaby
  40. 40. itcampro@ itcamp13# Premium conference on Microsoft technologiesQ & A

×