Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Challenges in Designing a Menu System with Touch-less Technology

2,443 views

Published on

Lecture presented by Shachar Oz at UXI conference in February 2012 (http://uxi.org.il/pages/13265).
Shachar is a game and user experience designer at Omek Interactive Studios. For more information on Omek and its products, visit www.omekinteractive.com

Published in: Design, Technology, Art & Photos
  • Be the first to comment

Challenges in Designing a Menu System with Touch-less Technology

  1. 1. CHALLENGES IN DESIGNING A MENU SYSTEM WITH DEPTH MOTION SENSOR TECHNOLOGY Shachar Oz Game & UX Designer Omek Interactive Studios© Omek Interactive, Ltd. All rights reserved.
  2. 2. MENUS ARE FORGOTTEN ABOUT . OR, WHAT CAN DRIVE USERS CRAZY ?© Omek Interactive, Ltd. All rights reserved.
  3. 3. © Omek Interactive, Ltd. All rights reserved.
  4. 4. MENU SYSTEM DESIGN GUIDELINES • Confident users understand: – where they are – where they were – what can they do – how can they do it© Omek Interactive, Ltd. All rights reserved.
  5. 5. 3D DEPTH SENSOR OR, WHAT IS IT ?© Omek Interactive, Ltd. All rights reserved.
  6. 6. 3D DEPTH SENSOR OR, WHAT IS IT ?© Omek Interactive, Ltd. All rights reserved.
  7. 7. TOUCH-BASED TECHNOLOGY© Omek Interactive, Ltd. All rights reserved.
  8. 8. TOUCH-LESS TECHNOLOGY© Omek Interactive, Ltd. All rights reserved.
  9. 9. TOUCH-LESS TECHNOLOGY© Omek Interactive, Ltd. All rights reserved.
  10. 10. DEPTH MOTION CAPTURE  Body tracking × Tangible feedback  Natural gestures × 100% stability  Free from controllers × Accuracy© Omek Interactive, Ltd. All rights reserved.
  11. 11. CHALLENGES OR, HOW TECHNOLOGY INFLUENCE DESIGN ?© Omek Interactive, Ltd. All rights reserved.
  12. 12. CHALLENGES OF MOTION CAPTURE • Feeling of a click : virtual tangibility • Active & inactive modes • Am I in control ? • Inner delay of the interface© Omek Interactive, Ltd. All rights reserved.
  13. 13. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes : differentiate between user behaviors • Am I in control ? • Inner delay of the interface© Omek Interactive, Ltd. All rights reserved.
  14. 14. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes • Am I in control ? feedback for the users • Inner delay of the interface© Omek Interactive, Ltd. All rights reserved.
  15. 15. CHALLENGES OF MOTION CAPTURE • Feeling of a click • Active & inactive modes • Am I in control ? • Inner delay of the interface : cannot predict the user© Omek Interactive, Ltd. All rights reserved.
  16. 16. DEALING WITH CHALLENGES SELECTING AND SCROLLING ITEMS© Omek Interactive, Ltd. All rights reserved.
  17. 17. Selecting Items • Click gesture : imitate mouse • Hot-spot • Grand gesture • Swipe in • Grab gesture© Omek Interactive, Ltd. All rights reserved.
  18. 18. © Omek Interactive, Ltd. All rights reserved.
  19. 19. Selecting Items • Click gesture • Hot-spot • Grand gesture : grandiose arm movement • Swipe in • Grab gesture© Omek Interactive, Ltd. All rights reserved.
  20. 20. Selecting Items • Click gesture • Hot-spot • Grand gesture • Swipe in : continuous feedback • Grab gesture© Omek Interactive, Ltd. All rights reserved.
  21. 21. Selecting Items • Click gesture • Hot-spot • Grand gesture • Swipe in • Grab gesture : pinch or fist© Omek Interactive, Ltd. All rights reserved.
  22. 22. Selecting Items Gran Grab Click d ge Hot- Swip gest g estu sture sp e in ure ot re Responsiveness v x v v v Active & v x v ½ ½ inactive Stablilty x v v v ½ Comfortable ½ v x v v Usability v v x ½ ½© Omek Interactive, Ltd. All rights reserved.
  23. 23. Scrolling Items • 2D cursor : imitate mouse • 1D cursor • Static active spot • Dynamic active spot • Grand gesture© Omek Interactive, Ltd. All rights reserved.
  24. 24. Scrolling Items • 2D cursor • 1D cursor : scroll on one axis • Static active spot • Dynamic active spot • Grand gesture© Omek Interactive, Ltd. All rights reserved.
  25. 25. Scrolling Items • 2D cursor • 1D cursor • Static active spot : magnifying glass • Dynamic active spot • Grand gesture© Omek Interactive, Ltd. All rights reserved.
  26. 26. Scrolling Items • 2D cursor • 1D cursor • Static active spot • Dynamic active spot : magnifying glass++ • Grand gesture© Omek Interactive, Ltd. All rights reserved.
  27. 27. Scrolling Items • 2D cursor • 1D cursor • Static active spot • Dynamic active spot • Grand gesture : grandiose arm movements© Omek Interactive, Ltd. All rights reserved.
  28. 28. Scrolling Items Gran Stati activ Dyna t 2D c 1D c d ge spot c act e spo sture urso urso mic ive r Responsiveness r v v ½ v v Active & v v x v v inactive Stablilty ½ v ½ v v Comfortable v ½ v ½ x Usability v v ½ v x© Omek Interactive, Ltd. All rights reserved.
  29. 29. Pagination • Just another button: hot-spot / click • Grand gesture: Minority Report • Drag n’ drop: scroll the entire list© Omek Interactive, Ltd. All rights reserved.
  30. 30. User Real Location • Camera view: what the camera sees? • B&W: grey scale colors • Freeze!: control over the character • Trapezoid: view playfield from up • Note over character: main area of concern© Omek Interactive, Ltd. All rights reserved.
  31. 31. Feeling of a Click© Omek Interactive, Ltd. All rights reserved.
  32. 32. CONCLUSIONS OR, WHAT DID WE LEARN ?© Omek Interactive, Ltd. All rights reserved.
  33. 33. Conclusions • Tracking: essential constant feedback • Gesture: toggle action modes© Omek Interactive, Ltd. All rights reserved.
  34. 34. Conclusions • Tracking: essential constant feedback • Gesture: toggle action modes© Omek Interactive, Ltd. All rights reserved.
  35. 35. User Expectations • One hand based control scheme • Grandiose gestures only once in a while • Constant feedback for each movement© Omek Interactive, Ltd. All rights reserved.
  36. 36. Depth Sensor Menu Design Guidelines • Consistency • Simplicity • Feeling of control • Feedback • Comfortable© Omek Interactive, Ltd. All rights reserved.
  37. 37. Future Experiments • Sound based feedback (for blind) • Speech based / speech components© Omek Interactive, Ltd. All rights reserved.
  38. 38. References • Frosted Glass / CAMPAR • EyeSight • Dance Central / Harmonix • Adrenaline Misfits / Konami • Omek Interactive Studios • Media Center / Primesense • PointGrab • Powerup Heroes / Ubisoft • Huang J., White R.W., Buscher G. (2012). User See, User Point: Gaze and Cursor Alignment in Web Search. CHI’12, May 5–10, 2012, Austin, Texas, USA© Omek Interactive, Ltd. All rights reserved.
  39. 39. Thank You For Listening , Shachar Oz Game & UX Designer Omek Interactive Studios www.OmekInteractive.com Shachar@OmekInteractive.com

×