0
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Human-Com...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
“The deta...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
How about...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Haptic  ...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
M. O’Mall...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Interacţi...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Interacţi...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
some gest...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
locomotio...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
discussion
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
optical m...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Konami Da...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Interacţi...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
tangible ...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
multimoda...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
multimoda...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Interacţi...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
multimoda...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
multimoda...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
multimoda...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
natural i...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
ubiquitou...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
“Conclusi...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
sensorial...
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Good luck!
Upcoming SlideShare
Loading in...5
×

HCI 2014 (10 of 10): Natural User Interfaces. Ubiquitous Computing

620

Published on

Key concepts about sensorial experience, natural user interfaces, multimodal interaction, and ubiquitous computing. See also http://profs.info.uaic.ro/~busaco/teach/courses/hci/hci-film.html

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
620
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
39
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "HCI 2014 (10 of 10): Natural User Interfaces. Ubiquitous Computing"

  1. 1. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Human-Computer Interaction from natural interaction to ubiquitous computing
  2. 2. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco “The details are not the details. They make the design.” Charles Eames
  3. 3. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco How about interacting with “special” devices offering non-conventional interfaces?
  4. 4. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Sense Relevant information Audio Speech, Identity, Intonation, Precision (timing) Vision Identity, Facial expression, Body language, Gesture, Accuracy (spatial) Tactile/ somesthetic Tabs/pads/devices, Texture, Precision (timing), Accuracy (spatial) Scent Atmosphere, likability Taste Clarification, enjoyment
  5. 5. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience The interpretation of sensorial data depends on user expectations
  6. 6. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience M. Nielsen, T. Moeslund, M. Storring & E. Granum (2008)
  7. 7. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Also, the interpretation of sensorial data depends on specific input devices (K. Hinckley, ‘08)
  8. 8. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Also, the interpretation of sensorial data depends on specific input devices (K. Hinckley, ‘08) mouse, trackball, isometric joystick, touchpad, touchscreen, pen-operated device, camera, microphone, indirect table,…
  9. 9. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes specify how an user interface responds to user actions
  10. 10. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes specify how an user interface responds to user actions for a particular manner of performing a task, UI adopts a specific mode if the interpretation of this task is always the same
  11. 11. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes when a task has a different interpretation, the UI offers another interaction mode
  12. 12. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes when a task has a different interpretation, the UI offers another interaction mode modal vs. modeless interaction
  13. 13. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes an interface could be modal for a given action, and modeless for another (Jef Raskin, 2000) if an UI is considered modeless, then that UI must not be modal for any other action
  14. 14. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience Interaction modes changing the interaction mode should have a solid motivation …even in the context of (mobile) Web
  15. 15. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Haptic  Gesture  Locomotion Auditory & Voice  Tangible
  16. 16. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI (O’Malley & Gupta, 2008) based on tactile sensations to provide information
  17. 17. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI (O’Malley & Gupta, 2008) based on tactile sensations to provide information typical examples: haptic screen for “touching” objects natural output – e.g., vibrations (via tactons)
  18. 18. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI cutaneous touch versus kinesthetic touch
  19. 19. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI important usages: CAD (Computer-Aided Design) design prototyping product evaluation simulation of exceptional situations remote task execution (tele-operation) mobile computing
  20. 20. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI usually, a haptic environment is defined by a formal model
  21. 21. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction example: virtual wall – used in 3D games/simulations
  22. 22. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI fixed haptic interfaces haptic joysticks pen-based haptic devices floor- and ceiling-mounted interfaces
  23. 23. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco M. O’Malley, A. Gupta, “Haptic Interfaces”, in P. Kortum (Ed.), HCI Beyond the GUI, Elsevier, 2008
  24. 24. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI portable haptic interfaces exoscheletons
  25. 25. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Light Exoskeleton (L-Exos) described by Frisoli et al. (2005)
  26. 26. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction PowerArm HCI project: Arduino, Android & Unity3D Dan-Gabriel Bratu, Daniel Vicol, Sergiu Recean (FII, 2013) http://profs.info.uaic.ro/~stefan.negru/studentprojects/powerarm.html case study
  27. 27. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI tactile interfaces could detect heat, pressure, vibrations, pain the feedback is usually provided by the user fingers
  28. 28. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI tactile interfaces vibrotactile interfaces wearable tactile interfaces
  29. 29. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI tactile interfaces vibrotactile interfaces wearable tactile interfaces useful in the context of user accessibility
  30. 30. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Moose haptic interface (O’Modhrain & Gillespie, 1995) https://ccrma.stanford.edu/files/papers/stanm95.pdf case study
  31. 31. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction AHNE – Audio-Haptic Navigation Environment (SOPI Research Group, Aalto University, 2011) user tracking via Kinect + OpenNI & OSCeleton http://vimeo.com/28447850 case study
  32. 32. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI aspects regarding human factors: understanding bio-mechanical, sensorial-motor, and cognitive abilities of users (Tan et al., 1994)
  33. 33. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI accuracy of movement measurement (position, velocity, acceleration)
  34. 34. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI accuracy of movement measurement (position, velocity, acceleration) in the mobile Web context, see HTML5 APIs – e.g., Touch, Proximity, Vibration, Screen Orientation, Gamepad, Media Capture http://www.w3.org/standards/techs/js#w3c_all
  35. 35. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI design principles: base your mechanical design on the inherent capabilities of the human operator
  36. 36. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI design principles: consider human sensitivity to tactile stimuli
  37. 37. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI design principles: use active rather than passive movement
  38. 38. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI design principles: minimize confusion and control instabilities
  39. 39. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI design principles: ensure realistic display of environments with tactile devices
  40. 40. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI specific uses: (tele-)medicine e.g., laparoscopic surgery simulator, palpation simulator
  41. 41. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI specific uses: 3D surface modeling example: Geomagic OpenHaptics Toolkit (C++) http://www.geomagic.com/en/products/open-haptics
  42. 42. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI specific uses: learning the interaction with touchscreen devices
  43. 43. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Haptic UI specific uses: digital art dance – Edinburgh experiments (2012): http://tinyurl.com/k7kcap4 cinema – GATech PhD thesis (2011): http://hdl.handle.net/1853/39500 installation – Middlesex (2014): http://youtu.be/_3ECYqu61ZQ sculpture – University of Guelph (2012): http://dhlguelph.com/art/
  44. 44. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Pseudo-Haptic UI (software) emulation of a haptic device
  45. 45. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Pseudo-Haptic UI sensorial substitution (Lenay et al., 2003) a haptic stimulus is substituted by another sense (e.g., an audio signal simulating the contact with virtual objects)
  46. 46. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Pseudo-Haptic UI offering pseudo-haptic feedback (Anatole Lecuyer, 2007) simulation of stiffness via a combination of the interaction with the input device & the visual feedback pseudo-haptic simulation of textures
  47. 47. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Simulation-based Palpation using Pseudo-haptic Feedback (Min Li et al., 2012) www.youtube.com/watch?v=OcIczYCUkmc case study
  48. 48. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction inspired by non-verbal interactions between people
  49. 49. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction inspired by non-verbal interactions between people alternative or complementary to traditional interactions “tap is the new click”
  50. 50. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction “While natural gestures are often subtle, gesture interfaces rely on emphasized gestures.” M. Nielsen et al., 2008
  51. 51. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction types: hand gestures for pointing out objects or controlling a mouse-like pointer
  52. 52. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Interacţiune neconvenţională
  53. 53. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction types: motion-tracking interfaces used by several game consoles or laptops
  54. 54. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction types: facial gestures useful in detection of reactions and emotions
  55. 55. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction usually, based on specific input devices mechanical/magnetic – e.g., mouse, data glove, Wii,… single/multi-point touch example: iPhone
  56. 56. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction could be “invisible” for the user detecting gestures via computer vision: segmentation – extracting the relevant fragments tracking – detecting the movements of interest classification – obtaining the desired information (e.g., via machine learning, neural nets,…)
  57. 57. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Interacţiune neconvenţională general architecture of a gesture-based interactive system (Moustakas et al., 2006)
  58. 58. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction gesture classification: semantic – the meaning of a gesture functional – what the gesture does in an interface descriptive – how the gesture is performed
  59. 59. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction functionally, gestures can signify: command – Quit, Undo, Configure pointing – e.g., selecting an item of interest manipulation – example: scaling/rotating an image control – emulates the control over an entity
  60. 60. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction dynamic & spatial-temporal “classical” gestures performed via an input device: mouse, stylus,…
  61. 61. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction common gestures for Android devices: touch, long press, swipe (drag), double touch, pinch http://developer.android.com/design/patterns/gestures.html case study
  62. 62. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction the interaction vocabulary should be limited we must assure an optimal interaction space (spatial zone)
  63. 63. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction “special” interactive zones having specific semantics
  64. 64. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction technology- versus human-based gestures causes of discomfort: stressful/fatigue producing for the user nearly impossible for some people to perform illogically imposed functionality
  65. 65. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco some gestures easily recognizable by software meanings/actions difficult to be understood/performed by the human users: T0: without signification (residue) T1: select T2: copy & paste T3: delete T4, T5: menu/release
  66. 66. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction a gesture-based UI must: be intuitive take into consideration the user mental model be easy to learn & deployed (ergonomics)
  67. 67. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction practical design advices: be tolerant to human errors beware of cultural factors consider the context provide positive feedback
  68. 68. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction patterns for touchscreens & interactive surfaces (Dan Saffer, 2009) tap to open/activate tap to select drag to move object slide to scroll, spin to scroll
  69. 69. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction patterns for touchscreens & interactive surfaces (Dan Saffer, 2009) slide and hold for continuous scroll tap to stop pinch to shrink and spread to enlarge two fingers to scroll
  70. 70. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction gesture notation (Luke Wroblewski)
  71. 71. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Cue – a set of icons to build a standard visual language of touch-based interactions (P.J. Onori) http://somerandomdude.com/work/cue/
  72. 72. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction patterns for free-form interactive gestures (Dan Saffer, 2009) move body to activate point to select/activate wave to activate place hands inside to activate
  73. 73. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Gesture interaction patterns for free-form interactive gestures (Dan Saffer, 2009) rotate to change state step to activate shake to change tilt to move
  74. 74. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco locomotion design
  75. 75. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces interfaces that both enable users to move around in real or virtual spaces and make users feel as if they are moving Mary C. Whitton & Sharif Razzaque, 2008
  76. 76. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces could be virtual, not only physical
  77. 77. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces could be virtual, not only physical main problem: to capture the user’s intent using data that can be derived from sensing the pose (position and orientation) and movement of the user’s body
  78. 78. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco discussion
  79. 79. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces perceiving self-motion each sensorial channel (visual, auditory, vestibular,…) is used in detection of user or surrounded objects movement Dichgans & Brandt, 1977
  80. 80. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces detection of pose and motion artificial sensors (trackers) optical motion capture mechanical solutions
  81. 81. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco optical motion capture optical motion capture exoskeleton trackers
  82. 82. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Konami DanceDance Revolution in the e-learning context www.ddrclassroomedition.com/ case study
  83. 83. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces providing feedback to user(s) visual information: head-mounted displays surround-screen displays
  84. 84. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces walking simulation treadmills (Brooks, 1998; Hollerbach et al., 2000) walking-in-place (WIP) interfaces
  85. 85. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction VirtuSphere www.virtusphere.com case study
  86. 86. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces design principles (Whitton & Razzaque, 2008): making the interface feel natural higher-fidelity reproduction of human gait avoiding simulator sickness (cyber-sickness)
  87. 87. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces issues that can be detected in the testing phase: realism & preservation of spatial understanding cognitive distraction break-in-presence (BIP) events
  88. 88. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction an action that causes break-in-presence (virtual scenephysical location)
  89. 89. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces advice: match the locomotion metaphor to the interface goals walking metaphor versus vehicle metaphor
  90. 90. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces practical considerations: Is viewing direction independent of motion direction? Are hands used for locomotion? Able to move in any direction and change direction easily? Can walking speed or step length be set for each user?
  91. 91. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Locomotion interfaces practical considerations: Are tracker sensors immune to other signals in the room? Are wireless trackers used? What parts of body will have sensors/markers on them? Cables – if any – interfere with user’s motion?
  92. 92. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Interacţiune neconvenţională auditory & vocal interactions
  93. 93. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces using non-speech audio information for interaction for details, see (S. Camille Peres et al., 2008)
  94. 94. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces motivations & uses: presenting information to visually impaired people providing an additional information channel alerting people to error or emergency states of a system providing information via devices with small screens
  95. 95. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces why an audio interaction? reducing visual overload reinforcing visual messages when eyes are elsewhere when audio is more informative conveying emotion – e.g., for electronic games
  96. 96. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces sonification = using non-speech sound to render data the simplest method is audification
  97. 97. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces representational auditory icons abstract earcons Stephen Brewster (2008)
  98. 98. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces
  99. 99. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces problems regarding the audio interaction: annoyance privacy auditory overload interference/masking low resolution lack of familiarity
  100. 100. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces aspect of interest: the tasks performed by the user via an audio interface
  101. 101. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces aspect of interest: what (kind of) information could be exclusively represented by sounds?
  102. 102. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces aspect of interest: the suitable format audio – lossless vs. lossy – to be used FLAC, PCM, WAV versus AAC, OGG, MP3
  103. 103. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Auditory interfaces aspect of interest: producing the sound thinking about sound as information designing the sound – consider auditory content as a kind of sound ecology (Walker & Kramer, 2004)
  104. 104. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction audio-only games – http://www.audiogames.net/list-games/ case study
  105. 105. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces facilitating the conversation between software and user
  106. 106. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces important aspect: speech recognition
  107. 107. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces user perceptions regarding a VUI are fragile lack of trust (Susan Hura, 2008)
  108. 108. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces users interact generally via prompts “Hello, you have to choose from the following options…”
  109. 109. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces several discourse makers are needed for: confirmation – “yes, of course”, “alright” changing the topic of conversation emphasizing a statement – “as we previously said…” narrative sequences – “so,…”
  110. 110. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces problem: the lack of concision “I can help you with the following five options. You can interrupt me and speak your choice at any time. Please, select one of the following: sign up for new service, add features to my service, move my existing service, problems with my satellite service, or ask a billing question.”
  111. 111. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces problem: dealing with errors “I’m sorry. I did not understand your response. I can help you with the following five options…” inducing the feeling of user culpability
  112. 112. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces problem: increasing the user discomfort “Please say or enter your account number!” the user cannot control the interface
  113. 113. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces problem: using the same message (in different contexts) “Attention! I don’t understand! Please, indicate the correct answer!... Attention! I don’t understand! Please, indicate the correct answer!... Attention! I don’t understand! Please, indicate the correct answer!...”
  114. 114. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces speech recognition – main phases (Cohen et al., 2004)
  115. 115. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: present menu options in a way that makes them comprehensible and easy to retain
  116. 116. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: consider error sources when writing error-handling prompts
  117. 117. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: provide context VUI: You can say: account balances, last contribution, transfers, allocations, or life insurance. User: Transfers. VUI: Transfers. You can say: hear pending transfers or make a transfer.
  118. 118. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: use hints and reminders “Next time, you can say ‘order status’ at the main menu to get here quicker.” “You can speak your account number or key it in.”
  119. 119. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: favor models over instructions learning by doing
  120. 120. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: use discourse markers liberally using in conversation common expressions like “all right”, “next”, “thanks”,…
  121. 121. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: allow for conversational repair
  122. 122. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces design guidelines: be careful with terminology
  123. 123. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Voice user interfaces recent examples in the mobile context: Cortana (Windows Phone) Google Now (Android) Siri (iOS) SpeakToIt Assistant (Android, iOS, Windows Phone,…)
  124. 124. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction case study
  125. 125. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco tangible interfaces
  126. 126. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible interfaces digital informationphysical form (representation) Hiroshi Ishii digital content could be directly perceived & manipulated
  127. 127. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible interfaces key components: control – permits users to manipulate the content external representations – perceived by human senses
  128. 128. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction
  129. 129. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible interfaces
  130. 130. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible Manipulation haptic direct manipulation lightweight interaction isomorph effects Spatial Interaction inhabited space configurable materials visual access full body interaction performative action Embodied Facilitation embodied constraints multiple access points tailored (adaptive) representations Expressive Representation representational significance externalization perceived coupling Eva Hornecker (2010) see also www.ehornecker.de/TangiblesFramework.html
  131. 131. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible Interaction Conceptual Framework responding to key design questions via cards Can users grab, feel and move “the important stuff”? Do people and objects meet and invite into interaction? Can you create a meaningful place with atmosphere? Are representations legible, meaningful, and expressive? https://personal.cis.strath.ac.uk/eva.hornecker/tang_framework_cards.pdf
  132. 132. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Tangible interfaces for other resources & demos, consult: www.interaction-design.org/encyclopedia/tangible_interaction.html http://mas834.media.mit.edu/ http://vimeo.com/search?q=tangible
  133. 133. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco multimodal interaction
  134. 134. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco multimodal interaction Processing two or many inputs – voice, gestures, tactile, etc. – in a coordinated manner in order to obtain a complex output (e.g., multimedia, 3D) or to perform a task Sharon Oviatt, 2008 Paulo Barthelmess & Sharon Oviatt, 2008
  135. 135. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Interacţiune multimodală
  136. 136. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco multimodal interaction Diverse contexts are considered from mobile interfaces to collaborative systems virtual and/or augmented reality
  137. 137. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco multimodal interaction Advantages: error reduction via mutual disambiguation increasing user performance
  138. 138. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco multimodal interaction Issues to be resolved: linguistic factors redundancy & complementarity choosing the “right” multi-/mono-modal input cognitive load
  139. 139. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction discussion designing multimodal interaction for info kiosks
  140. 140. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction discussion designing multimodal interaction for info kiosks aspects of interest (M. Maguire, 1999): choosing a suitable location encouraging use providing instructions for using the system user privacy multiple input methods: touch, speech, keypad proper output: language, color, images, feedback,… navigation possibilities http://ui4all.ics.forth.gr/UI4ALL-97/maguire.pdf
  141. 141. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing
  142. 142. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing “Invisibly enhancing the world that already exists.” (Mark Weiser, 1988)
  143. 143. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing “Invisibly enhancing the world that already exists.” (Mark Weiser, 1988) ubicomp pervasive computing ambient intelligence (AmI) physical computing everyware
  144. 144. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing “Invisibly enhancing the world that already exists.” (Mark Weiser, 1988) can occur using any device, in any location, and in any format computers disappear in the environment
  145. 145. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Related topics of research: context awareness distributed & mobile computing Internet of Things (IoT) + wireless sensor networks
  146. 146. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices Mark Weiser’s initial proposals (1991) tabs – centimeter-sized devices: PDAs, voice recorders, smartphones, smartwatches,… vision: individuals own many of them and they can all communicate with each other and environment
  147. 147. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction interacting with a smartwatch via widgets example: SmartWatch (Sony) http://developer.sonymobile.com/tag/smartwatch/ discussion
  148. 148. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices Mark Weiser’s initial proposals (1991) pads – handheld decimeter-sized devices: tablets, laptops, e-readers, etc. vision: an individual owns several, but it’s not assumed to be always with them
  149. 149. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices Mark Weiser’s initial proposals (1991) boards – meter-sized interactive devices: mounted walls, e-tables, smart info kiosks,… vision: buildings or institutions own them and lots of people used them
  150. 150. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Virtual Reality term coined by Jaron Lanier (1989) a computer-based simulated 3D environment intended for its users to inhabit and to interact via avatars an interface between the “physical” reality and a virtual environment discussion
  151. 151. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction Augmented Reality term coined by Thomas Caudell (1990) the use of technology which allows the perception of the physical world to be enhanced or modified by computer-generated stimuli perceived with the aid of special equipment generation of virtual objects merged into real scenes discussion
  152. 152. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction reality-virtuality continuum (Milgram & Kishino, 1994) see also www.slideshare.net/busaco/from-virtual-to-augmented-reality discussion
  153. 153. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices new proposals (Stefan Poslad, 2009) dust – miniaturized devices without visual output smartdust: a system of many tiny micro- electromechanical systems (MEMS) that can detect light, temperature, vibration, magnetism, chemicals,…
  154. 154. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices new proposals (Stefan Poslad, 2009) skin – fabrics based upon light emitting, conductive, polymers, organic computer devices smart clotheswearable computing
  155. 155. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco natural interaction T-Shirt-OS – 1024 pixels grid controlled by an app + built-in micro-camera, mic, accelerometer & speakers case study
  156. 156. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing Scales of devices new proposals (Stefan Poslad, 2009) clay – ensembles of MEMS that can be formed into arbitrary 3D shapes, resembling physical objects remember tangible interfaces?
  157. 157. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing For various projects and demos, see UbiComp conference proceedings UbiComp 2013: www.ubicomp.org/ubicomp2013/adjunct/forms/adjunct.htm
  158. 158. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing: future Brain-Computer Interface direct communication between the brain and an external device assisting, augmenting, or repairing human cognitive or sensory-motor functions
  159. 159. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco ubiquitous computing: future Alexis Ortiz-Rosario, Hojjat Adeli, “Brain-Computer Interface Technologies: from Signal to Action”, Reviews in the Neurosciences, 24 (5), 2013
  160. 160. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco “Conclusion” The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it. Mark Weiser, “The Computer for the 21st Century”, Scientific American, 265 (3), 1991
  161. 161. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco sensorial experience  natural user interfaces multimodal interaction  ubiquitous computing “Conclusion”
  162. 162. Master on Software Engineering :: Human-Computer Interaction Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco Good luck!
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×