The artificiality of natural user interfaces alessio malizia
The Artificiality of Natural User Interfaces Alessio Malizia, PhD Dept. of Information Systems and Computing, Brunel University
SynopsisResearch areasBackgroundProblem(s)Question(s)HypothesisContributionExpected result
Research areasHuman Computer InteractionNatural User InterfacesInteraction/UX Design
The Artificiality of Natural User Interfaces1960s –CLI 1980s –GUI 2000s –NUICommand Line Interface Graphic User Interface Natural User InterfaceMemorization/Recall Recognition (recall = shortcuts) Recall? Gestures are like shortcuts
ExplorationDon’t touch me!Demo @ACM Int. Conference AVI 2010 TESIS: Turn Every Surface into an Interactive Surface Demo @ACM Int. Conference ITS 2011
Question(s)• How can I create an interface in which users may quickly gain expertise using actions that feel natural to them? (research question 1)• How can I be sure that I succeeded in creating an interface that feels natural to the user? (research question 2)
Hypothesis• Natural properties are related to universals• The concept of affordance is crucial for defining a widget-level architecture for NUI – Interface as a Service – Widgets expose their affordances• Personalization and adaptation/evolution as a step toward natural interaction
I’d like to convince you (thesis)• Gestures (as signs) are something alive, which change depending on cultural and human aspects, time and context. Therefore users’ personalization can be a step to address natural interaction.• Refined research question 1: to what extend personalization of multi-touch gestures can be valuable for enabling natural interaction?
Natural properties and Universals• Concept of perfect natural properties from metaphysics – Perfect natural properties are shared among all the elements of a set• For we humans, perfect natural properties are our perception faculties (hearing, feeling by touch, seeing, tasting, smelling) – There are also acquired skills...• Could there exist such a thing as a natural gesture? – Take into account users innate and learned abilities
Which one is natural? iPhone: pinch for zooming Samsung Galaxy s2: holding down on the screen withZooming in real life: two fingers andbring the newspaper closer moving your phone back and forth
Affordance• Why affordance is important for natural interaction? – Gibson (1977) defined affordances as all action possibilities latent in the environment – Affordances as perceived action possibilities (Norman, 1988) – Affordance is the visual clue to the function of the object (an opportunity for action)
Design without affordanceYou can move an object in single-pixelincrements by nudging it.Touch and hold the object with one finger,and then use another finger to swipe acrossthe page in the direction you want the objectto move. From iPad’s Pages gestures list
References• Alessio Malizia and Andrea Bellucci. 2012. The artificiality of natural user interfaces. Commun. ACM 55, 3 (March 2012), 36-38.• Andrea Bellucci, Alessio Malizia, and Ignacio Aedo. 2011. TESIS: turn every surface into an interactive surface. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 11). ACM, New York, NY, USA.• Andrea Bellucci, Alessio Malizia, Paloma Diaz, Ignacio Aedo, "Human-Display Interaction Technology: Emerging Remote Interfaces for Pervasive Display Environments," IEEE Pervasive Computing, pp. 72-76, April-June, 2010.