Dynamics and Interaction Steven Strachan, Roderick Murray-Smith Hamilton Institute, NUI Maynooth & Department of Computing...
Dynamics & Interaction group <ul><li>Led by Roderick Murray-Smith </li></ul><ul><ul><li>Two-campus group. Based in The Ham...
Control in HCI? <ul><li>More and more devices are incorporating inertial sensing… </li></ul><ul><li>What new kinds of inte...
From  ‘look-and-feel’  to  ‘ handling qualities’? <ul><li>Moving from discrete event -based systems like this: </li></ul><...
Dynamics & Statistics in HCI? <ul><li>Why introduce  dynamics   – is that not harder? </li></ul><ul><ul><li>We can only co...
Mobile Sensing:  MESH hardware description <ul><li>Built by MLE Palpable Machines group. </li></ul><ul><li>Modality Enhanc...
Next sensor pack.. SHAKE <ul><li>Our next generation pack… </li></ul><ul><li>Bluetooth, wireless and compact </li></ul><ul...
Multimodal feedback from active inquiry Model-based interaction design  –  physical interaction with abstract concepts
Shoogle - Informative Shaking <ul><li>Shake the phone to feel (and hear) content discreetly </li></ul><ul><li>Only produce...
BodySpace Using constraints in the environment
BodySpace <ul><li>With MLE Palpable machines group – Jussi Angesleva, Ian Oakley, Sile O’Modhrain </li></ul>
Example Application <ul><li>Gesture controlled music player </li></ul><ul><li>Volume is controlled at the hip. </li></ul><...
Location-Aware Interaction
gps Tunes <ul><li>Whereable  computing…. </li></ul><ul><li>Location-Aware audio feedback </li></ul><ul><li>Quickening usef...
GPS Navigation Problem <ul><li>GPS is useful but inaccurate </li></ul><ul><ul><ul><li>Inaccuracy varies in a complex way <...
Uncertain Display <ul><li>Poor displays lead to poor control </li></ul><ul><ul><ul><li>Norman's example of  The Royal Maje...
Uncertainty in GPS Navigation <ul><li>Represent and display the true uncertainty of the navigation system – make it “hones...
Particle GPS Browsing <ul><li>Map browsing; include uncertainty about where we are </li></ul><ul><li>Project forward, find...
Relevance to the mobile internet… <ul><li>Mobile devices are by definition  ‘mobile’. </li></ul><ul><li>Traditional method...
Scenario…
Scenario… you are here
Scenario… you are here you are here
Scenario… you are here you are here you are here
Scenario… you are here you are here
Scenario… you are here you are here
<ul><li>Social interactions?… </li></ul><ul><li>Real-time interaction with people in your social network… </li></ul>
Outlook <ul><li>Dynamics allow intelligence to be sandwiched into an interface </li></ul><ul><ul><li>‘ look-and-feel’  of ...
Upcoming SlideShare
Loading in …5
×

Steven Strachan - Dynamics and Interaction

3,347 views

Published on

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,347
On SlideShare
0
From Embeds
0
Number of Embeds
44
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Steven Strachan - Dynamics and Interaction

  1. 1. Dynamics and Interaction Steven Strachan, Roderick Murray-Smith Hamilton Institute, NUI Maynooth & Department of Computing Science, University of Glasgow [email_address] http://www.dcs.gla.ac.uk/~rod http://www.dcs.gla.ac.uk/~rod/Videos.html With John Williamson, Parisa Eslambolchilar, Andy Crossan, Vuokko Lantz, James Kelly, Stephen Brewster, Andrew Ramsay May 2007
  2. 2. Dynamics & Interaction group <ul><li>Led by Roderick Murray-Smith </li></ul><ul><ul><li>Two-campus group. Based in The Hamilton Institute & The University of Glasgow </li></ul></ul><ul><ul><li>Dr Murray-Smith spent 7 years at Daimler-Benz research in Berlin, followed by M.I.T. and Technical University of Denmark. </li></ul></ul><ul><ul><li>Exploring the overlap between control theory, machine learning, probabilistic reasoning and human-computer interaction design. </li></ul></ul><ul><ul><li>Leading group in novel forms of interaction design for mobile interaction. Act as consultants for Nokia, Samsung and Microsoft. </li></ul></ul><ul><li>Current staff: </li></ul><ul><ul><li>Dr. Steven Strachan (NUIM) </li></ul></ul><ul><ul><li>Dr. John Williamson (GU) </li></ul></ul><ul><ul><li>Andrew Ramsay (GU) </li></ul></ul><ul><ul><li>Stephen Hughes (GU) </li></ul></ul>
  3. 3. Control in HCI? <ul><li>More and more devices are incorporating inertial sensing… </li></ul><ul><li>What new kinds of interface can we develop with this new sensing capability? </li></ul><ul><li>Think of user and device as being in a loop of control… </li></ul>
  4. 4. From ‘look-and-feel’ to ‘ handling qualities’? <ul><li>Moving from discrete event -based systems like this: </li></ul><ul><li>To continuous control like this? </li></ul>
  5. 5. Dynamics & Statistics in HCI? <ul><li>Why introduce dynamics – is that not harder? </li></ul><ul><ul><li>We can only control what we can perceive . </li></ul></ul><ul><ul><li>Dependent on feedback, so upper limits on the speed of change of display. </li></ul></ul><ul><ul><ul><li>Large steps in entropy are unnatural & error-prone </li></ul></ul></ul><ul><ul><li>Dynamics allows us to slip in ‘intelligence’ which couldn’t be done with a static interaction technique </li></ul></ul><ul><li>Why uncertain interaction? </li></ul><ul><ul><li>Uncertainty in user’s mind about what to do next, and system uncertain about user’s intentions. </li></ul></ul><ul><ul><li>With mobile devices, interaction with the user is now continuous instead of discrete, and input devices are noisier. </li></ul></ul><ul><li>‘ Honest’ interfaces </li></ul><ul><ul><li>Can lead to smoother interaction, with user behaviour regularised appropriately (e.g. K ö rding & Wolpert) </li></ul></ul>
  6. 6. Mobile Sensing: MESH hardware description <ul><li>Built by MLE Palpable Machines group. </li></ul><ul><li>Modality Enhancing Sensor-pack for Handhelds </li></ul><ul><li>Designed for the IPAQ range of pocket PCs </li></ul><ul><li>Physical design same as the PCMCIA expansion jacket </li></ul><ul><li>Triple-Axis acceleration sensing </li></ul><ul><ul><li>MEMS Accelerometers </li></ul></ul><ul><ul><li>Orientation sense and gesture capture </li></ul></ul><ul><li>High Fidelity Vibrotactile Display </li></ul><ul><ul><li>Sample based, Non-Volatile sample storage,Audio bus-driven option </li></ul></ul><ul><ul><li>Actuator – VBW32 rewound </li></ul></ul><ul><li>Triple-axis magnetometer </li></ul><ul><ul><li>Orthogonal Magneto-Resistive elements </li></ul></ul><ul><li>Capacitive sensing </li></ul><ul><li>GPS </li></ul>
  7. 7. Next sensor pack.. SHAKE <ul><li>Our next generation pack… </li></ul><ul><li>Bluetooth, wireless and compact </li></ul><ul><li>Accelerometers, gyros, magnetometers and haptic feedback. </li></ul><ul><li>Use for head, device or bimanual gestures. </li></ul>
  8. 8. Multimodal feedback from active inquiry Model-based interaction design – physical interaction with abstract concepts
  9. 9. Shoogle - Informative Shaking <ul><li>Shake the phone to feel (and hear) content discreetly </li></ul><ul><li>Only produces feedback when stimulated </li></ul><ul><li>Simple physical model of objects in a box </li></ul><ul><ul><li>Movement from accelerometers </li></ul></ul><ul><li>Impact with edges produces sound and vibration </li></ul>VIDEO
  10. 10. BodySpace Using constraints in the environment
  11. 11. BodySpace <ul><li>With MLE Palpable machines group – Jussi Angesleva, Ian Oakley, Sile O’Modhrain </li></ul>
  12. 12. Example Application <ul><li>Gesture controlled music player </li></ul><ul><li>Volume is controlled at the hip. </li></ul><ul><li>Track switching is controlled at the ear. </li></ul>VIDEO
  13. 13. Location-Aware Interaction
  14. 14. gps Tunes <ul><li>Whereable computing…. </li></ul><ul><li>Location-Aware audio feedback </li></ul><ul><li>Quickening useful – don’t want user to run back and forth to get gradient! </li></ul><ul><ul><li>Use tilt and bearing to get rapid exploration </li></ul></ul>
  15. 15. GPS Navigation Problem <ul><li>GPS is useful but inaccurate </li></ul><ul><ul><ul><li>Inaccuracy varies in a complex way </li></ul></ul></ul><ul><ul><ul><ul><li>Reflections, shadowing, poor coverage </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Could use hybrid positioning </li></ul></ul></ul></ul><ul><ul><ul><li>General problem – accurate representation of belief and trustworthiness </li></ul></ul></ul>
  16. 16. Uncertain Display <ul><li>Poor displays lead to poor control </li></ul><ul><ul><ul><li>Norman's example of The Royal Majesty </li></ul></ul></ul>“ precise” position
  17. 17. Uncertainty in GPS Navigation <ul><li>Represent and display the true uncertainty of the navigation system – make it “honest” </li></ul><ul><ul><ul><li>realistic display should regularise control behaviour </li></ul></ul></ul><ul><li>Incorporate models </li></ul><ul><ul><ul><li>environment models </li></ul></ul></ul><ul><ul><ul><li>user models </li></ul></ul></ul><ul><li>Monte Carlo sampling is a convenient statistical technique for dealing with uncertainty </li></ul>
  18. 18. Particle GPS Browsing <ul><li>Map browsing; include uncertainty about where we are </li></ul><ul><li>Project forward, find likely locations in the future. </li></ul><ul><li>Show all the possible places we might be, given a map of the area </li></ul><ul><li>User can scan around and project further into the future with inertial control. </li></ul><ul><li>Target points are sonified. </li></ul>Video Demonstration
  19. 19. Relevance to the mobile internet… <ul><li>Mobile devices are by definition ‘mobile’. </li></ul><ul><li>Traditional methods of interaction with the internet are not good in this mobile domain. </li></ul><ul><li>We should acknowledge our current location or context and use this to our advantage. </li></ul><ul><li>Introduce the location-aware internet… </li></ul>
  20. 20. Scenario…
  21. 21. Scenario… you are here
  22. 22. Scenario… you are here you are here
  23. 23. Scenario… you are here you are here you are here
  24. 24. Scenario… you are here you are here
  25. 25. Scenario… you are here you are here
  26. 26. <ul><li>Social interactions?… </li></ul><ul><li>Real-time interaction with people in your social network… </li></ul>
  27. 27. Outlook <ul><li>Dynamics allow intelligence to be sandwiched into an interface </li></ul><ul><ul><li>‘ look-and-feel’ of an interface, ‘noisy channel’, or in control terms, the ‘adaptive handling qualities’? </li></ul></ul><ul><li>The mobile internet has the potential to become a highly-interactive, embodied and location-aware internet… </li></ul>

×