PhD defense presentation

891 views

Published on

Presentation for my PhD defense at University of Minho 29 January 2014.

Published in: Education, Technology
2 Comments
1 Like
Statistics
Notes
No Downloads
Views
Total views
891
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
15
Comments
2
Likes
1
Embeds 0
No embeds

No notes for slide

PhD defense presentation

  1. 1. An Interaction Abstraction Toolkit for Public Display Applications Jorge C. S. Cardoso jorgecardoso@ieee.org http://jorgecardoso.eu
  2. 2. Outline ● ● ● ● ● ● Motivation Objective Challenges Interaction Abstractions Evaluation Conclusion
  3. 3. Motivation: “We need to do better”
  4. 4. Motivation Each display uses its own approach to interactivity
  5. 5. Objective: Interaction abstractions for public displays “toolkits for novel and perhaps unfamiliar application areas enhance the creativity of these programmers. By removing low-level implementation burdens and supplying appropriate building blocks, toolkits give people a ‘language’ to think about these new interfaces, which in turn allows them to concentrate on creative designs.” - Greenberg, S. (2007). Toolkits and interface creativity. Multimedia Tools and Applications, 32(2), 139–159.
  6. 6. Interaction in public displays Focus ● Generic information displays ● Multi-user ● Shared environment ● Multiple input devices
  7. 7. Interaction in public displays Challenges ● Very different interaction environment ○ What kind of abstractions are useful? ● No accepted interaction paradigms ○ No accepted set of “controls” ● Variety of interaction mechanisms
  8. 8. SMS
  9. 9. QR Codes
  10. 10. Gestures
  11. 11. Bluetooth
  12. 12. Touch
  13. 13. Keyboard + trackball!
  14. 14. What kind/level of abstractions? ● Footprints for socially-aware display systems ○ Designers ● User Interaction Controls ○ Developers
  15. 15. Footprints for socially-aware display systems What information can the display gather from interactions that can be used for context-aware content adaptation? Focus on adaptation to the social situation around the display Abstract interaction mechanisms and application semantics
  16. 16. Footprints for socially-aware display systems ❏ ❏ Cardoso, J. C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin / Heidelberg. doi:10.1007/978-3-642-052903_21 Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.), Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7
  17. 17. Footprints for socially-aware display systems
  18. 18. User Interaction Controls ❏ Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on Human-Computer Interaction. (under review)
  19. 19. PuReWidgets toolkit for web-based public display applications ● High-level abstractions ○ Widgets ● Various controls ○ Action buttons, list boxes, text entry, download, upload, checkin ● Independence from interaction mechanism ❏ Cardoso, J. C. S., & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press. doi:10.1145/2406367.2406434 (Demo) ❏ Cardoso, J. C. S., & José, R. (2012). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on Pervasive Displays. Porto, Portugal. (Poster) ❏ Cardoso, J. C. S., & José, R. (2012). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac Campos, Simone D. J. Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496
  20. 20. Widgets
  21. 21. Interaction Touch Text-based QR codes (SMS, email, …) ❏ Cardoso, J. C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS Science and and Technology Publications. doi:10.5220/0004707500050013 Mobile interface (Automatically generated)
  22. 22. Toolkit evaluation System scalability API usability Real-world deployment ❏ ❏ Cardoso, J. C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press. doi:10.1145/2541831.2541834 Cardoso, J. C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In R. Meersman, T. Dillon, & P. Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg. doi:10.1007/978-3-642-25126-9_67 Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle
  23. 23. Conclusion: Summary of contributions 1. A framework of digital footprints that designers of public displays can use to map several sensing and interaction features to content adaptation strategies. 2. A design space of interaction tasks and controls that can serve as a basis for programming toolkits that provide high-level interaction widgets. 3. Identification of the fundamental requirements for an interaction abstraction toolkit for public displays. 4. The PuReWidgets software toolkit itself for incorporating interactive features into public display applications 5. An in-breadth evaluation of the PuReWidgets toolkit along several dimensions, including the system’s performance and scalability, the API usability, and a real-world deployment. 6. Open-source software projects, allowing anyone to use, modify, and adapt for further research and development. ● https://code.google.com/p/purewidgets/ i. ii. ● – The PuReWidgets toolkit . – Three interactive public display applications https://code.google.com/p/public-display-scheduler/ A Google Chrome extension that serves as an application scheduler for public displays.
  24. 24. Conclusion: Summary of contributions 1. 2. 3. Cardoso, Jorge C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS - Science and and Technology Publications. Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on HumanComputer Interaction. (under review) Taivan, C., Rui José, Silva, B., Elhart, I., & Cardoso, J. (2013). Design considerations for application selection and control in multi-user public displays. JUCS special issue: Towards Sustainable Computing through Ambient Intelligence. 4. Cardoso, Jorge C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press. 5. José, R., Cardoso, J., Alt, F., Clinch, S., & Davies, N. (2013). Mobile applications for open display networks: common design considerations. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays -- PerDis ’13 (pp. 97–102). ACM. doi:10.1145/2491568.2491590 Cardoso, Jorge C S, & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press. Cardoso, Jorge C. S., & José, R. (2012a). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on Pervasive Displays. Porto, Portugal. Retrieved from http://dx.doi.org/10.6084/m9.figshare.92165 Cardoso, Jorge C. S., & José, R. (2012b). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac Campos, Simone D. J. Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems - EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496 Cardoso, Jorge C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In Robert Meersman, T. Dillon, & P. Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg. Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.), Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7 Cardoso, Jorge C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin / Heidelberg. 6. 7. 8. 9. 10. 11.
  25. 25. Conclusion ● We need better tools to create applications for open display networks ○ Interaction abstractions ● PuReWidgets is just one attempt/model
  26. 26. An Interaction Abstraction Toolkit for Public Display Applications Jorge C. S. Cardoso jorgecardoso@ieee.org http://jorgecardoso.eu

×