Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
User Expectations in
Intelligent Environments
Issues and Opportunities in the Interaction of
Intelligent Users and Intelli...
Outline
WoRIE'18,Rome, 26/06/2018User Expectations in IEs2
 IEs and Humans
 What do users want?
 IEs and Research
 Whe...
IEs and Humans
What are users demanding?
https://elite.polito.it
7th Workshop on the Reliability
of Intelligent Environmen...
Questions
WoRIE'18,Rome, 26/06/2018User Expectations in IEs4
 What have we promised to users of Intelligent
Environments ...
why
what
AmI is
people-
oriented
Ambient Intelligence (AmI)
WoRIE'18,Rome, 26/06/2018User Expectations in IEs5
AmI Features
AmI
Sensitive
Responsive
Adaptive
Transparent
Ubiquitous
Intelligent
WoRIE'18,Rome, 26/06/2018User Expectatio...
AmI Features
AmI
Sensitive
Responsive
Adaptive
Transparent
Ubiquitous
Intelligent
Able to sense the
environments and its
i...
Intelligent Environments (IE)
WoRIE'18,Rome, 26/06/2018User Expectations in IEs8
why
what
IEs are
people-
oriented
Smart Environment
WoRIE'18,Rome, 26/06/2018User Expectations in IEs9
Smart Environment
WoRIE'18,Rome, 26/06/2018User Expectations in IEs10
Issues
WoRIE'18,Rome, 26/06/2018User Expectations in IEs11
Expectations
Usability
Features
What Would You Ask to Your home?
WoRIE'18,Rome, 26/06/2018User Expectations in IEs12
2 13
Bonino D., Corno F. (2011). What...
What would you ask – Comfort
WoRIE'18,Rome, 26/06/2018User Expectations in IEs13
What would you ask – Housekeeping
WoRIE'18,Rome, 26/06/2018User Expectations in IEs14
User expectations
WoRIE'18,Rome, 26/06/2018User Expectations in IEs15
Smart Environment
WoRIE'18,Rome, 26/06/2018User Expectations in IEs16
Unsupervised
Sensitive
Proactive
Secure
Integrated
I...
Quiz
WoRIE'18,Rome, 26/06/2018User Expectations in IEs17
 What is the difference between an enchanted house (or
castle) a...
Quiz
WoRIE'18,Rome, 26/06/2018User Expectations in IEs18
 What is the difference between an enchanted house (or
castle) a...
Quiz
WoRIE'18,Rome, 26/06/2018User Expectations in IEs19
 What is the difference between an enchanted house (or
castle) a...
Smart Environment: User expectations
WoRIE'18,Rome, 26/06/2018User Expectations in IEs20
Smart Environment
WoRIE'18,Rome, 26/06/2018User Expectations in IEs21
Usability
WoRIE'18,Rome, 26/06/2018User Expectations in IEs22
Usability
WoRIE'18,Rome, 26/06/2018User Expectations in IEs23
Usability
WoRIE'18,Rome, 26/06/2018User Expectations in IEs24 Questa foto di Autore sconosciuto è concesso in licenza da C...
Sensing
Acting
ReasoningInteracting
They promised user-centered systems…
WoRIE'18,Rome, 26/06/2018User Expectations in IEs...
…they delivered tons of technologies…
WoRIE'18,Rome, 26/06/2018User Expectations in IEs26
…to implement Sensor-to-Dashboard
pipelines
WoRIE'18,Rome, 26/06/2018User Expectations in IEs27
Sensors Cloud Dashboards
C...
…that, by design, don’t work together
WoRIE'18,Rome, 26/06/2018User Expectations in IEs28
…that, by design, don’t work together
WoRIE'18,Rome, 26/06/2018User Expectations in IEs29
Intranets
of Silos of
Things
IEs and Research
Where is research going?
https://elite.polito.it
7th Workshop on the Reliability
of Intelligent Environme...
Literature analysis
WoRIE'18,Rome, 26/06/2018User Expectations in IEs31
Volumes 1÷4
46 papers
Volumes 7÷10
144 papers
Volu...
Methodology
WoRIE'18,Rome, 26/06/2018User Expectations in IEs32
1. Extract title, abstract, keywords from each paper
 Fro...
JORIE papers wordcloud
WoRIE'18,Rome, 26/06/2018User Expectations in IEs33
JAISE papers wordcloud
WoRIE'18,Rome, 26/06/2018User Expectations in IEs34
JAIHC papers wordcloud
WoRIE'18,Rome, 26/06/2018User Expectations in IEs35
Methodology
WoRIE'18,Rome, 26/06/2018User Expectations in IEs36
1. Extract title, abstract, keywords from each paper
 Fro...
Revealing Words
WoRIE'18,Rome, 26/06/2018User Expectations in IEs37
 user*
 user, users, ...
 person*
 person, persons...
Papers with revealing words
WoRIE'18,Rome, 26/06/2018User Expectations in IEs38
205
144
46
104
116
27
0
50
100
150
200
250...
Where are Words mentioned?
WoRIE'18,Rome, 26/06/2018User Expectations in IEs39
77 71
241
Title Keywords
Abstract
Total pap...
Where are Words mentioned?
WoRIE'18,Rome, 26/06/2018User Expectations in IEs40
Title Keywords
Abstract
Total papers:
395
4...
Methodology
WoRIE'18,Rome, 26/06/2018User Expectations in IEs41
1. Extract title, abstract, keywords from each paper
 Fro...
Selection criteria
WoRIE'18,Rome, 26/06/2018User Expectations in IEs42
 For each selected paper (due to title, keywords o...
Really user-driven papers
WoRIE'18,Rome, 26/06/2018User Expectations in IEs43
205
144
46
104
116
2723
44
3
0
50
100
150
20...
Really user-driven papers
WoRIE'18,Rome, 26/06/2018User Expectations in IEs44
Title Keywords
Abstract
Total papers:
395
49...
Causes for false positives
WoRIE'18,Rome, 26/06/2018User Expectations in IEs45
 Working on user-collected data (from othe...
Causes for false positives
WoRIE'18,Rome, 26/06/2018User Expectations in IEs46
Nihil de nobis,
sine nobis
Nothing About Us...
Conclusion
User Expectations in Intelligent Environments
https://elite.polito.it
7th Workshop on the Reliability
of Intell...
The situation is not new…
WoRIE'18,Rome, 26/06/2018User Expectations in IEs48
http://radar.oreilly.com/2014/05/most-of-wha...
Intelligent environments and Humans
WoRIE'18,Rome, 26/06/2018User Expectations in IEs49
 IEs and AmI systems should inclu...
Thank you
Questions?
Fulvio Corno, Politecnico di Torino, fulvio.corno@polito.it
@fulcorno
Possible actions
WoRIE'18,Rome, 26/06/2018User Expectations in IEs51
 Re-run the «What would you ask to your home» survey...
How it ended…
WoRIE'18,Rome, 26/06/2018User Expectations in IEs52
Contact information
WoRIE'18,Rome, 26/06/2018User Expectations in IEs53
 Fulvio Corno
Politecnico di Torino
fulvio.corno@...
Licenza d’uso
WoRIE'18,Rome, 26/06/2018User Expectations in IEs54
This work is licensed under the Creative Commons “Attrib...
Upcoming SlideShare
Loading in …5
×

User Expectations in Intelligent Environments - Issues and Opportunities in the Interaction of Intelligent Users and Intelligent Environments

140 views

Published on

Keynote speech given at the 7th Workshop on the Reliability of Intelligent Environments (Rome, 26 June 2018) http://www.ugr.es/~worie/2018/

Abstract:
The definition of Intelligent Environments has always been focused around their *users*, aiming at helping them in a smart and transparent way, and avoiding bothering them or acting against their will. The complexity of IEs, whose technologies range from sensors to machine learning, from distributed architectures to tangible interfaces, from communication protocols to data analysis, challenges researchers from various fields to contribute innovative and effective solutions. In this quest for technical solutions to the myriad requirements of an intelligent environments, user expectations are often left behind, and while researchers tend to focus on niche technical aspects, they risk of losing the big picture of an IE ``helping users in their daily life''.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

User Expectations in Intelligent Environments - Issues and Opportunities in the Interaction of Intelligent Users and Intelligent Environments

  1. 1. User Expectations in Intelligent Environments Issues and Opportunities in the Interaction of Intelligent Users and Intelligent Environments https://elite.polito.it 7th Workshop on the Reliability of Intelligent Environments Rome, 26 June 2018 Fulvio Corno, Politecnico di Torino, fulvio.corno@polito.it @fulcorno
  2. 2. Outline WoRIE'18,Rome, 26/06/2018User Expectations in IEs2  IEs and Humans  What do users want?  IEs and Research  Where is the research community going?  Comments and Conclusions
  3. 3. IEs and Humans What are users demanding? https://elite.polito.it 7th Workshop on the Reliability of Intelligent Environments Rome, 26 June 2018
  4. 4. Questions WoRIE'18,Rome, 26/06/2018User Expectations in IEs4  What have we promised to users of Intelligent Environments and Ambient Intelligence Systems?  Main focus of IEs  What are users expecting out of an IE?  Top-selling features  What makes an IE successful, in the eye of the users?  Applications
  5. 5. why what AmI is people- oriented Ambient Intelligence (AmI) WoRIE'18,Rome, 26/06/2018User Expectations in IEs5
  6. 6. AmI Features AmI Sensitive Responsive Adaptive Transparent Ubiquitous Intelligent WoRIE'18,Rome, 26/06/2018User Expectations in IEs6
  7. 7. AmI Features AmI Sensitive Responsive Adaptive Transparent Ubiquitous Intelligent Able to sense the environments and its inhabitants. Able to process sensor data. Able to respond to user needs. Able to act on the environment. Present, appearing, found everywhere. Able to be distributed over the ambient and over different people. Incorporates Artificial Intelligence: Machine learning, agent-based software, robotics Hearing, vision, language, knowledge processing Semantic web, reasoning WoRIE'18,Rome, 26/06/2018User Expectations in IEs7 "The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it." Mark Weiser Able to infer a situational context: - from environment data - from user data (identity, presence, actions, …) - from statistics and preferences - from external information sources Able to adapt to the context, by means of the interpretation of sensing and the generated response
  8. 8. Intelligent Environments (IE) WoRIE'18,Rome, 26/06/2018User Expectations in IEs8 why what IEs are people- oriented
  9. 9. Smart Environment WoRIE'18,Rome, 26/06/2018User Expectations in IEs9
  10. 10. Smart Environment WoRIE'18,Rome, 26/06/2018User Expectations in IEs10
  11. 11. Issues WoRIE'18,Rome, 26/06/2018User Expectations in IEs11 Expectations Usability Features
  12. 12. What Would You Ask to Your home? WoRIE'18,Rome, 26/06/2018User Expectations in IEs12 2 13 Bonino D., Corno F. (2011). What Would You Ask to Your Home if It Were Intelligent? Exploring User Expectations about Next-Generation Homes. In: JOURNAL OF AMBIENT INTELLIGENCE AND SMART ENVIRONMENTS, vol. Volume 3, Number 2 / 2011 n. Number, pp. 111-126. – ISSN 1876-1364. DOI:10.3233/AIS-2011-0099
  13. 13. What would you ask – Comfort WoRIE'18,Rome, 26/06/2018User Expectations in IEs13
  14. 14. What would you ask – Housekeeping WoRIE'18,Rome, 26/06/2018User Expectations in IEs14
  15. 15. User expectations WoRIE'18,Rome, 26/06/2018User Expectations in IEs15
  16. 16. Smart Environment WoRIE'18,Rome, 26/06/2018User Expectations in IEs16 Unsupervised Sensitive Proactive Secure Integrated Intelligent Transparent Creepy??
  17. 17. Quiz WoRIE'18,Rome, 26/06/2018User Expectations in IEs17  What is the difference between an enchanted house (or castle) and a haunted one?
  18. 18. Quiz WoRIE'18,Rome, 26/06/2018User Expectations in IEs18  What is the difference between an enchanted house (or castle) and a haunted one?  Both are autonomous in performing some actions (playing music, controlling doors and windows, providing food and entertainment, etc.)  Both could be powered by similar intelligent systems  Both could use the same technologies and algorithms
  19. 19. Quiz WoRIE'18,Rome, 26/06/2018User Expectations in IEs19  What is the difference between an enchanted house (or castle) and a haunted one?  Difference lies in user perception actions of an enchanted house are expected, desired and welcomed by the user, in a proactively friendly environment the haunted space will execute actions contrary to the will of the user, who will feel trapped by an hostile entity
  20. 20. Smart Environment: User expectations WoRIE'18,Rome, 26/06/2018User Expectations in IEs20
  21. 21. Smart Environment WoRIE'18,Rome, 26/06/2018User Expectations in IEs21
  22. 22. Usability WoRIE'18,Rome, 26/06/2018User Expectations in IEs22
  23. 23. Usability WoRIE'18,Rome, 26/06/2018User Expectations in IEs23
  24. 24. Usability WoRIE'18,Rome, 26/06/2018User Expectations in IEs24 Questa foto di Autore sconosciuto è concesso in licenza da CC BY-NC-ND
  25. 25. Sensing Acting ReasoningInteracting They promised user-centered systems… WoRIE'18,Rome, 26/06/2018User Expectations in IEs25
  26. 26. …they delivered tons of technologies… WoRIE'18,Rome, 26/06/2018User Expectations in IEs26
  27. 27. …to implement Sensor-to-Dashboard pipelines WoRIE'18,Rome, 26/06/2018User Expectations in IEs27 Sensors Cloud Dashboards Connectivity magic Analytics magic Currently… Where are the users? Where is interaction? Where is intelligence? Where are smart spaces?
  28. 28. …that, by design, don’t work together WoRIE'18,Rome, 26/06/2018User Expectations in IEs28
  29. 29. …that, by design, don’t work together WoRIE'18,Rome, 26/06/2018User Expectations in IEs29 Intranets of Silos of Things
  30. 30. IEs and Research Where is research going? https://elite.polito.it 7th Workshop on the Reliability of Intelligent Environments Rome, 26 June 2018
  31. 31. Literature analysis WoRIE'18,Rome, 26/06/2018User Expectations in IEs31 Volumes 1÷4 46 papers Volumes 7÷10 144 papers Volumes 7÷9 205 papers
  32. 32. Methodology WoRIE'18,Rome, 26/06/2018User Expectations in IEs32 1. Extract title, abstract, keywords from each paper  From publishers’ websites 2. Bird’s eye analysis with Wordclouds
  33. 33. JORIE papers wordcloud WoRIE'18,Rome, 26/06/2018User Expectations in IEs33
  34. 34. JAISE papers wordcloud WoRIE'18,Rome, 26/06/2018User Expectations in IEs34
  35. 35. JAIHC papers wordcloud WoRIE'18,Rome, 26/06/2018User Expectations in IEs35
  36. 36. Methodology WoRIE'18,Rome, 26/06/2018User Expectations in IEs36 1. Extract title, abstract, keywords from each paper  From editors’ websites 2. Bird’s eye analysis with Wordclouds 3. Check whether title and/or abstract and/or keyworks contain some “revealing” words  May indicate that the paper talks about user experience or involves users
  37. 37. Revealing Words WoRIE'18,Rome, 26/06/2018User Expectations in IEs37  user*  user, users, ...  person*  person, persons, personalize, personalized, ...  human*  human, humans, humanized, ...  usab*  usable, usability, ...  interact*  interact, interaction, interacting, ...  people  HCI  child*  child, children  adult*  elderly
  38. 38. Papers with revealing words WoRIE'18,Rome, 26/06/2018User Expectations in IEs38 205 144 46 104 116 27 0 50 100 150 200 250 JAIHC JAISE JORIE Numberofpapers Total Mentioning users
  39. 39. Where are Words mentioned? WoRIE'18,Rome, 26/06/2018User Expectations in IEs39 77 71 241 Title Keywords Abstract Total papers: 395
  40. 40. Where are Words mentioned? WoRIE'18,Rome, 26/06/2018User Expectations in IEs40 Title Keywords Abstract Total papers: 395 49 1 25 2 18 3 149 In: 247 Out: 148
  41. 41. Methodology WoRIE'18,Rome, 26/06/2018User Expectations in IEs41 1. Extract title, abstract, keywords from each paper  From editors’ websites 2. Bird’s eye analysis with Wordclouds 3. Check whether title and/or abstract and/or keyworks contain some “revealing” words  May indicate that the paper talks about user experience or involves users 4. Manually check potential papers (247), to confirm whether they actually involve users  Removal of false positives
  42. 42. Selection criteria WoRIE'18,Rome, 26/06/2018User Expectations in IEs42  For each selected paper (due to title, keywords or abstract matches), at least one condition should hold:  End-users were involved in the design phase  End-users or experimenters were involved in testing and/or evaluating the results  Some form of user study (survey, trial, experiment, …) was conducted  The following does not qualify:  Using data-sets containing user-collected data or user recordings (audio, images, videos, …)
  43. 43. Really user-driven papers WoRIE'18,Rome, 26/06/2018User Expectations in IEs43 205 144 46 104 116 2723 44 3 0 50 100 150 200 250 JAIHC JAISE JORIE Numberofpapers Total Mentioning users Really
  44. 44. Really user-driven papers WoRIE'18,Rome, 26/06/2018User Expectations in IEs44 Title Keywords Abstract Total papers: 395 49 1 25 2 18 3 149 Real: 70 In: 247 Out: 148 26 0 12 2 11 0 19
  45. 45. Causes for false positives WoRIE'18,Rome, 26/06/2018User Expectations in IEs45  Working on user-collected data (from other data-sets), as a basis for proposing new techniques: users as data-producers  Proposing a system/algorithm/interface/optimization thought for user benefit, but without an actual user evaluation  Evaluating user response with historical data-sets (as if user behavior wasn't influenced by the system)  Proposing a solution that "we think the users would like"  Proposing a solution that "the users will use in this way"  "We found interesting results, that in the future can be extended to support the users"  "Our theoretical results, in the lab, are positive.Therefore, the system is useful for real users"
  46. 46. Causes for false positives WoRIE'18,Rome, 26/06/2018User Expectations in IEs46 Nihil de nobis, sine nobis Nothing About Us, Without Us
  47. 47. Conclusion User Expectations in Intelligent Environments https://elite.polito.it 7th Workshop on the Reliability of Intelligent Environments Rome, 26 June 2018
  48. 48. The situation is not new… WoRIE'18,Rome, 26/06/2018User Expectations in IEs48 http://radar.oreilly.com/2014/05/most-of-what-we- need-for-smart-cities-already-exists.html http://radar.oreilly.com/2014/04/ioth-the-internet-of- things-and-humans.html
  49. 49. Intelligent environments and Humans WoRIE'18,Rome, 26/06/2018User Expectations in IEs49  IEs and AmI systems should include acting on the user- perceivable part of the environment  Otherwise it’s not a «smart» home/building/car/city/…  Users should close the loop of the intelligent algorithms  They must feel connected and feel in control  Consider user needs and requirements  More technology is not always the answer  Research is not going in the ‘right’ direction  Industry is not going in the ‘right’ direction
  50. 50. Thank you Questions? Fulvio Corno, Politecnico di Torino, fulvio.corno@polito.it @fulcorno
  51. 51. Possible actions WoRIE'18,Rome, 26/06/2018User Expectations in IEs51  Re-run the «What would you ask to your home» survey, ~10 years later  Will you help disseminating the poll?  Incentivize user-related research  Liaison with the HCI communities  Require that «algorithmic» results have a clear user-facing impact  Share resources  User groups, testability labs, data-sets, mock-ups  Realistic Intelligent Environments
  52. 52. How it ended… WoRIE'18,Rome, 26/06/2018User Expectations in IEs52
  53. 53. Contact information WoRIE'18,Rome, 26/06/2018User Expectations in IEs53  Fulvio Corno Politecnico di Torino fulvio.corno@polito.it @fulcorno  e-Lite Research Group https://elite.polito.it/  Ambient Intelligence course https://bit.ly/polito.ami (course materials) https://ami-2018.github.io (student projects)
  54. 54. Licenza d’uso WoRIE'18,Rome, 26/06/2018User Expectations in IEs54 This work is licensed under the Creative Commons “Attribution- NonCommercial-ShareAlike Unported (CC BY-NC-SA 3,0)” License. You are free:  to Share - to copy, distribute and transmit the work  to Remix - to adapt the work Under the following conditions:  Attribution -You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).  Noncommercial -You may not use this work for commercial purposes.  Share Alike - If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one. To view a copy of this license, visit http://creativecommons.org/license/by-nc-sa/3.0/

×