Technologies, potentials and challenges for people
                      with disabilities and elderly

                               Dr. Christos Kouroupetroglou
                                        Laboratory Associate
                                        ATEI of Thessaloniki
                                    chris.kourou@gmail.com
What are we going to discuss
What is a smart home?
How do you build it?
What are they good for?
Can people with disabilities and elderly benefit?
How? Why are they good for them?
What do we need to take care?
Possible future directions of personalization and
 adaptation technologies…


                                                     2
What is a smart home/house?
A smart house is a house that has highly advanced automatic
  systems for lighting, temperature control, multi-media,
  security, window and door operations, and many other
  functions. (http://
  architecture.about.com/od/buildyourhous1/g/smarthouse.htm)
A smart home or building is a home or building, usually a new
  one, that is equipped with special structured wiring to enable
  occupants to remotely control or program an array of
  automated home electronic devices by entering a single
  command. (
  http://searchcio-midmarket.techtarget.com/definition/smart-home-or-building
  )
A home equipped with lighting, heating, and electronic devices
  that can be controlled remotely by smartphone or computer (
  http://oxforddictionaries.com/definition/english/smart%2Bhome)
                                                                            3
How do you build it?
Build it as a new building.
But wireless changed a lot!
Augmenting an existing home
 with appropriate devices.



                               4
Main components
Sensors
Devices / appliances
Networks
Control (panel) mechanisms



                              5
Sensors
Security system sensors
Occupancy and motion sensors
Environmental sensors
  Temperature
  Smoke
  Water leaks
  Weather
  Etc.
Audio/Video sensors

                                6
Devices
Refrigerator
Oven
Dishwasher
Laundry
Vacuum
Home cinemas
TVs



                7
Network of devices/sensors
Bluetooth
IR
ZigBee
Z-Wave
NFC
WiFi




                             8
Control panel / Server
PC?
Tablet?
Smart phone?
TV?
Dedicated device?
Robot?
Anything we can interact with!



                                  9
What do we need from our home?
Health: we all need to live in a healthy living
 environment
Safety: we all need to feel safe in our home
Entertainment: we all need to get entertained in our
 home
Communication & social participation: we all need to
 communicate with friends and family from and within the
 home
Education: we all (might) need to educate ourselves
Employment – employability: we all (might) need to
 work from our home
                                                           10
Smart home applications
Health services
Security
Monitoring services
Remote control
Energy resources control
Plant watering, coffee making, pet feeding…
The sky is the limit!



                                               11
What about Persons With
Disabilities?
“We all need…”
Interaction?
Design?
Privacy?
Applications?

                          12
Applications for Persons With
Disabilities and Elderly
Health services
Monitoring
Notifications – reminder
Safety and security
Autonomy and mobility
Communication
Entertainment



                                13
Technological Challenges
Fragmentation
Communication - Collaboration
Sustainability
Survivability
Energy

                                 14
Some answers…
Fragmentation
  Devices as platforms
  See the smart phones example
Communication – Collaboration
  Standardization of communications
  Platforms for app development (Android, HomeOS,
   etc.)




                                                     15
Human factor challenges
Design
Sensor and devices survivability
Ease of use – interaction!!!
Unobtrusiveness
Ambient
Privacy issues


All these mean that…


                                    16
All these mean that…
We should place people in the
 first place!

We must design and develop
 for ALL people!

                                 17
Opportunities not to be missed
New sensors (wearable, ambient etc.)
New interaction techniques
Affective computing
Ubiquitous computing
Cloud computing
Big Data trend
                                    18
Putting ALL people in the first
place
We already have sensors and devices
We already have applications
We are learning user needs of different users
We map appropriate applications/devices for groups
 of people


Now we need machines to know their users
 and adapt accordingly

                                                      19
Personalization - Adaptation
We need data about the devices and applications
We need data about users and their needs
We need data about other contextual parameters
Combining all these using semantic technologies
 (RDF, OWL) could lead to better personalization and
 adaptation of smart home applications and solutions




                                                       20
Existing approaches
 Composite Capabilities/ Preference Profiles framework
    http://www.w3.org/Mobile/CCPP/
 Universal Remote Console - URC Standard (ISO/IEC 24752)
    http://
     www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=42309
 EMMA (Extensible Multi Modal Annotation mark-up language)
    http://www.w3.org/TR/emma/
 IMS AccLIP (Access For All Personal Needs and Preferences Description for
  Digital Delivery Information Model) and AccMD
     http://zope.cetis.ac.uk/members/accessibility/meetings/2004/sig8/accliphtml
     http://zope.cetis.ac.uk/members/accessibility/meetings/2004/sig8/accmdhtml
 Individualized adaptability and accessibility in e-learning, education and
  training (ISO/IEC 24751-1:2008)
     http://www.iso.org/iso/catalogue_detail.htm?csnumber=41521




                                                                                    21
What about context modeling?
When?
Where?
What do I want to do?
How?
Other environmental parameters (sound, lighting,
 etc.)
Who else is there?
… anything else?


                                                    22
What about social context
modeling?
Who is in the house?
What are their needs?
How do we relate to them?
Do we trust them?
Do we feel comfortable with them?
Who is in command / superior position?
… anything else?



                                          23
What about cultural background
modeling?
Does cultural background affect interaction?
What is the cultural background of users?
What feels better/ more natural for them in their
 interaction?
What happens when users with different cultural
 background exist in the same environment?
… anything else?




                                                     24
Research problem
Investigate possible technologies,
 standards and models that could
 be used for modeling social
 context and cultural background.



                                      25
Further reading
 Biswas P., Langdon P. & Robinson P. (2012) Designing inclusive interfaces through user modelling
    and simulation, International Journal of Human Computer Interaction, Taylor & Francis, Vol 28,
    Issue 1 DOI:10.1080/10447318.2011.565718
   Brush, A.J.B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S. and Dixon, C., 2011. Home automation in
    the wild: challenges and opportunities. In: Proceedings of the SIGCHI Conference on Human Factors
    in Computing Systems. Vancouver, BC, Canada, 2011. New York: ACM, pp.2115-2124.
   Callejas, Z. and Lopez-Cozar, R., 2009. Designing smart home interfaces for the elderly. SIGACCESS
    Access. Comput. 95, pp. 10-16
   Kirisci, P.T., Klein, P., Modzelewski, M., Lawo, M., Mohamad, Y., Fiddian, T., Bowden, C., Fennel, A.
    and O’Connor, J., 2011. Supporting inclusive product design with virtual user models at the early
    stages of product development. Lecture Notes in Computer Science, 6766, pp.69-78.
   Lawo, M., Kirisci, P., Modzelewski, M., Connor, J.O., Fennell, A., Fiddian, T., Gökmen, H., Klann, M.,
    Geissler, M., Matiouk, S. and Mohamad, Y., 2012. Virtual User Models – Approach and first results of
    the VICON project. eChallenges e-2012, Lisbon, Portugal, October 2012.
   Mejia, A., Juarez-Ramirez, R., Inzunza, S. and Valenzuela, R., 2012. Implementing adaptive
    interfaces: a user model for the development of usability in interactive systems. In: Proceedings of
    the CUBE International Information Technology Conference. Pune, India, 2012. New York, NY, USA:
    ACM. pp.598-604.
   Modzelewski, M., Lawo, M., Kirisci, P., Connor, J.O., Fennell, A., Mohamad, Y., Matiouk, S., Valle-
    Klann, M. and Gokmen, H., 2012. Creative Design for Inclusion using Virtual User Models. Lecture
    Notes in Computer Science 7382, pp.288-294.




                                                                                                         26
Further reading
 Peissner, M., Sellner, T. and Janssen, D., 2012. MyUI Individualization Patterns for Accessible and
    Adaptive User Interfaces. In: Proceedings of SMART 2012, The First International Conference on
    Smart Systems, Devices and Technologies, Stuttgart, Germany, 2012.
   Perry, M., Dowdall, A., Lines, L. and Hone, K., 2004. Multimodal and ubiquitous computing
    systems: Supporting independent-living older users. IEEE Transactions on Information Technology
    in Biomedicine, 8(3), pp.258-270.
   Portet, F., Vacher, M., Golanski, C., Roux, C. and Meillon, B., 2013. Design and evaluation of a smart
    home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous
    Computing, 17(1), pp.127-144.
   Rocker, C., Janse, M., Portolan, N., and Streitz, N., 2005. User requirements for intelligent home
    environments: a scenario-driven approach and empirical cross-cultural study. In: Proceedings of the
    2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services:
    usages and technologies. Grenoble, France, 2005. New York: ACM, pp.111-116.
   Strnad, O., Felic, A. and Schmidt, A., 2012. Context Management for Self-adaptive User Interfaces in
    the Project MyUI. In Wichert, R. and Eberhardt, B., eds . 2012. Ambient Assisted Living. Berlin:
    Springer. pp.263-27.
   Wehbi, A., Cherif, A. R. and Tadj, C., 2012. Modeling ontology for multimodal interaction in
    ubiquitous computing systems. In: Proceedings of the 2012 ACM Conference on Ubiquitous
    Computing. Pittsburgh, Pennsylvania, USA, 2012. New York, NY, USA: ACM. pp.842-849.




                                                                                                             27
Thank you!
Any questions…




                  ?
                      28

Smart homes

  • 1.
    Technologies, potentials andchallenges for people with disabilities and elderly Dr. Christos Kouroupetroglou Laboratory Associate ATEI of Thessaloniki chris.kourou@gmail.com
  • 2.
    What are wegoing to discuss What is a smart home? How do you build it? What are they good for? Can people with disabilities and elderly benefit? How? Why are they good for them? What do we need to take care? Possible future directions of personalization and adaptation technologies… 2
  • 3.
    What is asmart home/house? A smart house is a house that has highly advanced automatic systems for lighting, temperature control, multi-media, security, window and door operations, and many other functions. (http:// architecture.about.com/od/buildyourhous1/g/smarthouse.htm) A smart home or building is a home or building, usually a new one, that is equipped with special structured wiring to enable occupants to remotely control or program an array of automated home electronic devices by entering a single command. ( http://searchcio-midmarket.techtarget.com/definition/smart-home-or-building ) A home equipped with lighting, heating, and electronic devices that can be controlled remotely by smartphone or computer ( http://oxforddictionaries.com/definition/english/smart%2Bhome) 3
  • 4.
    How do youbuild it? Build it as a new building. But wireless changed a lot! Augmenting an existing home with appropriate devices. 4
  • 5.
    Main components Sensors Devices /appliances Networks Control (panel) mechanisms 5
  • 6.
    Sensors Security system sensors Occupancyand motion sensors Environmental sensors Temperature Smoke Water leaks Weather Etc. Audio/Video sensors 6
  • 7.
  • 8.
  • 9.
    Control panel /Server PC? Tablet? Smart phone? TV? Dedicated device? Robot? Anything we can interact with! 9
  • 10.
    What do weneed from our home? Health: we all need to live in a healthy living environment Safety: we all need to feel safe in our home Entertainment: we all need to get entertained in our home Communication & social participation: we all need to communicate with friends and family from and within the home Education: we all (might) need to educate ourselves Employment – employability: we all (might) need to work from our home 10
  • 11.
    Smart home applications Healthservices Security Monitoring services Remote control Energy resources control Plant watering, coffee making, pet feeding… The sky is the limit! 11
  • 12.
    What about PersonsWith Disabilities? “We all need…” Interaction? Design? Privacy? Applications? 12
  • 13.
    Applications for PersonsWith Disabilities and Elderly Health services Monitoring Notifications – reminder Safety and security Autonomy and mobility Communication Entertainment 13
  • 14.
    Technological Challenges Fragmentation Communication -Collaboration Sustainability Survivability Energy 14
  • 15.
    Some answers… Fragmentation Devices as platforms See the smart phones example Communication – Collaboration Standardization of communications Platforms for app development (Android, HomeOS, etc.) 15
  • 16.
    Human factor challenges Design Sensorand devices survivability Ease of use – interaction!!! Unobtrusiveness Ambient Privacy issues All these mean that… 16
  • 17.
    All these meanthat… We should place people in the first place! We must design and develop for ALL people! 17
  • 18.
    Opportunities not tobe missed New sensors (wearable, ambient etc.) New interaction techniques Affective computing Ubiquitous computing Cloud computing Big Data trend 18
  • 19.
    Putting ALL peoplein the first place We already have sensors and devices We already have applications We are learning user needs of different users We map appropriate applications/devices for groups of people Now we need machines to know their users and adapt accordingly 19
  • 20.
    Personalization - Adaptation Weneed data about the devices and applications We need data about users and their needs We need data about other contextual parameters Combining all these using semantic technologies (RDF, OWL) could lead to better personalization and adaptation of smart home applications and solutions 20
  • 21.
    Existing approaches  CompositeCapabilities/ Preference Profiles framework  http://www.w3.org/Mobile/CCPP/  Universal Remote Console - URC Standard (ISO/IEC 24752)  http:// www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=42309  EMMA (Extensible Multi Modal Annotation mark-up language)  http://www.w3.org/TR/emma/  IMS AccLIP (Access For All Personal Needs and Preferences Description for Digital Delivery Information Model) and AccMD  http://zope.cetis.ac.uk/members/accessibility/meetings/2004/sig8/accliphtml  http://zope.cetis.ac.uk/members/accessibility/meetings/2004/sig8/accmdhtml  Individualized adaptability and accessibility in e-learning, education and training (ISO/IEC 24751-1:2008)  http://www.iso.org/iso/catalogue_detail.htm?csnumber=41521 21
  • 22.
    What about contextmodeling? When? Where? What do I want to do? How? Other environmental parameters (sound, lighting, etc.) Who else is there? … anything else? 22
  • 23.
    What about socialcontext modeling? Who is in the house? What are their needs? How do we relate to them? Do we trust them? Do we feel comfortable with them? Who is in command / superior position? … anything else? 23
  • 24.
    What about culturalbackground modeling? Does cultural background affect interaction? What is the cultural background of users? What feels better/ more natural for them in their interaction? What happens when users with different cultural background exist in the same environment? … anything else? 24
  • 25.
    Research problem Investigate possibletechnologies, standards and models that could be used for modeling social context and cultural background. 25
  • 26.
    Further reading  BiswasP., Langdon P. & Robinson P. (2012) Designing inclusive interfaces through user modelling and simulation, International Journal of Human Computer Interaction, Taylor & Francis, Vol 28, Issue 1 DOI:10.1080/10447318.2011.565718  Brush, A.J.B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S. and Dixon, C., 2011. Home automation in the wild: challenges and opportunities. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Vancouver, BC, Canada, 2011. New York: ACM, pp.2115-2124.  Callejas, Z. and Lopez-Cozar, R., 2009. Designing smart home interfaces for the elderly. SIGACCESS Access. Comput. 95, pp. 10-16  Kirisci, P.T., Klein, P., Modzelewski, M., Lawo, M., Mohamad, Y., Fiddian, T., Bowden, C., Fennel, A. and O’Connor, J., 2011. Supporting inclusive product design with virtual user models at the early stages of product development. Lecture Notes in Computer Science, 6766, pp.69-78.  Lawo, M., Kirisci, P., Modzelewski, M., Connor, J.O., Fennell, A., Fiddian, T., Gökmen, H., Klann, M., Geissler, M., Matiouk, S. and Mohamad, Y., 2012. Virtual User Models – Approach and first results of the VICON project. eChallenges e-2012, Lisbon, Portugal, October 2012.  Mejia, A., Juarez-Ramirez, R., Inzunza, S. and Valenzuela, R., 2012. Implementing adaptive interfaces: a user model for the development of usability in interactive systems. In: Proceedings of the CUBE International Information Technology Conference. Pune, India, 2012. New York, NY, USA: ACM. pp.598-604.  Modzelewski, M., Lawo, M., Kirisci, P., Connor, J.O., Fennell, A., Mohamad, Y., Matiouk, S., Valle- Klann, M. and Gokmen, H., 2012. Creative Design for Inclusion using Virtual User Models. Lecture Notes in Computer Science 7382, pp.288-294. 26
  • 27.
    Further reading  Peissner,M., Sellner, T. and Janssen, D., 2012. MyUI Individualization Patterns for Accessible and Adaptive User Interfaces. In: Proceedings of SMART 2012, The First International Conference on Smart Systems, Devices and Technologies, Stuttgart, Germany, 2012.  Perry, M., Dowdall, A., Lines, L. and Hone, K., 2004. Multimodal and ubiquitous computing systems: Supporting independent-living older users. IEEE Transactions on Information Technology in Biomedicine, 8(3), pp.258-270.  Portet, F., Vacher, M., Golanski, C., Roux, C. and Meillon, B., 2013. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous Computing, 17(1), pp.127-144.  Rocker, C., Janse, M., Portolan, N., and Streitz, N., 2005. User requirements for intelligent home environments: a scenario-driven approach and empirical cross-cultural study. In: Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies. Grenoble, France, 2005. New York: ACM, pp.111-116.  Strnad, O., Felic, A. and Schmidt, A., 2012. Context Management for Self-adaptive User Interfaces in the Project MyUI. In Wichert, R. and Eberhardt, B., eds . 2012. Ambient Assisted Living. Berlin: Springer. pp.263-27.  Wehbi, A., Cherif, A. R. and Tadj, C., 2012. Modeling ontology for multimodal interaction in ubiquitous computing systems. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing. Pittsburgh, Pennsylvania, USA, 2012. New York, NY, USA: ACM. pp.842-849. 27
  • 28.