Enabling Abilites with Smart Systems - Madelaine Sayko


Published on

Madelaine Sayko's presentation at the Cognitive Systems Institute Speaker Group Series call on October 22, 2015.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Enabling Abilites with Smart Systems - Madelaine Sayko

  1. 1. Enabling Abilities with Smart Support Systems Madelaine Sayko, CEO Patrice Tremoulet, PhD Meira Josephy
  2. 2. What Is Cognition ● Cognition: the process by which sensory inputs are transformed, reduced, elaborated, stored, recovered, and used. (APA, 2013) ● Includes; the mental processes of attention, memory, comprehending and producing language, monitoring mental and physiological states, calculating, reasoning, planning, problem solving, sequencing, wayfinding and decision making. (from ICF cognitive functions) ● Cognition is not necessarily the same as intelligence © Cognitive Compass 2015
  3. 3. What Is A Cognitive Disability? ● Standard Definition: Because of a physical, mental, or emotional condition, this individual has more difficulty than the average person with concentrating, remembering, or making decisions ● Additional features include:  Deficits in initiation, problem solving, abstract reasoning insight, judgement, planning, information processing, interpreting social cues, and organization. (NIH Consensus Development Panel of Rehabilitation of Persons with Traumatic Brain Injury)  Cognitive disabilities range from significant to mild.  They occur across a broad spectrum (Armstrong – continuum of competence)  Cognitive disabilities are not always apparent (invisible)  Many individuals can perform at very high levels but may have a problem with a specific function such as attention or social skills  Cognitive disabilities may include physical attributes such as vision or balance  Many cognitive disabilities improve throughout a lifetime, no matter when they occurred or how (Chapman 2015) © Cognitive Compass 2015
  4. 4. Why Cognitive Assistants for Disability • Almost ½ of all disabilities are cognitive (43%) • 25% of the workforce are baby boomers who will experience mild cognitive impairments even as they continue to work • First generation of students graduating from school under ADA are now in the workforce • 95% of clinicians report that people with brain injury need technology to support organization and memory • Over 1/3 of employers have difficulty filling positions; persons with cognitive disabilities may be able to meet these needs with Assistive Technology for Cognition (ATC) © Cognitive Compass 2015
  5. 5. What Is Assistive Technology For Cognition • Technologies Are Human Created Artifacts that Extend Human Capabilities (Kapp 1877, Lawson 2010) • Assistive Technology for Cognition are human created artifacts that enable, enhance or extend cognitive function (Gillespie and Zittoun, 2010) © Cognitive Compass 2015
  6. 6. Evolution of Cognitive Model Technology Type/ User Group/ Rehab Goals Modular/ Neuropsychological View/Functional Specificity/ ICF Neuro-Socio- Technical /ATC as a circuit • Similar deficits arise in different user groups. • Single technology can support multiple cognitive functions DESIGN FOR ALL Cognition as an interactive process – Cognition and Behavior linked (Bateson) © Cognitive Compass 2015
  7. 7. Executive Function (Norman and Shallice) Environmental Triggers Mobilize Scripts Action in the Environment Regulating and Monitoring Supervisory Attentional System © Cognitive Compass 2015
  8. 8. Socio-Neuro-Technical Model • A full understanding of human cognition must consider the elements beyond the brain itself; including interaction with environmental factors • Environmental factors include o Psycho-social o Physical Space o Task o Resources • Seamless Interaction with the world – Zero effort technology • Neural structure of individual adapts to the tools in the environment and the modes of social interaction – supports compensation © Cognitive Compass 2015
  9. 9. What Are The Challenges Of Addressing Cognitive Disability ● Very individualized needs – wide spectrum ● Challenges with initiation may impact ability to enter or actively use tools ● Memory issues may make it harder to learn tools ● Lack of self- awareness ● Socio-Neuro-Technical model is needed – must address  Context  Task  Ability  Personality  Supports  Environment © Cognitive Compass 2015
  10. 10. Examples • Neuropage • PEAT (Brain Aid) • Memex • Bionic Brain • Smart Calendaring • SIRI et al • Remembrance Agent • Word processing tools – spell check • CALO © Cognitive Compass 2015
  11. 11. New Product Development © Cognitive Compass 2015
  12. 12. A New Solution Set for a Cognitive Assistant • Based on Semantic Knowledge • Start with one function built into a service system • Based on organizational norms • Utilize built in decision making, cuing and custom prompts for minimal effort and to mitigate initiation problems • Creates a status for documents, email and contacts for projects © Cognitive Compass 2015
  13. 13. Key Features • Service System • Zero Effort Technology (approximates) • Smart System – learns the users • Cognitively Friendly UI - NLP • Assessment and Recommender Component • Captures User Data • Mobile • Focus on Function & Task Interaction NOT a given disability • Integrates task functions into one system • Uses external prompts and aids to ‘scaffold’ the user © Cognitive Compass 2015
  14. 14. Functions • Set of Assistive Tools that are “aware” of accepted social norms in work organizations • Monitor work patterns • Offer assistance and appropriate reminders and cues • Offloads some task management to technology • Provide insight in cognitive disability in the workplace • ‘Canary in the coal mine’ for understanding cognition overall © Cognitive Compass 2015
  15. 15. Learning Models • Guide the User – high level of system feedback, instructs user when mistakes are made, encourages when right path is chosen (think video games) • Understand the User – responds to user needs and preferences, response speed, accuracy etc. shape system presentation (think cognitive games) • Support the User- present information in ways that are easy to follow, step by step (highly structured) © Cognitive Compass 2015
  16. 16. AN INTELLIGENT TASK STATUS MANAGER Task Status Management Functionality Knowledge of Social / Org norms and practices related to tasks statuses Monitoring Cues & Advise Adjustments *1) Supplier X hasn’t responded to inquiry for a week, follow up with him *2) email requests from Manager needs respond within 24 hours, *3) monthly work status report pre-warning 5 days in advance of deadline © Cognitive Compass 2015
  17. 17. Future Vision For A Cognitive Support Service System Private Data Store Behavioral Physiological & Environmental Models Recommender & Integrated Work Assist Environment Smart Assessor Individualized cuing and aids to ‘scaffold’ the user for task needs – Cognitive Assistant Task & Status Management Attention / Initiation Planning & Organization Communication/ Behavior Time Management/ Cognitive Budget Usage Patterns Biometric Devices Image Collection Dialogue Module User Preferences © Cognitive Compass 2015
  18. 18. Contact Information • Madelaine Sayko • msayko@cognitivecompass.com • (610) 715-2057