SlideShare a Scribd company logo
IBM Research - Tokyo
Eldercare Research
Hironobu Takagi
IBM Research – Tokyo
Aging Strategic Initiative
IBM Research - Tokyo
PercentageofPopulation65yearsandolder
Japan
Italy
Germany
Ireland
China
Australia
Brazil
US
India
Egypt
2017
2017
27%
World Population Aging
IBM Research - Tokyo
62 87
28%
Dementia 15% + MCI 13%
estimation by Japanese Government, 2012
of people over the age of 65
are at the risk of dementia.
70%of people want to work over
the age of 70 (and forever).
Life expectancy of women in
1950 and 2015.
* numbers in Japan
3%
Total social cost per year in
Japan is $145B or
of the GDP
IBM Research - Tokyo
We need a new model for
active life-long society.
IBM Research - Tokyo
Eldercare Research: Focus Areas
Social
Intelligent assist
Sensing
Accessibility
Brain
2003 - 2012
2010 -
2015 -
2016 -
Physical assist
Japan Post
Japan Post
IBM Research - Tokyo
Eldercare Pilot Project with Japan Post
• Pilot with 1000 elderlies completed (Oct. 2015 – Oct. 2016)
• Medicine reminders, video telephony, online shopping, photo sharing, etc.
IBM Research - Tokyo
Global Apple + IBM Apps for Elder Services
Care givers
Family
members
Elderly
people
IBM Research - Tokyo
Italian Post
IBM Research - Tokyo
Eldercare Research: Focus Areas
Social
Intelligent assist
Sensing
Accessibility
Brain
2003 - 2012
2010 -
2015 -
2016 -
Physical assist
Japan Post
Japan Post
IBM Research - Tokyo
Voice-base natural user interface for daily watchover
• Analyze life patterns, feelings, interests and issues from daily conversation (e.g. cognitive decline detection)
• Share information with families and care givers
• Provide support that can keep the elderly self-sufficient
Conversation as Sensors
User
Weather
Events
Meals
Activities
Life Patterns
Cognitive issues
Feelings
Interests
Family & Friends
Daily Engagement Alerts & Reports
Support workers
WATSON
IBM Research - Tokyo
11
Conversational Eldercare - DEMO
IBM Research - Tokyo
Questionnaire Intent
“What did you have last night?” Dementia (Neuro Cognitive Disease) Risk
Assessment
“Did you go out today?” Activity checking
“You mentioned about gardening in diary. Are
you interested in community gardening?”
Recommendation of activities
”Which city do you want to travel?” Marketing
“The shop, you mentioned last week, is now on
sale!”
Promotion
“We delivered a package, but you were not
there. Please contact post office"
Notification (business related)
Intent of each questionnaire
IBM Research - Tokyo
Emotion and Physical Condition Recognition
Voice data Features
988 acoustic features for
emotion recognition.
• Intensity
• Loudness
• 12 MFCC
• Pitch (F0)
• Probability of voicing,
F0 envelope,
• 8 LSF,
• Zero-Crossing Rate
Labeled
voice
dataset
ML-based
Regression
Estimation
Feeling good
or bad
40
0
100
Physical
condition
Ex: Good night
*Each circle represents one greeting.
*One participant data
Emotion
NegativePositive
Confusion FrustrationDelight Flow
Physical Condition
Emotion
Yorktown – Speech team
Tokyo Research
Happy
Sad
IBM Research - Tokyo
Dashboard for Family and Care Givers
Condition
Emotion
(voice sound
analysis)
Personality analysis
(Watson personality
insights)
Daily activities
Eating habits
Dementia
questionnaire
scores
and more ….
IBM Research - Tokyo
Eldercare Research: Focus Areas
Social
Intelligent assist
Sensing
Accessibility
Brain
2003 - 2012
2010 -
2015 -
2016 -
Physical assist
Japan Post
Japan Post
IBM Research - Tokyo
th Leading Cause of Death
6
But, interventions during MCI have been
shown to be effective
Of the top 10 killers, AD is the only one that
cannot be prevented, cured, or even slowed
50-95%
of the people with dementia never have screening
• High income countries: 40-50% (e.g. US 45%)
• Low/Middle income countries: 5-10%
Societal Impact of Dimentia
Poor gait performance can be used for detection and also
prediction of dementia and mild cognitive impairments before
up to 7-12 years
[Buchman & Bennett, Expert Rev. Neurother., 2011]
[McGough EL et al . Phys Ther. 2011; Beauchet O et al., J Nutr Health Aging. 2013]
IBM Research - Tokyo
• Gait speed & its variability
• Step frequency
• Stride time variability
• Step-length & its variability
• Foot swing velocity
• Stance and stride time
• Motor function
• Fall risks
• Cognitive decline
• Episodic memory
• Executive function
• Diseases
• Parkinson disease
• MCI
• Alzheimer’s disease
Feature extraction of gait
Features Detection
IBM Research - Tokyo
IBM Research - Tokyo
Brain Simulation: Understanding Alzheimer Disease (2016)
19
APOE-4 carriers
APOE-4 non-carriers
Investigate whether and how an abnormality in inter-areal structural connectivity observed in APOE-4
carriers (major risk factors in Alzheimer Disease) affects cortical information processing
Structural connectivity of APOE-4 carriers might
reduce cortical information propagation and lead to
negative effects in information integration.
IBM Research - Tokyo
Social
Intelligent assist
Sensing
Accessibility
Brain
Physical assist
Eldercare Research: Focus Areas
IBM Research - Tokyo
Thank you
Hiro Takagi
takagih@jp.ibm.com
Twitter: @hirotakagi

More Related Content

Viewers also liked

Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17
Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17
Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17Hunter Hastings
 
"Classroom Centaurs: A new genre of educational technology"
"Classroom Centaurs:  A new genre of educational technology""Classroom Centaurs:  A new genre of educational technology"
"Classroom Centaurs: A new genre of educational technology"diannepatricia
 
Intelligent tutoring systems (ITS) for online learning
Intelligent tutoring systems (ITS) for online learningIntelligent tutoring systems (ITS) for online learning
Intelligent tutoring systems (ITS) for online learningBrandon Muramatsu
 
Profesionalizar la enseñanza universitaria
Profesionalizar la enseñanza universitariaProfesionalizar la enseñanza universitaria
Profesionalizar la enseñanza universitariaRebeca Marquez
 
Ujian mac bahasa arab 2017( form 3)
Ujian mac bahasa arab 2017( form 3)Ujian mac bahasa arab 2017( form 3)
Ujian mac bahasa arab 2017( form 3)zailani a idris
 
Materi forum komunikasi pengelola jasa makanan dan minuman
Materi forum komunikasi pengelola jasa makanan dan minumanMateri forum komunikasi pengelola jasa makanan dan minuman
Materi forum komunikasi pengelola jasa makanan dan minumanBagus Widi Kurnianto
 
Get Advertising Smart - Be Bold for Change
Get Advertising Smart - Be Bold for ChangeGet Advertising Smart - Be Bold for Change
Get Advertising Smart - Be Bold for Changeemmersons1
 
DevSecOps - CrikeyCon 2017
DevSecOps - CrikeyCon 2017DevSecOps - CrikeyCon 2017
DevSecOps - CrikeyCon 2017kieranjacobsen
 
201407 A System Architecture for Affective Meta Intelligent Tutoring Systems
201407 A System Architecture for Affective Meta Intelligent Tutoring Systems201407 A System Architecture for Affective Meta Intelligent Tutoring Systems
201407 A System Architecture for Affective Meta Intelligent Tutoring SystemsJavier Gonzalez-Sanchez
 
буклеты родителям по пдд
буклеты родителям по пддбуклеты родителям по пдд
буклеты родителям по пддvirtualtaganrog
 
Intrusion Detection Systems and Intrusion Prevention Systems
Intrusion Detection Systems  and Intrusion Prevention Systems Intrusion Detection Systems  and Intrusion Prevention Systems
Intrusion Detection Systems and Intrusion Prevention Systems Cleverence Kombe
 
Millennial Moms + Content
Millennial Moms + ContentMillennial Moms + Content
Millennial Moms + Content(add)ventures
 
3Com 3C597-TX (03-0051-00
3Com 3C597-TX (03-0051-003Com 3C597-TX (03-0051-00
3Com 3C597-TX (03-0051-00savomir
 
How to be a Multimedia expert
How to be a Multimedia expertHow to be a Multimedia expert
How to be a Multimedia expertHi-Tech Animation
 
Evaluation LO4
Evaluation LO4 Evaluation LO4
Evaluation LO4 sdolman
 

Viewers also liked (18)

Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17
Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17
Entrepreneurial super intelligence AERC 2017 Paper Mar-11-17
 
"Classroom Centaurs: A new genre of educational technology"
"Classroom Centaurs:  A new genre of educational technology""Classroom Centaurs:  A new genre of educational technology"
"Classroom Centaurs: A new genre of educational technology"
 
Intelligent tutoring systems (ITS) for online learning
Intelligent tutoring systems (ITS) for online learningIntelligent tutoring systems (ITS) for online learning
Intelligent tutoring systems (ITS) for online learning
 
Profesionalizar la enseñanza universitaria
Profesionalizar la enseñanza universitariaProfesionalizar la enseñanza universitaria
Profesionalizar la enseñanza universitaria
 
TRAB FEITO EOQ
TRAB FEITO EOQTRAB FEITO EOQ
TRAB FEITO EOQ
 
Ujian mac bahasa arab 2017( form 3)
Ujian mac bahasa arab 2017( form 3)Ujian mac bahasa arab 2017( form 3)
Ujian mac bahasa arab 2017( form 3)
 
Secciones conicas
Secciones conicasSecciones conicas
Secciones conicas
 
Materi forum komunikasi pengelola jasa makanan dan minuman
Materi forum komunikasi pengelola jasa makanan dan minumanMateri forum komunikasi pengelola jasa makanan dan minuman
Materi forum komunikasi pengelola jasa makanan dan minuman
 
Get Advertising Smart - Be Bold for Change
Get Advertising Smart - Be Bold for ChangeGet Advertising Smart - Be Bold for Change
Get Advertising Smart - Be Bold for Change
 
DevSecOps - CrikeyCon 2017
DevSecOps - CrikeyCon 2017DevSecOps - CrikeyCon 2017
DevSecOps - CrikeyCon 2017
 
201407 A System Architecture for Affective Meta Intelligent Tutoring Systems
201407 A System Architecture for Affective Meta Intelligent Tutoring Systems201407 A System Architecture for Affective Meta Intelligent Tutoring Systems
201407 A System Architecture for Affective Meta Intelligent Tutoring Systems
 
буклеты родителям по пдд
буклеты родителям по пддбуклеты родителям по пдд
буклеты родителям по пдд
 
Intrusion Detection Systems and Intrusion Prevention Systems
Intrusion Detection Systems  and Intrusion Prevention Systems Intrusion Detection Systems  and Intrusion Prevention Systems
Intrusion Detection Systems and Intrusion Prevention Systems
 
Millennial Moms + Content
Millennial Moms + ContentMillennial Moms + Content
Millennial Moms + Content
 
3Com 3C597-TX (03-0051-00
3Com 3C597-TX (03-0051-003Com 3C597-TX (03-0051-00
3Com 3C597-TX (03-0051-00
 
How to be a Multimedia expert
How to be a Multimedia expertHow to be a Multimedia expert
How to be a Multimedia expert
 
Evaluation LO4
Evaluation LO4 Evaluation LO4
Evaluation LO4
 
Sierra bermeja Parque Nacional
Sierra bermeja Parque NacionalSierra bermeja Parque Nacional
Sierra bermeja Parque Nacional
 

Similar to Cognitive Assistance for the Aging

Heller lowe use of technology to motivate active ageing
Heller lowe   use of technology to motivate active ageingHeller lowe   use of technology to motivate active ageing
Heller lowe use of technology to motivate active ageingAHP_SHU
 
Disability Awareness at Work
Disability Awareness at WorkDisability Awareness at Work
Disability Awareness at WorkJoe Chiappetta
 
Designing for seniors hcii2015 slides
Designing for seniors hcii2015 slidesDesigning for seniors hcii2015 slides
Designing for seniors hcii2015 slidesTAG_lab
 
Renish Dadhaniya - GlobeSync Technologies | Work at a glance
Renish Dadhaniya - GlobeSync Technologies | Work at a glanceRenish Dadhaniya - GlobeSync Technologies | Work at a glance
Renish Dadhaniya - GlobeSync Technologies | Work at a glanceGlobeSync Technologies
 
Marjorie Skubic - Squaring the Life Curve
Marjorie Skubic  - Squaring the Life CurveMarjorie Skubic  - Squaring the Life Curve
Marjorie Skubic - Squaring the Life CurveDaniel Huber
 
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...SharpBrains
 
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...National Center for Telehealth & Technology
 
Australian Computer Society WA, Education 2 Employment
Australian Computer Society WA, Education 2 EmploymentAustralian Computer Society WA, Education 2 Employment
Australian Computer Society WA, Education 2 EmploymentBeacham Group
 
Pietro leo - Active Intelligence
Pietro leo - Active IntelligencePietro leo - Active Intelligence
Pietro leo - Active IntelligencePietro Leo
 
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine mntbs1
 
Niiu digital - SXSW Highlights 2015
Niiu digital - SXSW Highlights 2015Niiu digital - SXSW Highlights 2015
Niiu digital - SXSW Highlights 2015Niiu Digital Inc.
 
Artificial Intelligence for Societal Impact
Artificial Intelligence for Societal ImpactArtificial Intelligence for Societal Impact
Artificial Intelligence for Societal ImpactAmit Sharma
 
Project Management Institute, WA Chapter presentation - Perth
Project Management Institute, WA Chapter presentation - PerthProject Management Institute, WA Chapter presentation - Perth
Project Management Institute, WA Chapter presentation - PerthBeacham Group
 
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To Talk
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To TalkAISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To Talk
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To TalkSimon Harvey
 
Multimedia presentation teahan campbell
Multimedia presentation teahan campbellMultimedia presentation teahan campbell
Multimedia presentation teahan campbellTeahanCampbell
 
CrikeyCon 2019: Mental Health and the InfoSec Community
CrikeyCon 2019: Mental Health and the InfoSec CommunityCrikeyCon 2019: Mental Health and the InfoSec Community
CrikeyCon 2019: Mental Health and the InfoSec CommunitySimon Harvey
 
Bank of America Digital Wellbeing Presentation
Bank of America Digital Wellbeing Presentation Bank of America Digital Wellbeing Presentation
Bank of America Digital Wellbeing Presentation Salema Veliu
 
Internet Health Report 2018
Internet Health Report 2018Internet Health Report 2018
Internet Health Report 2018Irvin Chen
 
NPO應該要了解的網路健康報告!
NPO應該要了解的網路健康報告!NPO應該要了解的網路健康報告!
NPO應該要了解的網路健康報告!Net Tuesday Taiwan
 

Similar to Cognitive Assistance for the Aging (20)

Heller lowe use of technology to motivate active ageing
Heller lowe   use of technology to motivate active ageingHeller lowe   use of technology to motivate active ageing
Heller lowe use of technology to motivate active ageing
 
Disability Awareness at Work
Disability Awareness at WorkDisability Awareness at Work
Disability Awareness at Work
 
Designing for seniors hcii2015 slides
Designing for seniors hcii2015 slidesDesigning for seniors hcii2015 slides
Designing for seniors hcii2015 slides
 
Renish Dadhaniya - GlobeSync Technologies | Work at a glance
Renish Dadhaniya - GlobeSync Technologies | Work at a glanceRenish Dadhaniya - GlobeSync Technologies | Work at a glance
Renish Dadhaniya - GlobeSync Technologies | Work at a glance
 
Marjorie Skubic - Squaring the Life Curve
Marjorie Skubic  - Squaring the Life CurveMarjorie Skubic  - Squaring the Life Curve
Marjorie Skubic - Squaring the Life Curve
 
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...
How can inno­va­tors lever­age crowd­fund­ing and strate­gic invest­ments to ...
 
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...
Practicing in a Connected World: Tech Use Guidelines aka A Mobile Health Guid...
 
Australian Computer Society WA, Education 2 Employment
Australian Computer Society WA, Education 2 EmploymentAustralian Computer Society WA, Education 2 Employment
Australian Computer Society WA, Education 2 Employment
 
Pietro leo - Active Intelligence
Pietro leo - Active IntelligencePietro leo - Active Intelligence
Pietro leo - Active Intelligence
 
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine
Dr. Phil Webb (Velindre University NHS Trust) - Data-driven systems medicine
 
Niiu digital - SXSW Highlights 2015
Niiu digital - SXSW Highlights 2015Niiu digital - SXSW Highlights 2015
Niiu digital - SXSW Highlights 2015
 
Artificial Intelligence for Societal Impact
Artificial Intelligence for Societal ImpactArtificial Intelligence for Societal Impact
Artificial Intelligence for Societal Impact
 
Project Management Institute, WA Chapter presentation - Perth
Project Management Institute, WA Chapter presentation - PerthProject Management Institute, WA Chapter presentation - Perth
Project Management Institute, WA Chapter presentation - Perth
 
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To Talk
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To TalkAISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To Talk
AISA BrisSec 2019: Mental Health and the InfoSec Community - We Need To Talk
 
Bogazici ICF 2015
Bogazici ICF 2015Bogazici ICF 2015
Bogazici ICF 2015
 
Multimedia presentation teahan campbell
Multimedia presentation teahan campbellMultimedia presentation teahan campbell
Multimedia presentation teahan campbell
 
CrikeyCon 2019: Mental Health and the InfoSec Community
CrikeyCon 2019: Mental Health and the InfoSec CommunityCrikeyCon 2019: Mental Health and the InfoSec Community
CrikeyCon 2019: Mental Health and the InfoSec Community
 
Bank of America Digital Wellbeing Presentation
Bank of America Digital Wellbeing Presentation Bank of America Digital Wellbeing Presentation
Bank of America Digital Wellbeing Presentation
 
Internet Health Report 2018
Internet Health Report 2018Internet Health Report 2018
Internet Health Report 2018
 
NPO應該要了解的網路健康報告!
NPO應該要了解的網路健康報告!NPO應該要了解的網路健康報告!
NPO應該要了解的網路健康報告!
 

More from diannepatricia

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsondiannepatricia
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0diannepatricia
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systemsdiannepatricia
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”diannepatricia
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibilitydiannepatricia
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Cardiannepatricia
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”diannepatricia
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...diannepatricia
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...diannepatricia
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”diannepatricia
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"diannepatricia
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligencediannepatricia
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognitiondiannepatricia
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systemsdiannepatricia
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”diannepatricia
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...diannepatricia
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50diannepatricia
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learningdiannepatricia
 
“Semantic Technologies for Smart Services”
“Semantic Technologies for Smart Services” “Semantic Technologies for Smart Services”
“Semantic Technologies for Smart Services” diannepatricia
 

More from diannepatricia (20)

Teaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watsonTeaching cognitive computing with ibm watson
Teaching cognitive computing with ibm watson
 
Cognitive systems institute talk 8 june 2017 - v.1.0
Cognitive systems institute talk   8 june 2017 - v.1.0Cognitive systems institute talk   8 june 2017 - v.1.0
Cognitive systems institute talk 8 june 2017 - v.1.0
 
Building Compassionate Conversational Systems
Building Compassionate Conversational SystemsBuilding Compassionate Conversational Systems
Building Compassionate Conversational Systems
 
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”
 
Cognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving AccessibilityCognitive Insights drive self-driving Accessibility
Cognitive Insights drive self-driving Accessibility
 
Artificial Intellingence in the Car
Artificial Intellingence in the CarArtificial Intellingence in the Car
Artificial Intellingence in the Car
 
“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”“Semantic PDF Processing & Document Representation”
“Semantic PDF Processing & Document Representation”
 
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...
 
170330 cognitive systems institute speaker series mark sherman - watson pr...
170330 cognitive systems institute speaker series    mark sherman - watson pr...170330 cognitive systems institute speaker series    mark sherman - watson pr...
170330 cognitive systems institute speaker series mark sherman - watson pr...
 
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”
 
From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"From complex Systems to Networks: Discovering and Modeling the Correct Network"
From complex Systems to Networks: Discovering and Modeling the Correct Network"
 
The Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented IntelligenceThe Role of Dialog in Augmented Intelligence
The Role of Dialog in Augmented Intelligence
 
Developing Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team CognitionDeveloping Cognitive Systems to Support Team Cognition
Developing Cognitive Systems to Support Team Cognition
 
Cyber-Social Learning Systems
Cyber-Social Learning SystemsCyber-Social Learning Systems
Cyber-Social Learning Systems
 
“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”“IT Technology Trends in 2017… and Beyond”
“IT Technology Trends in 2017… and Beyond”
 
"Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ..."Curious Learning: using a mobile platform for early literacy education as a ...
"Curious Learning: using a mobile platform for early literacy education as a ...
 
Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50Embodied Cognition - Booch HICSS50
Embodied Cognition - Booch HICSS50
 
KATE - a Platform for Machine Learning
KATE - a Platform for Machine LearningKATE - a Platform for Machine Learning
KATE - a Platform for Machine Learning
 
Hicss17 asakawa
Hicss17 asakawaHicss17 asakawa
Hicss17 asakawa
 
“Semantic Technologies for Smart Services”
“Semantic Technologies for Smart Services” “Semantic Technologies for Smart Services”
“Semantic Technologies for Smart Services”
 

Recently uploaded

"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...Elena Simperl
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsPaul Groth
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...Product School
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupCatarinaPereira64715
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesThousandEyes
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...Product School
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...Product School
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1DianaGray10
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxDavid Michel
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Product School
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»QADay
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoTAnalytics
 

Recently uploaded (20)

"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 

Cognitive Assistance for the Aging

  • 1. IBM Research - Tokyo Eldercare Research Hironobu Takagi IBM Research – Tokyo Aging Strategic Initiative
  • 2. IBM Research - Tokyo PercentageofPopulation65yearsandolder Japan Italy Germany Ireland China Australia Brazil US India Egypt 2017 2017 27% World Population Aging
  • 3. IBM Research - Tokyo 62 87 28% Dementia 15% + MCI 13% estimation by Japanese Government, 2012 of people over the age of 65 are at the risk of dementia. 70%of people want to work over the age of 70 (and forever). Life expectancy of women in 1950 and 2015. * numbers in Japan 3% Total social cost per year in Japan is $145B or of the GDP
  • 4. IBM Research - Tokyo We need a new model for active life-long society.
  • 5. IBM Research - Tokyo Eldercare Research: Focus Areas Social Intelligent assist Sensing Accessibility Brain 2003 - 2012 2010 - 2015 - 2016 - Physical assist Japan Post Japan Post
  • 6. IBM Research - Tokyo Eldercare Pilot Project with Japan Post • Pilot with 1000 elderlies completed (Oct. 2015 – Oct. 2016) • Medicine reminders, video telephony, online shopping, photo sharing, etc.
  • 7. IBM Research - Tokyo Global Apple + IBM Apps for Elder Services Care givers Family members Elderly people
  • 8. IBM Research - Tokyo Italian Post
  • 9. IBM Research - Tokyo Eldercare Research: Focus Areas Social Intelligent assist Sensing Accessibility Brain 2003 - 2012 2010 - 2015 - 2016 - Physical assist Japan Post Japan Post
  • 10. IBM Research - Tokyo Voice-base natural user interface for daily watchover • Analyze life patterns, feelings, interests and issues from daily conversation (e.g. cognitive decline detection) • Share information with families and care givers • Provide support that can keep the elderly self-sufficient Conversation as Sensors User Weather Events Meals Activities Life Patterns Cognitive issues Feelings Interests Family & Friends Daily Engagement Alerts & Reports Support workers WATSON
  • 11. IBM Research - Tokyo 11 Conversational Eldercare - DEMO
  • 12. IBM Research - Tokyo Questionnaire Intent “What did you have last night?” Dementia (Neuro Cognitive Disease) Risk Assessment “Did you go out today?” Activity checking “You mentioned about gardening in diary. Are you interested in community gardening?” Recommendation of activities ”Which city do you want to travel?” Marketing “The shop, you mentioned last week, is now on sale!” Promotion “We delivered a package, but you were not there. Please contact post office" Notification (business related) Intent of each questionnaire
  • 13. IBM Research - Tokyo Emotion and Physical Condition Recognition Voice data Features 988 acoustic features for emotion recognition. • Intensity • Loudness • 12 MFCC • Pitch (F0) • Probability of voicing, F0 envelope, • 8 LSF, • Zero-Crossing Rate Labeled voice dataset ML-based Regression Estimation Feeling good or bad 40 0 100 Physical condition Ex: Good night *Each circle represents one greeting. *One participant data Emotion NegativePositive Confusion FrustrationDelight Flow Physical Condition Emotion Yorktown – Speech team Tokyo Research Happy Sad
  • 14. IBM Research - Tokyo Dashboard for Family and Care Givers Condition Emotion (voice sound analysis) Personality analysis (Watson personality insights) Daily activities Eating habits Dementia questionnaire scores and more ….
  • 15. IBM Research - Tokyo Eldercare Research: Focus Areas Social Intelligent assist Sensing Accessibility Brain 2003 - 2012 2010 - 2015 - 2016 - Physical assist Japan Post Japan Post
  • 16. IBM Research - Tokyo th Leading Cause of Death 6 But, interventions during MCI have been shown to be effective Of the top 10 killers, AD is the only one that cannot be prevented, cured, or even slowed 50-95% of the people with dementia never have screening • High income countries: 40-50% (e.g. US 45%) • Low/Middle income countries: 5-10% Societal Impact of Dimentia Poor gait performance can be used for detection and also prediction of dementia and mild cognitive impairments before up to 7-12 years [Buchman & Bennett, Expert Rev. Neurother., 2011] [McGough EL et al . Phys Ther. 2011; Beauchet O et al., J Nutr Health Aging. 2013]
  • 17. IBM Research - Tokyo • Gait speed & its variability • Step frequency • Stride time variability • Step-length & its variability • Foot swing velocity • Stance and stride time • Motor function • Fall risks • Cognitive decline • Episodic memory • Executive function • Diseases • Parkinson disease • MCI • Alzheimer’s disease Feature extraction of gait Features Detection
  • 18. IBM Research - Tokyo
  • 19. IBM Research - Tokyo Brain Simulation: Understanding Alzheimer Disease (2016) 19 APOE-4 carriers APOE-4 non-carriers Investigate whether and how an abnormality in inter-areal structural connectivity observed in APOE-4 carriers (major risk factors in Alzheimer Disease) affects cortical information processing Structural connectivity of APOE-4 carriers might reduce cortical information propagation and lead to negative effects in information integration.
  • 20. IBM Research - Tokyo Social Intelligent assist Sensing Accessibility Brain Physical assist Eldercare Research: Focus Areas
  • 21. IBM Research - Tokyo Thank you Hiro Takagi takagih@jp.ibm.com Twitter: @hirotakagi