SlideShare a Scribd company logo
MOTIVATION OF CHILDREN
WITH CEREBRAL PALSY
BY RAC-CP FUN
(ROBOTICS AGENT COACHER FOR CP
MOTOR FUNCTION)
Dr. Marina Fridin1
Dr. Mark Belokopytov2,3
1Ariel University Center
2Assaf Harofeh Medical Center
3Ben-Gurion University of the Negev
The Therapeutic and Educational Social Robotics Lab
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
CEREBRAL PALSY (CP)
- Spectrum of non-progressive syndromes of posture and
motor impairments that result from an insult to the
developing central nervous system
• Characterized by:
• body function impairments
• activity limitations
• participation limitations
Often accompanied by disturbances of sensation,
cognition, communication, perception, and/or behaviour.
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
SOCIAL ASSISTIVE ROBOTICS (SAR)
- SAR is the class of robots that provide various types of assistance
to various vulnerable populations primarily through social, rather than
physical interaction.
• POPULATIONS:
• Elderly:
• Post- stroke rehabilitation, Matarić, et al., 2007
• Alzheimer’s disease , Tapus et..al. ,2009
• Hospital delivery robot, Mutlu & Forlizzi ,2008
• Nursing home residents , Wada et.al. , 2004
• Children, mainly for children with autism spectrum disorders
(ASD)
• Scassellati, et al. 2007.
• Robins, et al., 2005.
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Hands off
RAC CP Fun
Body Structure & Functions Activity Participation
Environmental
Factors
Personal
Factors
Health condition (disorder or disease)Therapist
Hands on
Motor Actions
I N T E R N AT I O N A L
C L A S S I F I C AT I O N O F
F U N C T I O N I N G , D I S A B I L I T Y
A N D H E A LT H ( I C F )
F R A M E W O R K , ( W H O , 2 0 0 2 )
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
RAC CP Fun
Body Structure & Functions Activity Participation
Environmental
Factors
Personal
Factors
Therapist RAC CP Fun
Health condition (disorder or disease)
Hands on
Conceptual Interference
Environment Taxonomy
Learning Algorithm
Hands off
Human-Robot Interaction
Motor GamesMotor Actions
Adaptation to personality, mood and motor performance
Motivation: feedback, mirroring effect
Team Decomposition
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
MOTIVATION AS PART OF A
GAME
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Embedded features:
• Play-like activate
• Toy appearance of the robot
• Emotional arousal
• Variety of games
NOT ENOUGH…
SUBJECTS
Subject Gender Age (yrs) GMFCS
1 M 5.8 III
2 M 5.9 III
3 M 6.3 I
4 F 5.7 II
5 M 6.2 IV
6 M 5.8 III
7 M 6.1 II
8 M 6.3 III
9 M 4.9 IV
10 M 5.1 II
11 F 5.4 II
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
All diagnosed as CP
SETUP
Operator
Cameras
Staff
~0.8m
~0.5m
~2 m
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
0.5m
1.2m
0.5m
DATA ANALYSIS
• Interaction Level (IL)
• Cognitive Performance (V)
• Motor Performance
3
1
**
F
FSss FWSignECIL
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
RT
AVE
V
)(1
Coding Performance
0 did not perform
1 attempt to perform - 2nd attempt
2 incomplete performance- 2nd attempt
3 attempt to perform - 1st attempt
4 complete performance- 2nd attempt
5 incomplete performance- 1st attempt
6 complete performance- 1st attempt
EXPERIMENT 1:
FIRST MEETING PROCEDURE
• AIM: the robot introduces itself to the children, explains it’s intention,
demonstrates games, explains it’s limitations (ethical issues)
• MOTIVATION: the robots create enjoyable interaction, emotional
arousal, creates personal contact, reduces children’s and staff’s concern
• RESULT: children enjoyed, actively played with robot, participated in the
conversation with the robot , allowed the robot to be in their personal
space
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Procedureflow
Interaction level
-10 0 10 20 30 40
Hello
Introduction
Song
Conversation
Motor game
Robot falls down
Explanation
Parting
0 1 2
Execution
CP
ND
• AIM: motor exercises (symmetrical, asymmetrical, and dual tasks)
• MOTIVATION: the robot is personal toy, personal feedback
• RESULTS: high interaction, high performance (better then educational
staff expected), possible correlation
between exercise difficulty and motivation
EXPERIMENT 2:
ONE-TO-ONE MOTOR INVOLVEMENT
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Procedureflow
Interaction level
0 5 10 15 20
Intro
SM
AM
DT
Motor performance
0 2 4 6
CP
ND
EXPERIMENT 3 :
“ROBY SAID”
• AIM: collaborative motor game (symmetrical, asymmetrical, and complex
tasks), selective attention
• MOTIVATION: the robot initiates and mediates a social game
• RESULTS: children enjoy, high interaction, improvement in motor
performance and selective attention
• CHALLENGE: variability of children’s reactions and abilities, need of
“social psychology” approach (despair attention, feedback, adaptive game’s
flow)
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
EXPERIMENT 4:
”FOUR SEASONS”
• AIM: to explore a possibility to facilitate the development of spatial cognition
(as example of cognitive abilities) of the children
• MOTIVATION: competition between children, experience in operating the
robot, classical music, dancing
• RESULTS: children enjoyed, their cognitive performance were improved
• CHALLENGE: adjustment of the robot’s behavior to the variability of the
physical and mental abilities of the children
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Sketch Picture
IL
V
EXPERIMENT 5:
COMPLEX INTERACTION
• AIM: to test a constructive learning approach (using books and
furniture), accompanied with motor and cognitive development
• MOTIVATION: the robot is a “help-seeker”, natural environment
• RESULT: “help-seeker” is efficient, single robot’s can not fit complex
interaction
• CHALLENGE: need for assortment of behaviors driven by the child’s
personality
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
VARIABILITY of REACTIONS
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
E., 4 yrs, Hemiplegia, ADHD, GMFSC I
M., 4 yrs, Spastic diplegia, ADHD, GMFCS II
A., 6 yrs, Hemiplegia, GMFSC III
D., 6 yrs, Spastic syndrome, ADHD, GMFSC I
Fragment of long scenario. Goal: to induce arm rising to maximal range
THE SCHEME OF THE RAC CP FUN
MODULES AND DATA FLOW
Low-level Perception
• Kinect: Motion processing
• Robot’s Video:
High color saturation filters
Skin-color filters
Edge detection
Disparity computation
• Robot’s Sensors: Data filtering
Motor module
• Visual-motor skills
• Manipulation skills (reaching/ grasping)
• Expressive skills (bodily/facial/vocalizations)
Attention module
• Attention on a child with fastest/slowest reactions
• Attention on a child defined by physiotherapist
Motivation module
• Positive-negative reinforcement
• Qualitive and quantative feedback
• Empathy and mirroring effect
Behavior module
• Behavior selection
• Decomposition to the set of
operations: body
movements, operational
vocabulary, sounds, emotiona
l expressions
High-level Perception
• Visual:
Scene analysis and segmentation
Face and eye detection
Whole body labeling
Subjects identification
Gaze direction
Emotional Recognition
• Kinect: Extremities movement analysis
• Sensory Data fusion
Adaptation module
• Adjustment to the stage of motor learning
• Mood and current success level
• Personality matching: hyperactive/passive
Information analysis module
• Subject’s motor behavior analysis
• Subject’s cognitive behavior analysis
• Monitoring of the level of interaction strength
• Recognition of subjects attention state
Input
• Robot: Sensors data, including Scene video
• Kinect: Movement tracking
• Physiotherapist: Settings
Personal and Anthropometric data
Functional (pathological) restrictions
Tasks difficulty
Session scenario components
Safety module
• Avoid children in robot’s working space
Databas
e
Self-awareness module
• Error detection/Success measuring
Locomotion, Falling, Manipulation
• Robot localization
Personal Information
Pathology characteristics:
GMFCS, Altered side, Assistive device
Motor functions : Time of sit-stand
initiation, Symmetry of holding arms
Child-Robot Interaction Measurements:
Emotional status, Responsiveness
Environment: Place, # participants
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
SUMMARY
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
Unconstrained interaction
Personal toy
Social mediator
Combined:
competitive, entertaining,
operated by a child
Help-seeker
Strategy for motivation
Assortment
of behaviors
Taskcomplexity
Variabilityofreactions
Need
CONCLUSIONS
● RAC CP FUN is a feasible and promising new research
area of social assistive technology with immeasurable
potential
● RAC CP FUN may stimulate the development of new
treatments for a wide variety of diseases and disorders
through effective physiotherapy practice
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
RESEARCH GROUP
Dr. Mark BelokopytovDr. Simona Bar-Haim
Bella DavidovGuy Keren
Ronit Aviram
MESHI Jerusalem
Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
IROS 2012
THANK YOU FOR
ATTENTION

More Related Content

Similar to Social Assistive Robotics for children with Cerebral Palsy

Teacch programme for Autism spectrum Disorder
Teacch programme for Autism spectrum DisorderTeacch programme for Autism spectrum Disorder
Teacch programme for Autism spectrum Disorder
Heba Essawy, MD
 
Interaction between abstract agents: Increasing the readability of causal e...
Interaction between abstract agents:  Increasing the readability of causal  e...Interaction between abstract agents:  Increasing the readability of causal  e...
Interaction between abstract agents: Increasing the readability of causal e...
Mindtrek
 
PHYSIOLOGY Chap9
PHYSIOLOGY Chap9PHYSIOLOGY Chap9
PHYSIOLOGY Chap9
Sheldon Nelson
 
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
Dennis Kappen
 
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
Marina Fridin
 
Galloway
GallowayGalloway
Galloway
Jesse Lingeman
 
Occupational therapy in school settings.1.16.2012.rev
Occupational therapy in school settings.1.16.2012.revOccupational therapy in school settings.1.16.2012.rev
Occupational therapy in school settings.1.16.2012.rev
carrollamyp
 
Hippotherapy module 13 EN
Hippotherapy module 13 ENHippotherapy module 13 EN
Hippotherapy module 13 EN
Karel Van Isacker
 
Poster
PosterPoster
Poster
Jon P. Emory
 
Abracadabra professional
Abracadabra professional Abracadabra professional
Abracadabra professional
Marina Fridin
 
Neuropsychological Implications Of Ucd
Neuropsychological Implications Of UcdNeuropsychological Implications Of Ucd
Neuropsychological Implications Of Ucd
zmiers
 
Sensory Integration the body centered senses_2021_On-Demand.pdf
Sensory Integration the body centered senses_2021_On-Demand.pdfSensory Integration the body centered senses_2021_On-Demand.pdf
Sensory Integration the body centered senses_2021_On-Demand.pdf
cristiangheorgherist
 
Disrupted Futures 2023 | Social and emotional competences of practitioners
Disrupted Futures 2023 | Social and emotional competences of practitionersDisrupted Futures 2023 | Social and emotional competences of practitioners
Disrupted Futures 2023 | Social and emotional competences of practitioners
EduSkills OECD
 
Lifespan Development and Occupational Transitions -Model of human occupation
Lifespan Development and Occupational Transitions -Model of human occupationLifespan Development and Occupational Transitions -Model of human occupation
Lifespan Development and Occupational Transitions -Model of human occupation
Stephan Van Breenen
 
Perceptual and cognitive disorder
Perceptual and cognitive disorderPerceptual and cognitive disorder
Perceptual and cognitive disorder
Shiva Tiwari
 
Emotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost SensorsEmotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost Sensors
Nicole Novielli
 
Motivation in physiotherapy
Motivation in  physiotherapyMotivation in  physiotherapy
Motivation in physiotherapy
Marina Fridin
 
Occupational therapy task analyzis
Occupational therapy task analyzisOccupational therapy task analyzis
Occupational therapy task analyzis
Stephan Van Breenen
 
Problem Solving in Everyday Life Following Brain Injury: Current Research
Problem Solving in Everyday Life Following Brain Injury: Current Research Problem Solving in Everyday Life Following Brain Injury: Current Research
Problem Solving in Everyday Life Following Brain Injury: Current Research
cbirtpresent
 
Using A Humanoid Robot to Learn Social Skills
Using A Humanoid Robot to Learn Social SkillsUsing A Humanoid Robot to Learn Social Skills
Using A Humanoid Robot to Learn Social Skills
cjemitchell
 

Similar to Social Assistive Robotics for children with Cerebral Palsy (20)

Teacch programme for Autism spectrum Disorder
Teacch programme for Autism spectrum DisorderTeacch programme for Autism spectrum Disorder
Teacch programme for Autism spectrum Disorder
 
Interaction between abstract agents: Increasing the readability of causal e...
Interaction between abstract agents:  Increasing the readability of causal  e...Interaction between abstract agents:  Increasing the readability of causal  e...
Interaction between abstract agents: Increasing the readability of causal e...
 
PHYSIOLOGY Chap9
PHYSIOLOGY Chap9PHYSIOLOGY Chap9
PHYSIOLOGY Chap9
 
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
 
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
Kindergarten Socail Assistive Robotics (KindSAR) for Children's Cognitive and...
 
Galloway
GallowayGalloway
Galloway
 
Occupational therapy in school settings.1.16.2012.rev
Occupational therapy in school settings.1.16.2012.revOccupational therapy in school settings.1.16.2012.rev
Occupational therapy in school settings.1.16.2012.rev
 
Hippotherapy module 13 EN
Hippotherapy module 13 ENHippotherapy module 13 EN
Hippotherapy module 13 EN
 
Poster
PosterPoster
Poster
 
Abracadabra professional
Abracadabra professional Abracadabra professional
Abracadabra professional
 
Neuropsychological Implications Of Ucd
Neuropsychological Implications Of UcdNeuropsychological Implications Of Ucd
Neuropsychological Implications Of Ucd
 
Sensory Integration the body centered senses_2021_On-Demand.pdf
Sensory Integration the body centered senses_2021_On-Demand.pdfSensory Integration the body centered senses_2021_On-Demand.pdf
Sensory Integration the body centered senses_2021_On-Demand.pdf
 
Disrupted Futures 2023 | Social and emotional competences of practitioners
Disrupted Futures 2023 | Social and emotional competences of practitionersDisrupted Futures 2023 | Social and emotional competences of practitioners
Disrupted Futures 2023 | Social and emotional competences of practitioners
 
Lifespan Development and Occupational Transitions -Model of human occupation
Lifespan Development and Occupational Transitions -Model of human occupationLifespan Development and Occupational Transitions -Model of human occupation
Lifespan Development and Occupational Transitions -Model of human occupation
 
Perceptual and cognitive disorder
Perceptual and cognitive disorderPerceptual and cognitive disorder
Perceptual and cognitive disorder
 
Emotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost SensorsEmotion Detection Using Noninvasive Low-cost Sensors
Emotion Detection Using Noninvasive Low-cost Sensors
 
Motivation in physiotherapy
Motivation in  physiotherapyMotivation in  physiotherapy
Motivation in physiotherapy
 
Occupational therapy task analyzis
Occupational therapy task analyzisOccupational therapy task analyzis
Occupational therapy task analyzis
 
Problem Solving in Everyday Life Following Brain Injury: Current Research
Problem Solving in Everyday Life Following Brain Injury: Current Research Problem Solving in Everyday Life Following Brain Injury: Current Research
Problem Solving in Everyday Life Following Brain Injury: Current Research
 
Using A Humanoid Robot to Learn Social Skills
Using A Humanoid Robot to Learn Social SkillsUsing A Humanoid Robot to Learn Social Skills
Using A Humanoid Robot to Learn Social Skills
 

Recently uploaded

Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 

Recently uploaded (20)

Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 

Social Assistive Robotics for children with Cerebral Palsy

  • 1. MOTIVATION OF CHILDREN WITH CEREBRAL PALSY BY RAC-CP FUN (ROBOTICS AGENT COACHER FOR CP MOTOR FUNCTION) Dr. Marina Fridin1 Dr. Mark Belokopytov2,3 1Ariel University Center 2Assaf Harofeh Medical Center 3Ben-Gurion University of the Negev The Therapeutic and Educational Social Robotics Lab Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 2. CEREBRAL PALSY (CP) - Spectrum of non-progressive syndromes of posture and motor impairments that result from an insult to the developing central nervous system • Characterized by: • body function impairments • activity limitations • participation limitations Often accompanied by disturbances of sensation, cognition, communication, perception, and/or behaviour. Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 3. SOCIAL ASSISTIVE ROBOTICS (SAR) - SAR is the class of robots that provide various types of assistance to various vulnerable populations primarily through social, rather than physical interaction. • POPULATIONS: • Elderly: • Post- stroke rehabilitation, Matarić, et al., 2007 • Alzheimer’s disease , Tapus et..al. ,2009 • Hospital delivery robot, Mutlu & Forlizzi ,2008 • Nursing home residents , Wada et.al. , 2004 • Children, mainly for children with autism spectrum disorders (ASD) • Scassellati, et al. 2007. • Robins, et al., 2005. Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 4. Hands off RAC CP Fun Body Structure & Functions Activity Participation Environmental Factors Personal Factors Health condition (disorder or disease)Therapist Hands on Motor Actions I N T E R N AT I O N A L C L A S S I F I C AT I O N O F F U N C T I O N I N G , D I S A B I L I T Y A N D H E A LT H ( I C F ) F R A M E W O R K , ( W H O , 2 0 0 2 ) Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 5. RAC CP Fun Body Structure & Functions Activity Participation Environmental Factors Personal Factors Therapist RAC CP Fun Health condition (disorder or disease) Hands on Conceptual Interference Environment Taxonomy Learning Algorithm Hands off Human-Robot Interaction Motor GamesMotor Actions Adaptation to personality, mood and motor performance Motivation: feedback, mirroring effect Team Decomposition Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 6. MOTIVATION AS PART OF A GAME Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 Embedded features: • Play-like activate • Toy appearance of the robot • Emotional arousal • Variety of games NOT ENOUGH…
  • 7. SUBJECTS Subject Gender Age (yrs) GMFCS 1 M 5.8 III 2 M 5.9 III 3 M 6.3 I 4 F 5.7 II 5 M 6.2 IV 6 M 5.8 III 7 M 6.1 II 8 M 6.3 III 9 M 4.9 IV 10 M 5.1 II 11 F 5.4 II Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 All diagnosed as CP
  • 8. SETUP Operator Cameras Staff ~0.8m ~0.5m ~2 m Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 0.5m 1.2m 0.5m
  • 9. DATA ANALYSIS • Interaction Level (IL) • Cognitive Performance (V) • Motor Performance 3 1 ** F FSss FWSignECIL Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 RT AVE V )(1 Coding Performance 0 did not perform 1 attempt to perform - 2nd attempt 2 incomplete performance- 2nd attempt 3 attempt to perform - 1st attempt 4 complete performance- 2nd attempt 5 incomplete performance- 1st attempt 6 complete performance- 1st attempt
  • 10. EXPERIMENT 1: FIRST MEETING PROCEDURE • AIM: the robot introduces itself to the children, explains it’s intention, demonstrates games, explains it’s limitations (ethical issues) • MOTIVATION: the robots create enjoyable interaction, emotional arousal, creates personal contact, reduces children’s and staff’s concern • RESULT: children enjoyed, actively played with robot, participated in the conversation with the robot , allowed the robot to be in their personal space Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 11. Procedureflow Interaction level -10 0 10 20 30 40 Hello Introduction Song Conversation Motor game Robot falls down Explanation Parting 0 1 2 Execution CP ND
  • 12. • AIM: motor exercises (symmetrical, asymmetrical, and dual tasks) • MOTIVATION: the robot is personal toy, personal feedback • RESULTS: high interaction, high performance (better then educational staff expected), possible correlation between exercise difficulty and motivation EXPERIMENT 2: ONE-TO-ONE MOTOR INVOLVEMENT Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 13. Procedureflow Interaction level 0 5 10 15 20 Intro SM AM DT Motor performance 0 2 4 6 CP ND
  • 14. EXPERIMENT 3 : “ROBY SAID” • AIM: collaborative motor game (symmetrical, asymmetrical, and complex tasks), selective attention • MOTIVATION: the robot initiates and mediates a social game • RESULTS: children enjoy, high interaction, improvement in motor performance and selective attention • CHALLENGE: variability of children’s reactions and abilities, need of “social psychology” approach (despair attention, feedback, adaptive game’s flow) Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 15.
  • 16. EXPERIMENT 4: ”FOUR SEASONS” • AIM: to explore a possibility to facilitate the development of spatial cognition (as example of cognitive abilities) of the children • MOTIVATION: competition between children, experience in operating the robot, classical music, dancing • RESULTS: children enjoyed, their cognitive performance were improved • CHALLENGE: adjustment of the robot’s behavior to the variability of the physical and mental abilities of the children Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 18. EXPERIMENT 5: COMPLEX INTERACTION • AIM: to test a constructive learning approach (using books and furniture), accompanied with motor and cognitive development • MOTIVATION: the robot is a “help-seeker”, natural environment • RESULT: “help-seeker” is efficient, single robot’s can not fit complex interaction • CHALLENGE: need for assortment of behaviors driven by the child’s personality Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 19. VARIABILITY of REACTIONS Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 E., 4 yrs, Hemiplegia, ADHD, GMFSC I M., 4 yrs, Spastic diplegia, ADHD, GMFCS II A., 6 yrs, Hemiplegia, GMFSC III D., 6 yrs, Spastic syndrome, ADHD, GMFSC I Fragment of long scenario. Goal: to induce arm rising to maximal range
  • 20. THE SCHEME OF THE RAC CP FUN MODULES AND DATA FLOW Low-level Perception • Kinect: Motion processing • Robot’s Video: High color saturation filters Skin-color filters Edge detection Disparity computation • Robot’s Sensors: Data filtering Motor module • Visual-motor skills • Manipulation skills (reaching/ grasping) • Expressive skills (bodily/facial/vocalizations) Attention module • Attention on a child with fastest/slowest reactions • Attention on a child defined by physiotherapist Motivation module • Positive-negative reinforcement • Qualitive and quantative feedback • Empathy and mirroring effect Behavior module • Behavior selection • Decomposition to the set of operations: body movements, operational vocabulary, sounds, emotiona l expressions High-level Perception • Visual: Scene analysis and segmentation Face and eye detection Whole body labeling Subjects identification Gaze direction Emotional Recognition • Kinect: Extremities movement analysis • Sensory Data fusion Adaptation module • Adjustment to the stage of motor learning • Mood and current success level • Personality matching: hyperactive/passive Information analysis module • Subject’s motor behavior analysis • Subject’s cognitive behavior analysis • Monitoring of the level of interaction strength • Recognition of subjects attention state Input • Robot: Sensors data, including Scene video • Kinect: Movement tracking • Physiotherapist: Settings Personal and Anthropometric data Functional (pathological) restrictions Tasks difficulty Session scenario components Safety module • Avoid children in robot’s working space Databas e Self-awareness module • Error detection/Success measuring Locomotion, Falling, Manipulation • Robot localization Personal Information Pathology characteristics: GMFCS, Altered side, Assistive device Motor functions : Time of sit-stand initiation, Symmetry of holding arms Child-Robot Interaction Measurements: Emotional status, Responsiveness Environment: Place, # participants Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 21. SUMMARY Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012 Unconstrained interaction Personal toy Social mediator Combined: competitive, entertaining, operated by a child Help-seeker Strategy for motivation Assortment of behaviors Taskcomplexity Variabilityofreactions Need
  • 22. CONCLUSIONS ● RAC CP FUN is a feasible and promising new research area of social assistive technology with immeasurable potential ● RAC CP FUN may stimulate the development of new treatments for a wide variety of diseases and disorders through effective physiotherapy practice Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 23. RESEARCH GROUP Dr. Mark BelokopytovDr. Simona Bar-Haim Bella DavidovGuy Keren Ronit Aviram MESHI Jerusalem Workshop on Motivational Aspects of Robotics in Physical Therapy, IROS 2012
  • 24. IROS 2012 THANK YOU FOR ATTENTION

Editor's Notes

  1. Gross motor function classification system
  2. Our work to date demonstrates the promise of RAC CP FUN, a new research area of social assistive technology with immeasurable potential. SAR technology is still in its infancy, but the results of our experiment demonstrate how assistive robotic platforms can be used in the near future in hospitals and homes, in training and therapeutic programs that monitor, encourage, and assist their users. This multidisciplinary project will not only open a window to other advanced applications of advanced robotic interactive technology, but may also stimulate the development of new treatments for a wide variety of diseases and disorders through effective physiotherapy practice.
  3. Our work to date demonstrates the promise of RAC CP FUN, a new research area of social assistive technology with immeasurable potential. SAR technology is still in its infancy, but the results of our experiment demonstrate how assistive robotic platforms can be used in the near future in hospitals and homes, in training and therapeutic programs that monitor, encourage, and assist their users. This multidisciplinary project will not only open a window to other advanced applications of advanced robotic interactive technology, but may also stimulate the development of new treatments for a wide variety of diseases and disorders through effective physiotherapy practice.