Serious games for upper limb rehabilitation following stroke


Published on

Presented at First International IEEE Conference in Serious Games and Virtual Worlds.

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Serious games for upper limb rehabilitation following stroke

  1. 1. Serious games for upper limb rehabilitation following stroke J. W. Burke, M. D. J. McNeill, D. K. Charles, P. J. Morrow School of Computing and Information Engineering J. H. Crosbie, S. M. McDonough School of Health Sciences University of Ulster
  2. 2. Contents <ul><li>Overview </li></ul><ul><li>Background on Stroke </li></ul><ul><li>Technology for Stroke Rehabilitation </li></ul><ul><li>Previous Studies </li></ul><ul><li>Game Design & Rehabilitation </li></ul><ul><li>University of Ulster Work </li></ul><ul><ul><ul><li>Virtual Reality Games </li></ul></ul></ul><ul><ul><ul><li>Webcam Games </li></ul></ul></ul><ul><ul><ul><li>Nintendo Wiimote </li></ul></ul></ul><ul><li>Design Principles in Our Games </li></ul><ul><li>Usability Study </li></ul><ul><li>Final Remarks </li></ul>
  3. 3. Overview <ul><li>THE PROBLEM AREA: </li></ul><ul><li>Stroke is a leading cause of severe physical disability. </li></ul><ul><li>Effective rehabilitation must be early , intensive and repetitive . </li></ul><ul><li>Difficult to maintain patient motivation. </li></ul><ul><li>THE PROPOSED SOLUTION: </li></ul><ul><li>Games may be effective in optimising engagement. </li></ul><ul><li>We have developed a serious game system for upper limb post-stroke rehabilitation . </li></ul>
  4. 4. Stroke <ul><li>Impairments : attention and concentration deficiencies, balance loss, pain, weakness and paralysis. </li></ul><ul><li>Can cause depression and fatigue . </li></ul><ul><li>Early and intensive practice of functional tasks in an enriched environment show more positive outcomes for upper limb rehabilitation. </li></ul><ul><li>Tasks often mundane and boring . </li></ul><ul><li>Rehabilitation can require patients to travel to specialised units. </li></ul><ul><li>High healthcare costs. </li></ul>
  5. 5. Traditional Therapy Video
  6. 6. Technology for Stroke Rehabilitation <ul><li>BENEFITS: </li></ul><ul><li>Rehabilitation systems which are novel , interesting , safe and customisable to a particular user’s abilities and interests. </li></ul><ul><li>Motivate , involve and immerse the user. </li></ul><ul><li>Potential for home use . </li></ul><ul><ul><li>Performance data recorded at home, uploaded to remote site. </li></ul></ul><ul><li>LIMITATIONS: </li></ul><ul><li>Clinically valid? [Burdea, 2002; Crosbie, 2008; Rizzo, 2005] </li></ul><ul><li>Cost and size of equipment? </li></ul><ul><li>Expertise required? </li></ul>
  7. 7. Previous Studies <ul><li>BESPOKE: </li></ul><ul><li>S ensor-based systems [Crosbie, 2004; Yeh, 2005] </li></ul><ul><li>Xbox console with P5 glove [Morrow, 2006] </li></ul><ul><li>Haptics & Robotics [Boian, 2002; Guo, 2007; Podobnik, 2008] </li></ul><ul><li>ADAPTED: </li></ul><ul><li>Gesture Xtreme / IREX [Rand, 2004] </li></ul><ul><li>Sony EyeToy [Rand, 2004; Yavuzer, 2008] </li></ul><ul><li>Open source games [Herbelin, 2008] </li></ul><ul><li>Nintendo Wii [ongoing studies] </li></ul><ul><li>REVIEWS: [Burdea, 2003; Crosbie, 2004; Weiss, 2004; Rizzo, 2005; Rizzo, 2008; Flores, 2008] </li></ul>
  8. 8. <ul><li>Designers of rehabilitation tasks can benefit from examining the formulas that commercial game developers use… [Rizzo & Kim, 2005] </li></ul><ul><li>MEANINGFUL PLAY: </li></ul><ul><li>Conservative response to failure – reward all engagement . </li></ul><ul><li>Goals spanning multiple sessions to reward atypical player behaviour . </li></ul><ul><ul><li>E.g. Rewards for time spent playing game. </li></ul></ul>Game Design & Rehabilitation ” “ Inputs choices Discernable and integrated outcome Player Game Meaningful play Feedback
  9. 9. Game Design & Rehabilitation <ul><li>CHALLENGE: </li></ul><ul><li>Challenge needs to match patient’s abilities . </li></ul><ul><li>Maintains engagement . </li></ul><ul><li>How to maintain challenge? </li></ul><ul><ul><li>Manual difficulty adjustment? </li></ul></ul><ul><ul><li>Adaptivity ? </li></ul></ul><ul><ul><li>Levels of increasing difficulty? </li></ul></ul><ul><li>Speed , position and size of game elements can set level of challenge. </li></ul><ul><li>In-game calibration can determine suitable level of challenge for player’s abilities. </li></ul>[Rabin, 2005]
  10. 10. Uni. of Ulster Work <ul><li>VIRTUAL REALITY GAMES: </li></ul><ul><li>Bilateral catch task: </li></ul><ul><ul><li>Uses an electromagnetic sensor attached to a real physical basket. </li></ul></ul><ul><ul><li>User moves basket with both hands to catch falling oranges. </li></ul></ul><ul><ul><li>Various adjustable parameters. </li></ul></ul><ul><li>Adaptive ‘Whack-a-Mouse’ game: </li></ul><ul><ul><li>Sensor attached to player’s hand. </li></ul></ul><ul><ul><li>Encourages arm movement and visual discrimination. </li></ul></ul><ul><ul><li>Initial configuration based on assessment prior to play. </li></ul></ul><ul><li>Further information - [Ma, 2007] </li></ul>Slide of
  11. 11. Uni. of Ulster Work <ul><li>WEBCAM GAMES: </li></ul><ul><li>Simple 2D games which use a webcam image as input. </li></ul><ul><li>Game library where all games share patient profile . </li></ul><ul><ul><li>Profile stores reaching ability, play-time, scores, long-term progress, regions of difficulty and skill level. </li></ul></ul><ul><li>Played with coloured gloves or any single coloured object. </li></ul><ul><li>No attaching of wires required , untethered movement. </li></ul><ul><li>Games can be played standing up or seated . </li></ul><ul><li>Potential for home rehabilitation . </li></ul><ul><li>No expertise required . </li></ul>
  12. 12. Uni. of Ulster Work <ul><li>Single Arm Exercise: </li></ul><ul><li>“ Rabbit Chase” </li></ul><ul><ul><li>Player must catch a rabbit as it peers out of holes on the screen. </li></ul></ul><ul><li>“ Bubble Trouble” </li></ul><ul><ul><li>Player must burst bubbles as they float around the screen. </li></ul></ul><ul><li>Bimanual Arm Exercise: </li></ul><ul><li>“ Arrow Attack” </li></ul><ul><ul><li>Player must touch corresponding arrows with both hands simultaneously as they enter boxes. </li></ul></ul>
  13. 13. Uni. of Ulster Work <ul><li>Initial reach calibration: </li></ul><ul><li>Player must roll each ball as far as they possibly can. </li></ul><ul><li>Allows system to determine range of movement and position game elements accordingly. </li></ul><ul><li>Camera calibration tool: </li></ul><ul><li>Allows refining of colour detection settings. </li></ul><ul><li>Hope to improve automation of colour detection in future. </li></ul>
  14. 14. Webcam Games Video
  15. 15. Uni. of Ulster Work <ul><li>NINTENDO WIIMOTE VIBRAPHONE: </li></ul><ul><li>Instrument simulator using multiple Nintendo Wii remotes. </li></ul><ul><li>Works with PC, interfacing through a bluetooth dongle . </li></ul><ul><li>User can create a tune, or play back a tune in a timed game mode. </li></ul><ul><li>Potential for wrist and arm rehabilitation. </li></ul>
  16. 16. Design Principles in Our Games <ul><li>Auditory feedback: Sound indicators (hit, miss, play note). </li></ul><ul><li>Visual feedback: Hit or miss messages, target changing colour, particle effects, score indicator, time indicator, progress graph. </li></ul><ul><li>Level of challenge can be manually adjusted. </li></ul><ul><li>Optional adaptivity to adjust speed and position of game elements according to player’s successive hits or misses. </li></ul>
  17. 17. Usability Study <ul><li>Usability study of 10 able bodied users playing the two webcam games and vibraphone application. </li></ul><ul><li>Majority of participants enjoyed all games . </li></ul><ul><li>Players felt games were enjoyable , replayable and easy to play due to intuitive controls. </li></ul><ul><li>Apativity approved by those who noticed it (>80%), indicating the game would be less enjoyable without it. </li></ul><ul><ul><li>One user expressed that the adaptivity was too aggressive. </li></ul></ul><ul><li>> 80% agreed that the feedback was effective . </li></ul><ul><ul><li>Some players reported it was difficult to see their score during gameplay. </li></ul></ul><ul><li>With the Vibraphone game, some users found the controls to be too sensitive. </li></ul>
  18. 18. Final Remarks <ul><li>FURTHER WORK: </li></ul><ul><li>Single patient case studies for playability evaluation are underway with people with stroke – initial feedback is very positive. </li></ul><ul><li>Larger study planned to assess impact of games on motor function. </li></ul><ul><li>How to provide a consistent level of challenge for a patient during rehabilitation? </li></ul><ul><li>CONCLUSION: </li></ul><ul><li>Games have potential to engage and motivate during rehabilitation. </li></ul><ul><li>No need for computer or video game experience. </li></ul><ul><li>Low-cost off-the-shelf hardware may offer an opportunity for home rehabilitation in addition to traditional therapy. </li></ul>
  19. 19. Questions? <ul><li>This work was supported by the Department for Employment and Learning (DEL) , Northern Ireland. </li></ul><ul><li>E-mail: [email_address] </li></ul><ul><li>Website: </li></ul>
  20. 20. References <ul><li>BOIAN, R., SHARMA, A., HAN, C., MERIANS, A., BURDEA, G., ADAMOVICH, S., RECCE, M., TREMAINE, M. and POIZNER, H., 2002. Virtual Reality-Based Post-Stroke Hand Rehabilitation, 2002 Proceedings of Medicine Meets Virtual Reality Conference, 2002, IOS Press pp. 64-70. </li></ul><ul><li>BURDEA, G., 2002. Key Note Address: Virtual Rehabilitation - Benefits and Challenges, 1st International Workshop on Virtual Reality Rehabilitation (Mental Health, Neurological, Physical, Vocational), VRMHR’2002, November 7-8 2002, pp. 1-11. </li></ul><ul><li>BURDEA, G., 2003. Virtual Rehabilitation - Benefits and Challenges. International Medical Informatics Association Yearbook of Medical Informatics, , pp. 170-176. </li></ul><ul><li>CROSBIE, J.H., LENNON, S., MCGOLDRICK, M.C., MCNEILL, M.D.J., BURKE, J.W. and MCDONOUGH, S.M., 2008. Virtual reality in the rehabilitation of the upper limb after hemiplegic stroke: a randomised pilot study, Proc. 7th ICDVRAT with ArtAbilitation, 2008, pp. 229-235. </li></ul><ul><li>CROSBIE, J.H., MCDONOUGH, S.M., LENNON, S., POKLUDA, L. and MCNEILL, M.D.J., 2004. Virtual Reality in the Rehabilitation of the Upper Limb After Stroke: The User’s Perspective, 5th International Conference for Disability, Virtual Reality and Associated Technology, 2004, ICDVRAT / University of Reading pp. 215-224. </li></ul><ul><li>FLORES, E., TOBON, G., CAVALLARO, E., CAVALLARO, F.I., PERRY, J.C. and KELLER, T., 2008. Improving Patient Motivation in Game Development for Motor Deficit Rehabilitation, Advances in Computer Entertainment Technology, 2008, pp. 381-384. </li></ul><ul><li>GUO, S., SONG, G. and SONG, Z., 2007. Development of a Self-assisted Rehabilitation System for Upper Limbs Based on Virtual Reality, International Conference on Mechatronics and Automation 2007. 2007, IEEE pp. 1452-1457. </li></ul><ul><li>HERBELIN, B., CIGER, J. and BROOKS, A.L., 2008. Customization of gaming technology and prototyping of rehabilitation applications, Proc. 7th ICDVRAT with ArtAbilitation, 2008, pp. 211-218. </li></ul><ul><li>MA, M., MCNEILL, M., CHARLES, D., MCDONOUGH, S., CROSBIE, J., OLIVER, L. and MCGOLDRICK, C., 2007. Adaptive Virtual Reality Games for Rehabilitation of Motor Disorders. Lecture Notes in Computer Science. Springer Berlin / Heidelberg, pp. 681-690. </li></ul><ul><li>MORROW, K., DOCAN, C., BURDEA, G. and MERIANS, A., 2006. Low-Cost Virtual Rehabilitation of the Hand for Patients Post-Stroke, 2006 International Workshop on Virtual Rehabilitation, 2006, IEEE pp. 6-10. </li></ul><ul><li>PODOBNIK, J., MUNIH, M. and CINKELJ, J., 2008. HARMiS: hand and arm rehabilitation system, Proc. 7th ICDVRAT with ArtAbilitation, 2008, pp. 237-244. </li></ul><ul><li>RAND, D., KIZONY, R. and WEISS, P.L., 2004. Virtual reality rehabilitation for all: Vivid GX versus Sony PlayStation II EyeToy, Proceedings of the 5th International Conference on Disability, Virtual Reality & Associated Technology, 2004, ICDVRAT pp. 87-94. </li></ul><ul><li>RIZZO, A.A., 2008. Virtual reality in psychology and rehabilitation: the last ten years and the next! Proc. 7th ICDVRAT with ArtAbilitation, 2008, pp. 3-6. </li></ul><ul><li>RIZZO, A. and KIM, G.J., 2005. A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy. Presence: Teleoperators and Virtual Environments, 14(2), pp. 119-146. </li></ul><ul><li>WEISS, P.L., RAND, D., KATZ, N. and KIZONY, R., 2004. Video Capture Virtual Reality as a Flexible and Effective Rehabilitation Tool. Journal of NeuroEngineering and Rehabilitation, 1(12). </li></ul><ul><li>YAVUZER, G., SENEL, A., ATAY, M.B. and STAM, H.J., 2008. Playstation eyetoy games improve upper extremity-related motor functioning in subacute stroke: a randomized controlled clinical trial. European Journal of Physical and Rehabilitation Medicine, 44. </li></ul><ul><li>YEH, S., RIZZO, A., ZHU, W., STEWART, J., MCLAUGHLIN, M., COHEN, I., JUNG, Y. and PENG, W., 2005. An Integrated System: Virtual Reality, Haptics and Modern Sensing Technique (VHS), Proceedings of the ACM symposium on Virtual reality software and technology, 2005, ACM pp59-62. </li></ul>