Visual Scene Displays


Published on

Presentation at the More Than Gadgets conference in Perth in 2011

Published in: Health & Medicine
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Visual Scene Displays

  1. 1. Visual Scene Displays<br />Pretty Playthings or Powerful Pictures?<br />
  2. 2. Jane Farrall<br />Speech Pathologist<br />AAC Support Services Manager<br />Spectronics<br />
  3. 3. Visual Scene Displays<br />A visual scene display (VSD) is a picture, photograph, or virtual environment that depicts and represents a situation, place or experience. Individual elements such as people, actions and objects appear within the visual scene (Blackstone, 2004). <br />
  4. 4. Visual Scene Displays<br />Different from a traditional grid display<br />The visual scene shows elements such as people, actions and objects in a visually integrated image.<br />Messages can be accessed from the picture.<br />Additional displays might also be triggered from the visual scene display<br />
  5. 5. Visual Scene Displays<br />Visual scene displays (VSDs) are meant primarily to address the needs of beginning communicators and individuals with significant cognitive and/or linguistic limitations. These groups are unserved or underserved by current AAC technologies. (Blackstone, 2004)<br />
  6. 6. Let’s have a look....<br />
  7. 7. Why so common recently?<br />VSDs are much easier to do on dynamic display touch screens<br />Dynamic display touch screens are now common and with a range of software options<br />Dynamic display touch screens are more portable e.g. iPad, Maestro<br />
  8. 8. Three main areas of research with VSDs<br />People with aphasia<br />Children with Autism Spectrum Disorder<br />Young children with Complex Communication Needs<br />Majority (but not all) of this research has been conducted by members of AAC RERC<br />
  9. 9. VSDs and people with Aphasia<br />Research primarily conducted by David Beukelman and colleagues. Summary webcast available at<br />Looked at research which showed that AAC and Speech Generating Devices (SGDs) were most successful with people who retained literacy<br />Wanted to look at ways of allowing people without literacy skills to retain social networks<br />
  10. 10. VSDs and people with aphasia<br />Beukelman et al (2003), Beukelman et al (2007) and AAC RERC (2009)<br />VSDs have been very successful with people with chronic aphasia<br />Need to be customised, real photos from their life. Higher uptake if individual is involved in selection of pictures and generation of utterances<br />
  11. 11. VSDs and people with aphasia <br />“After her stroke, our mother refused to attend (social) functions due to embarrassment of the challenges she faced when interacting with people outside of her immediate family . . . Her success (with a Visual Scenes Display AAC device) led to a renewed interest in attending family gatherings. Six weeks after the introduction of (the AAC device), she left her house for the first time (after her stroke), to engage socially – she went to a family holiday gathering’’ (Personal communication with the adult daughter of a woman with severe, chronic aphasia, Beukelman et al 2007)<br />
  12. 12. VSDs and people with aphasia<br />The most successful VSDs:<br />Provide context (setting, people, objects and activities)<br />Show Interaction with people or the environment<br />Are personally relevant<br />Are clear photos<br />Have the ability to be used for personal story telling<br />
  13. 13. Environment: Low<br />Interaction: None<br />Personal relevance: Medium<br />Clarity: High<br />
  14. 14. Environment: High<br />Interaction: High<br />Personal relevance: High<br />Clarity: High<br />
  15. 15. Environment: Low<br />Interaction: Low<br />Personal relevance: Low<br />Clarity: High<br />
  16. 16. Environment: High<br />Interaction: High<br />Personal relevance: High<br />Clarity: High<br />
  17. 17. VSDs and people with aphasia<br />Lots of Publisher templates available with tested formats<br />From<br />Visual Scene Display – Adult (Aphasia/TBI) user in DynaVox Series 5 devices<br />
  18. 18. VSDs and children with Autism Spectrum Disorder<br />Research primarily conducted by Howard Shane and colleagues. <br />Looked at VSDs as<br />Visual Expressive Mode<br />Visual Organizational Mode<br />Visual Instructional Mode<br />Called VSDs “Maps”<br />
  19. 19. Visual Maps<br />
  20. 20. Visual Organisational Mode<br />Maps can be more successful than traditional schedules or charts because they convey more information<br />Can convey not just that the individual will be going to McDonalds but also when, who will attend and what will happen.<br />
  21. 21. Visual Instructional Mode<br />Visual scenes compensated for the child’s comprehension or auditory processing difficulties (helped them to understand better what was being said by others)<br />Built comprehension<br />
  22. 22. Puddingstone Place<br />This was created as an interactive virtual environment for children to learn language<br />
  23. 23. Boston Children’s Hospital<br />Now looking into use of iPads as visual supports throughout the day<br /><br />
  24. 24. VSD Apps<br />Lots of talking photo album options e.g. Click ‘nTalk.<br />SceneSpeak<br />Scene&Heard<br />
  25. 25. Visual Expressive Mode<br />Drager et al. (2005) repeated some of the studies done with children with developmental disabilites and found similar results in a study of preschoolers with autism (ages 3 – 5).<br />
  26. 26. VSDs and young children<br />Research primarily conducted by Janice Light and colleagues. Summary webcast available at<br />Idea partly came from a AAC RERC meeting where the feedback from parents was that SGDs needed to:<br />Decrease learning demands<br />Increase appeal<br />
  27. 27. Children and Symbols<br />Drager et al (2008) asked typically developing children to draw pictures of 10 emerging language concepts.<br />The children’s pictures were:<br />Grounded in context<br />Involved familiar experiences<br />Used entire scenes<br />This was mostly consistent across a variety of ethnic/cultural groups.<br />
  28. 28. Generic VSD for young child<br />
  29. 29. Hybrid VSD for young child<br />
  30. 30. VSDs and young children<br />Drager et al (2003) found that 2.5 year olds were most accurate locating vocabulary on VSDs even if displays were not customised for them<br />Drager et al (2004) found that 3 year olds had trouble with all forms of vocabulary arrangement on initial exposure, but after just one session performed significantly better with the visual scenes than a grid format.<br />
  31. 31. VSDs and young children<br />Light et al (2004) found that by ages 4 and 5, the children were able to locate vocabulary within the visual scene displays and the grid layouts with similar levels of accuracy, but they had significant difficulty learning to use iconic encoding.<br />
  32. 32. VSDs and Young Children<br />Light and Drager (2008) reported on a study using VSDs with young children with developmental disabilities, aged 1 – 3. <br />They concluded: .....<br />
  33. 33. Young Children and VSDs<br />All the children were able to use VSDs to participate in social interactions with only one session of modelling<br />The children demonstrated significant increases in turn taking immediately <br />The children sustained these turn taking and social communication gains<br />Children tended to plateau, but improved again following introduction of hybrid scenes and then grid displays<br />
  34. 34. VSDs and Young Children <br />A lot of this research has had small sample sizes and in some studies children were only exposed to SGDs for short periods each time<br />Focus has been on making AAC easier, acknowledging limited intervention many children receive<br />
  35. 35. Case Study<br />
  36. 36. Dynamic Display Devices<br />Lucas received his first dynamic display device (Dynavox MT4) when he was 6 years old.<br />At the time his multi-level communication book was organised by ‘semantic categories’ and so his device mirrored this.<br />
  37. 37. Dynamic Display Devices<br /><ul><li>When he was 9 years old Lucas received a Dynavox V.
  38. 38. He had a Pragmatically Organised Dynamic Display (PODD) communication book.</li></li></ul><li>Using Visual Scene Displays<br />Why it was decided to use VSDs<br />Already was programmed on the device<br />Evidence suggested it was an effective way for some people to communicate<br />Lucas was motivated to use <br />As he was motivated it was hoped using them would increase his device use<br />
  39. 39. Visual Scene Displays<br />Advantages<br />Lucas like the idea of them and was more motivated to use his device<br />They look ‘pretty’ and so appealed to other people, making them more motivated to use the device<br />Disadvantages<br />It takes a long time to scan to parts of the visual scene<br />It adds an extra cognitive step to the process (ie remembering where in the visual scene things are placed) particularly because of moving between PODD and VSDs<br />It makes it difficult for other people to model the device as it is impossible/difficult to tell where things are placed on the visual scene<br />At times the visual scene itself can be a distraction<br />Using VSDs means that any multi-level communication book must be organised differently. For Lucas this meant learning and remembering two systems – VSDs and his PODD book.<br />
  40. 40. PODD<br />Due to the disadvantages Lucas now uses a PODD communication book and his device is programmed to reflect this book as closely as possible.<br />
  41. 41. References<br />AAC RERC. (2009). AAC for Aphasia: A Review of Visual Scenes Display Project. Retrieved April 27, 2009, from<br />AAC RERC. (2009). AAC Interventions to Maximize Language Development for Young Children. Retrieved April 27, 2009, from<br />ASHA. (2009). Children’s Representations of Early Language Concepts: Implications for AAC Symbols. Retrieved May 01, 2009 from<br />
  42. 42. References<br />Beukelman, D., Fager, S., Ball, L. and Dietz, A. (2007). AAC for adults with acquired neurological conditions: A review. Augmentative and Alternative Communication, 23(3), 230 – 242<br />Beukelman, D., Fager, S., Ball, L., Prentice, C., Jakobs, T., & Caves, K. (2003). New AAC interfaces: Field test results. ASHA Leader, 8, 144.<br />Blackstone, S. (2004). Clinical news: Visual scene displays. Augmentative Communication News, 16(2), 1-8. <br />
  43. 43. References<br />Drager, K., Light, J., Carlson, R., D’Silva, K., Larsson, B., Pitkin, L. (2004). Learning of Dynamic Display AAC Technologies by Typically Developing 3-Year-Olds: Journal of Speech, Language and Hearing Research, 47(5), 1133– 1149<br />Drager, K., Light, J., Curran-Speltz, J., Fallon, K., & Jeffries, L. (2003). The performance of typically developing 2 ½-year-olds on dynamic display AAC technologies with different system layouts and language organizations. Journal of Speech, Language and Hearing Research, 46, 298 – 312.<br />
  44. 44. References<br />Drager, K., Light, J., Angert, E., Finke, E., Johnson, J., Larson, H., et al. (2005). AAC & interactive play: Language learning in children with autism. Seminar presented at the annual conference of the American Speech Language Hearing Association, San Diego, CA<br />HB Munroe Barkley AAC Centers. (2009). Visual Scene Resources. Retrieved April 28, 2009, from<br />Light, J., & Drager, K. (2004). Re-thinking access to AAC technologies for young children: Simplifying the learning demands. Perspectives on Augmentative and Alternative Communication, 13, 5 – 12.<br />
  45. 45. References<br />Light, J. & Drager, K. (2008) Evidence-based AAC interventions to build language and communication skills with infants, toddlers and preschoolers. Paper presented at the ISAAC biennial conference, Montreal, Canada.<br />Light, J., Drager, K., McCarthy, J., Mellott, S., Parrish, C., Parsons, A., et al. (2004). Performance of typically developing four and five year old children with AAC systems using different language organization techniques. Augmentative and Alternative Communication, 20, 63 – 88.<br />
  46. 46. References<br />Light, J. and Drager, K. (2007) AAC technologies for young children with complex communication needs: State of the science and future research directions, Augmentative and Alternative Communication,23(3), 204 – 216<br />Shane, H. C. (2006). Using visual scene displays to improve communication and communication instruction in persons with Autism Spectrum Disorders. Perspectives in Augmentative and Alternative Communication, 15(1), 8 – 13.<br />