Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Real time sensory substitution of a bingo game

871 views

Published on

This presentation evaluates

  • Be the first to comment

  • Be the first to like this

Real time sensory substitution of a bingo game

  1. 1. Supplemental Sonification of a Bingo Game Daniel Ramos, Eelke Folmer - FDG’11, Bordeaux Player-Game Interaction Research University of Nevada, Reno
  2. 2. Why How do we play games? Player-Game Interaction Research University of Nevada, Reno
  3. 3. Why How do we play games?1.Game provides feedback {visual,audio,haptic} Player-Game Interaction Research University of Nevada, Reno
  4. 4. Why How do we play games? POW1.Game provides feedback {visual,audio,haptic} Player-Game Interaction Research University of Nevada, Reno
  5. 5. Why How do we play games? Bzzzzzz POW1.Game provides feedback {visual,audio,haptic} Player-Game Interaction Research University of Nevada, Reno
  6. 6. Why How do we play games? Bzzzzzz POW1.Game provides feedback {visual,audio,haptic}2.Player determines in game response (shoot) Player-Game Interaction Research University of Nevada, Reno
  7. 7. Why How do we play games? Bzzzzzz POW1.Game provides feedback {visual,audio,haptic}2.Player determines in game response (shoot)3.Player provides input (press button) Player-Game Interaction Research University of Nevada, Reno
  8. 8. Why How do we play games? Bzzzzzz POW1.Game provides feedback {visual,audio,haptic}2.Player determines in game response (shoot)3.Player provides input (press button)4.goto 1 until gameover or finished Player-Game Interaction Research University of Nevada, Reno
  9. 9. Generalize steps pong mario kart fps1. feedback 1. feedback 1. feedback2. up/down 2. le//right/gas 2. le//right/shoot3. button 3. wheel 3. button / mouse Player-Game Interaction Research University of Nevada, Reno
  10. 10. Gameplay State Machine Player-Game Interaction Research University of Nevada, Reno
  11. 11. Choice Response TaskStimulus Player-Game Interaction Research University of Nevada, Reno
  12. 12. Choice Response TaskStimulus visual Response Player-Game Interaction Research University of Nevada, Reno
  13. 13. Choice Response TaskStimulus visual Response + audio Response Player-Game Interaction Research University of Nevada, Reno
  14. 14. Choice Response TaskStimulus visual Response + audio Response + haptic Response Player-Game Interaction Research University of Nevada, Reno
  15. 15. Choice Response Task multimodal representation:Stimulus performance++ error-- visual Response + audio Response + haptic Response Player-Game Interaction Research University of Nevada, Reno
  16. 16. Role of Feedback Bzzzzzz POW Player-Game Interaction Research University of Nevada, Reno
  17. 17. Role of Feedback POW Player-Game Interaction Research University of Nevada, Reno
  18. 18. Role of Feedback Bzzzzzz Player-Game Interaction Research University of Nevada, Reno
  19. 19. Role of Feedback Bzzzzzz POW Player-Game Interaction Research University of Nevada, Reno
  20. 20. Role of Feedback Bzzzzzz POW Player-Game Interaction Research University of Nevada, Reno
  21. 21. Video GamesStimulus visual Response Player-Game Interaction Research University of Nevada, Reno
  22. 22. Video GamesStimulus visual Response + audio Response ? Player-Game Interaction Research University of Nevada, Reno
  23. 23. Research QuestionCan supplemental sonificationincrease performance & reduceplayer errors? Player-Game Interaction Research University of Nevada, Reno
  24. 24. What is Bingo Ball callsPatterns Multiple Bingos » horizontal » single line » vertical » full card » diagonal Player-Game Interaction Research University of Nevada, Reno
  25. 25. What is Bingo Ball calls 16Patterns Multiple Bingos » horizontal » single line » vertical » full card » diagonal Player-Game Interaction Research University of Nevada, Reno
  26. 26. What is Bingo Ball calls 16 48Patterns Multiple Bingos » horizontal » single line » vertical » full card » diagonal Player-Game Interaction Research University of Nevada, Reno
  27. 27. What is Bingo Ball calls 16 48 63Patterns Multiple Bingos » horizontal » single line » vertical » full card » diagonal Player-Game Interaction Research University of Nevada, Reno
  28. 28. What is Bingo Ball calls 16 48 63 “Bingo”Patterns Multiple Bingos » horizontal » single line » vertical » full card » diagonal Player-Game Interaction Research University of Nevada, Reno
  29. 29. is Bingo a Video game? Player-Game Interaction Research University of Nevada, Reno
  30. 30. is Bingo a Video game?»Up to 100 cards»Shows cards closest to Bingo»jurisdiction determines how bingo is played Player-Game Interaction Research University of Nevada, Reno
  31. 31. Bingo is BIG business2009 Player-Game Interaction Research University of Nevada, Reno
  32. 32. Bingo is BIG business2009»Charitable Bingo -> 1.8 Billion (US)»WoW -> 1.0 Billion (worldwide) Player-Game Interaction Research University of Nevada, Reno
  33. 33. Why Bingo?SimpleFinite ~bingo <24 callsControllable Player-Game Interaction Research University of Nevada, Reno
  34. 34. Who plays Bingo? Player-Game Interaction Research University of Nevada, Reno
  35. 35. Who plays Bingo? Player-Game Interaction Research University of Nevada, Reno
  36. 36. Bingo Demographics 57% female 11% age 65 and up 20% are 18-24 year olds (UK) Online bingo > 20% market share Player-Game Interaction Research University of Nevada, Reno
  37. 37. avoiding a sleeperBingo casino halls are crowded / noisyplayers more likely to have sensory impairment due to their ageplayers play with a large number of cards Player-Game Interaction Research University of Nevada, Reno
  38. 38. SonificationDisplaying data in non speech audio »Geiger counterTypes of sonification: »Volume »Pitch »Timbre {instruments} »Frequency of a repetitive cue »Audio IconsSensory substitutionAudio Games (users with visual impairments) Player-Game Interaction Research University of Nevada, Reno
  39. 39. Simulator Player-Game Interaction Research University of Nevada, Reno
  40. 40. Simulator Player-Game Interaction Research University of Nevada, Reno
  41. 41. Away Count ac = two ac = threeAC is the smallest value for any pattern Player-Game Interaction Research University of Nevada, Reno
  42. 42. Types of sonificationTypes »Pitch {99hz, 119hz, 156hz, 193hz} »Timbre {piano, cello, organ, pan flute} »Audio Icons {dog, jackhammer, cash register, audience clapping}Length ~ 1 secondOnly sonify when AC changes for a card Player-Game Interaction Research University of Nevada, Reno
  43. 43. Test Away Countrandom intervals (avg 6 calls between test)log: »value of provided AC and AC for each card »time it takes to do test Player-Game Interaction Research University of Nevada, Reno
  44. 44. Demo Player-Game Interaction Research University of Nevada, Reno
  45. 45. User study9 participants2 female / 7 maleage = 41.2 (SD=12.8)Expert Bingo PlayersNo impairmentsVersions {none, pitch, audiocon, timbre}Randomized & Balanced4 Tests or BingoQuestionnaire Player-Game Interaction Research University of Nevada, Reno
  46. 46. Results Table 1: Results of Bingo simulation. Type Error σ Time (ms) σ (ms) NONE 0.241 0.19 16,554 22,677 PITCH 0.105 0.14 9,879 5,672 TIMBRE 0.074 0.11 9,149 8,510 AUDIOICON 0.059 0.06 6,954 1,815 Significant No Significant P<0.05 p> 0.05 good health, with no hearing or vision impairments (some Post Hoc Tests had corrected vision) that could possibly impede their ability Timbre > None to play the game. Each user was given a brief explanation AudioIcons > None and walk-through of the application, a demonstration of the Pitch <> None different sounds and subjects were able to play a number ofa- games using <> Timbre AudioIcons different sonification techniques. Player-Game Interaction Researchof Subjects were tested alone in a room using a laptop.of There University Nevada, Reno
  47. 47. Qualitative resultsall subjects felt sonification helped »5 preferred audio icons »2 preferred pitch »1 preferred timbre »1 preferred timbre & pitch Player-Game Interaction Research University of Nevada, Reno
  48. 48. Discussion & future workSemiotics of audio iconsSonification can be facilitated on most daubersTest with sensory impairedUse in other gamesExplore haptic feedback drop 7 Player-Game Interaction Research University of Nevada, Reno
  49. 49. Discussion & future workSemiotics of audio iconsSonification can be facilitated on most daubersTest with sensory impairedUse in other gamesExplore haptic feedback drop 7 Player-Game Interaction Research University of Nevada, Reno
  50. 50. Questions Player-Game Interaction Research University of Nevada, Reno
  51. 51. Questions ? Player-Game Interaction Research University of Nevada, Reno

×