0
Syntherella: A Feedback Synthesizer forEfficient Exploration of Virtual Worlds using a Screen Reader<br />BugraOktay and E...
Outline<br />Intro<br />Problem<br />Syntherella<br />Discussion<br />Future Work<br />
Introduction<br />Virtual World<br />Screen Reader<br />
Introduction<br />Virtual World<br />TextSL<br />
Problem<br />Densely Populated Environments<br />Lots of Information to consume<br />Easy with visual perception; overwhel...
Problem (cnt’d)<br />Command-line interface<br />“describe”<br />“describe objects”<br />Iterative Queries<br />“describe ...
Syntherella<br />There are 5 animals, 4 tools, a house and a bike.<br />There are 2 books, a cat, a dog and a house to you...
Syntherella: Scanning<br />Scanning objects inside a virtual circle around the user’s avatar where the radius is defined b...
Syntherella: Filtering<br />Filtering objects that do not contribute to the textual description of the environment (i.e. o...
Syntherella: Thresholding<br />Good enough<br />74<br />table<br />cat<br />laptop<br />book<br />30<br />Size / Distance ...
Syntherella: Grouping<br />book<br />book<br />cat<br />book<br />chair<br />cat<br />chair<br />table<br />chair<br />tab...
Syntherella: Aggregation<br />There are<br />object<br />11 objects.<br />animal<br />vehicle<br />…<br />2 bikes and 9 an...
Syntherella: Detailing<br />There are 2 cats to your north; 1 cat to your south and 2 chairs to your east.<br />Level 2:3 ...
Syntherella: Example<br />“describe objects”<br />There are 936 objects: window, object, prim, box_by_vi$boyz, chair, tree...
Syntherella: Example<br />After scanning<br />There are 87 objects: frame, object, dog, step, object, object, object, cat,...
Syntherella: Example<br />After thresholding<br />There are 14 objects: dog, cat, tree, rose, chair, dog, chair, table, ca...
Syntherella: Example<br />After detailing<br />There are 2 dogs, 1 cat, 2 trees to your north; 4 chairs, 1 table, 1 rose t...
Discussion & Future Work<br />http://ear.textsl.org<br /><ul><li>Information Source
Perceptional Challenges
Upcoming SlideShare
Loading in...5
×

syntherella feedback synthesizer

354

Published on

This presentation describes a mechanism for synthesizing meaningful concise descriptions for exploring virtual worlds using a screenreader.

Published in: Technology, Lifestyle
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
354
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "syntherella feedback synthesizer"

  1. 1. Syntherella: A Feedback Synthesizer forEfficient Exploration of Virtual Worlds using a Screen Reader<br />BugraOktay and EelkeFolmer<br />Player-Game Interaction Lab<br />
  2. 2. Outline<br />Intro<br />Problem<br />Syntherella<br />Discussion<br />Future Work<br />
  3. 3. Introduction<br />Virtual World<br />Screen Reader<br />
  4. 4. Introduction<br />Virtual World<br />TextSL<br />
  5. 5. Problem<br />Densely Populated Environments<br />Lots of Information to consume<br />Easy with visual perception; overwhelming when transformed into text<br />overwhelming<br />
  6. 6. Problem (cnt’d)<br />Command-line interface<br />“describe”<br />“describe objects”<br />Iterative Queries<br />“describe table”<br />Slow interaction<br />(even when there are very few objects)<br />“zzz… zzz…”<br />Consumable<br />
  7. 7. Syntherella<br />There are 5 animals, 4 tools, a house and a bike.<br />There are 2 books, a cat, a dog and a house to your west; a dog, a bike … to your east; ... 2 cats are described as “Angora cat with blue eyes”. One of them is interactive and for sale for $20 ...<br />
  8. 8. Syntherella: Scanning<br />Scanning objects inside a virtual circle around the user’s avatar where the radius is defined by the user.<br />
  9. 9. Syntherella: Filtering<br />Filtering objects that do not contribute to the textual description of the environment (i.e. objects with non-descriptive or meaningless names).<br />
  10. 10. Syntherella: Thresholding<br />Good enough<br />74<br />table<br />cat<br />laptop<br />book<br />30<br />Size / Distance /<br />Name / Description /<br />Interaction Capabilities<br />undescriptive<br />box<br />too small<br />stone<br />too far<br />cat<br />16<br />
  11. 11. Syntherella: Grouping<br />book<br />book<br />cat<br />book<br />chair<br />cat<br />chair<br />table<br />chair<br />table<br />book<br />chair<br />cat<br />cat<br />chair<br />chair<br />chair<br />cat<br />cat<br />chair<br />cat, book, chair, chair, cat, table, chair, book, chair and cat.<br />3 cats, 2 books, 4 chairs and table.<br />
  12. 12. Syntherella: Aggregation<br />There are<br />object<br />11 objects.<br />animal<br />vehicle<br />…<br />2 bikes and 9 animals.<br />mammal<br />reptile<br />ground vehicle<br />2 bikes, 8 mammals and a snake.<br />…<br />more specific<br />cat<br />dog<br />snake<br />bike<br />2 bikes, 3 cats, 5 dogs and a snake.<br />
  13. 13. Syntherella: Detailing<br />There are 2 cats to your north; 1 cat to your south and 2 chairs to your east.<br />Level 2:3 cats are described as “Angora cat with blue eyes”. 2 chairs are described as “black leather office chair”. <br />Level 3:3 cats are described as “Angora cat with blue eyes”. 2 of them are interactive. 1 of them is not interactive. 2 chairs are described as “black leather office chair”. They are not interactive.<br />Level 4:3 cats are described as “Angora cat with blue eyes”. 1 of them is interactive but not for sale. 1 of them is interactive and for sale for L300. 1 of them is not interactive and not for sale. 2 chairs are described as “black leather office chair”. They are not interactive but for sale for L20.<br />
  14. 14. Syntherella: Example<br />“describe objects”<br />There are 936 objects: window, object, prim, box_by_vi$boyz, chair, tree, flowerz, book v2.0, stone, dog, cat, book, window, window, object, object, cat, no_name, obj23, owl, table, window, object, notecard dispenser, SL educational places kiosk, landmark_3.4, buy_me_L34, object, window, table, chair, chair, car, chair, bicycle, rabbit, rose, chair, chalk, object, skidzPrimz, object4, box7, window, door, tableXY, object, object, paper clip v4.0, lcd screen with remote, voice activated robot helper, phone booth, object, skidzPrimz, object4, box7, window, door, tableXY, object, object, paper clip v4.0, lcd screen with remote, voice activated robot helper, phone booth, window, object, prim, box_by_vi$boyz, chair, tree, flowerz, book v2.0, stone, dog, cat, book, window, window, object, object, cat, no_name, obj23, owl, table, window, object, notecard dispenser, SL educational places kiosk, landmark_3.4, buy_me_L34, object, window, table, chair, chair, car, chair, bicycle, rabbit, rose, chair, chalk, object, skidzPrimz, object4, box7, window, door, tableXY, object, object, paper clip v4.0, lcd screen with remote, voice activated robot helper, phone booth, object, skidzPrimz, object4, box7, window, door, tableXY, object, object, paper clip v4.0, lcd screen with remote,<br />Pretty long<br />
  15. 15. Syntherella: Example<br />After scanning<br />There are 87 objects: frame, object, dog, step, object, object, object, cat, prim, box_by_vi$boyz, object, stone, tree, rose, chair, object, object, frame, nozd_jkie&&jack, stone, step, dog, object, object, object, object, chair, table, cat, object, prim, prim, tree, prim, box, Julia’s Gull, cat, chair, object, object, object, object, object, prim, prim, object, stone, step, object, chair, table, cat, object, prim, prim, tree, prim, box, cat, chair, object, object, object, object, object, prim, prim, object, stone and step.<br />After filtering<br />There are 26 objects: frame, dog, step, cat, stone, frame, tree, rose, chair, frame, stone, dog, chair, table, cat, cat, chair, stone, step, stone, tree, chair, stone, step, Julia’s Gull and frame.<br />
  16. 16. Syntherella: Example<br />After thresholding<br />There are 14 objects: dog, cat, tree, rose, chair, dog, chair, table, cat, cat, chair, tree, chair and Julia’s Gull.<br />After grouping<br />There are 14 objects: 2 dogs, 3 cats, 2 trees, rose, 4 chairs, table and Julia’s Gull.<br />After aggregation (word limit: 14)<br />There are 3 plants, 5 animals, 5 furniture and Julia’s Gull.<br />After aggregation (word limit: 10)<br />There are 13 known and 1 unknown objects.<br />
  17. 17. Syntherella: Example<br />After detailing<br />There are 2 dogs, 1 cat, 2 trees to your north; 4 chairs, 1 table, 1 rose to your west and 2 cats, Julia’s Gull to your south. 2 dogs are described as “black and brown Saint Bernard”. 3 cats are described as “Angora cat with blue eyes”. 1 tree is described as “large oak tree”. 1 tree is described as “green and tall palmae tree”. 4 chairs are described as “brown stylish dining chair”. Rose is described as “Red rose”. Table is described as “diner table for 4”. Julia’s Gull is described as “Laughing gull that can fly; designed by Julia Doe”. <br />
  18. 18. Discussion & Future Work<br />http://ear.textsl.org<br /><ul><li>Information Source
  19. 19. Perceptional Challenges
  20. 20. User Studies
  21. 21. Performance Measurements
  22. 22. Widening the Scope (augmented reality, navigation, web accessibility etc.)
  23. 23. Goal/Intention Oriented Feedback Generation
  24. 24. Exploiting Command History</li></li></ul><li>Discussion & Future Work<br />http://ear.textsl.org<br /><ul><li>Information Source
  25. 25. Perceptional Challenges
  26. 26. User Studies
  27. 27. Performance Measurements
  28. 28. Widening the Scope (augmented reality, navigation, web accessibility etc.)
  29. 29. Goal/Intention Oriented Feedback Generation
  30. 30. Exploiting Command History</li></ul>bugra@cse.unr.edu<br />
  1. ¿Le ha llamado la atención una diapositiva en particular?

    Recortar diapositivas es una manera útil de recopilar información importante para consultarla más tarde.

×