SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects

SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects Bei Yuan, Manjari Sapre, Eelke Folmer - Graphics Interface 2010, Ottawa Player Game Interaction Research University of Nevada, Reno

Virtual Worlds Education Museums Communities Player Game Interaction Research University of Nevada, Reno

Accessibility Player Game Interaction Research University of Nevada, Reno

Accessibility TextSL Player Game Interaction Research University of Nevada, Reno

Interaction & Feedback Navigation {move, teleport, follow....} Interaction {say, whisper, mute, sit on....} Query {describe, where, help} chair >describe “there is 1 person and 3 objects.” ﬁre >describe objects dog “there is a chair, a ﬁre and a dog” jill >describe dog “the dog is barking” Player Game Interaction Research University of Nevada, Reno

Compiling Feedback object with a really long name chest car jill moe wall table tree chair tree jack bike dog tree tree bike curly tree ﬁre larry bike bike bike Player Game Interaction Research University of Nevada, Reno

Compiling Feedback object with a really long name chest car jill moe ? wall ? table tree ? chair tree jack ? bike dog tree ? tree ? tree bike curly ﬁre ? larry bike bike bike Player Game Interaction Research University of Nevada, Reno

Useful ? ? ? ? ? ? ? >describe objects “there is an object, an object, an object, an object, an object..... Player Game Interaction Research University of Nevada, Reno

Useful Player Game Interaction Research University of Nevada, Reno

Useful cat pig dog car truck car bike >describe objects “there is a cat a dog, a car, a bike a car, a truck and a pig Player Game Interaction Research University of Nevada, Reno

Useful cat pig dog car truck car object taxonomy animals vehicles bike dog cat pig bike car truck >describe objects “there is a cat a dog, a car, a bike a car, a truck and a pig >describe objects “there are 3 animals and 3 vehicles Player Game Interaction Research University of Nevada, Reno

Labeling web images - Deﬁned in Isolation - Segmentation - Solid bodies (prims) - 2D info - Eﬃcient discrimination Player Game Interaction Research University of Nevada, Reno

Construct Classiﬁer object categories shape descriptors unknown object Player Game Interaction Research University of Nevada, Reno

Human based Computation “chair” “kitty” “cat” Player Game Interaction Research University of Nevada, Reno

Human based Computation “chair” “kitty” “cat” Tedious Player Game Interaction Research University of Nevada, Reno

Human based Computation Game “chair” “kitty” “cat” Tedious Fun? Player Game Interaction Research University of Nevada, Reno

Games with a Purpose ESP Game Phetch Web images Google Image Labeler ? Player Game Interaction Research University of Nevada, Reno

Seek-n-Tag Find a Cat Goal: »Player participates in Scavenger hunt ✔ + 5s Rules: Find a Tree »30 seconds to “tag” an object ✔ + 15s »Score 50 points per tagged object »Initially start with 900 seconds Find a Dog »Game over when time =0 ✘ - 30s »Remaining time is added to clock. Competition Find a Shoe »Leaderboard ✔ + 10s Player Game Interaction Research University of Nevada, Reno

Title Text

How do we learn from Tagging? Find a Cat Player Game Interaction Research University of Nevada, Reno

How do we learn from Tagging? Find a Cat “tag” Player Game Interaction Research University of Nevada, Reno

How do we learn from Tagging? Find a Cat “tag” “tag” Player Game Interaction Research University of Nevada, Reno

How do we learn from Tagging? Find a Cat “tag” “tag” “tag” Player Game Interaction Research University of Nevada, Reno

How do we learn from Tagging? Find a Cat “tag” “tag” animals “tag” Player Game Interaction Research University of Nevada, Reno

What to look for? Find a Cat cat ✔ dog ✘ Player Game Interaction Research University of Nevada, Reno

What to look for? Player Game Interaction Research University of Nevada, Reno

What to look for? Find an animal dog Player Game Interaction Research University of Nevada, Reno

What to look for? Find an animal “tag” dog Player Game Interaction Research University of Nevada, Reno

What to look for? Find an animal “tag” “tag” dog Player Game Interaction Research University of Nevada, Reno

What to look for? Find an animal “tag” cat → animal horse → animal “tag” dog Player Game Interaction Research University of Nevada, Reno

What to look for? Find an animal “tag” dog → animal cat → animal horse → animal “tag” dog Player Game Interaction Research University of Nevada, Reno

User Study Seek-n-Tag vs Manual Labeling object object object object object object object object object object object object object object object A object object B object object object object object object object object object object object object object “dog” naming “car” Player Game Interaction Research University of Nevada, Reno

User Study Seek-n-Tag vs Manual Labeling object object object object object object object object object object object object object object object A object object B object object object object object object object object object object object object object Player Game Interaction Research University of Nevada, Reno

User Study Seek-n-Tag vs Manual Labeling object object object object object object object object object object object object object object object A object object B object object object object object object object object object object object object object dog dog Find a Car pig pig Find a dog tree tree seek-n-tag Player Game Interaction Research University of Nevada, Reno

Results Naming: »31 names for location A »35 names for location B Seek-n-tag: »used 50 names »No timeouts  Naming & Seek-n-tag »consensus for 45 objects Player Game Interaction Research University of Nevada, Reno

Accuracy !&" !*" 3647,8"9:";7<,=>?" #*" &'" &)" &&" %" &*" $" (" !" #" &" *" @9/:5A,/=,"B"&" #" !" (" $" +,,-./.012" 3145/2" Player Game Interaction Research University of Nevada, Reno

Eﬃciency '$!" '#!" />=+"?4+@">."*+:7.@4"" '!!" &!" %!" $!" #!" !" A7.B>@+.:+"C"'" #" (" $" )" *++,-.-/01"234+56" *++,-.-/01"2789+:;6" <0=>.1" Player Game Interaction Research University of Nevada, Reno

Usability Player Game Interaction Research University of Nevada, Reno

Summary & Future work Tagging is more efficient than naming How to spend tagging efforts most cost effectively? Evaluate: »seek-n-tag’s ability to create a taxonomy »real environments Player Game Interaction Research University of Nevada, Reno

Acknowledgements more info? contribute? Bei Yuan textsl.org feedback? collaborate? Manjari Sapre IIS-0917362: HCC-Small: TextSL: A Virtual World Interface for Visually Impaired. (Eelke Folmer / George Bebis) Player Game Interaction Research University of Nevada, Reno

Questions? ? ? ? ? ? Player Game Interaction Research University of Nevada, Reno

SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects

by eelke folmer on Jul 31, 2010

Accessibility

Tags

Upload Details

Usage Rights

2 Embeds 8

Statistics

SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects — Presentation Transcript

http://thinkingontheknoll.weebly.com	7
http://www.weebly.com	1